Skip to content

Long running test spawn too many threads #196

@sjmonson

Description

@sjmonson
Collaborator

The SyncManager process spawns a huge number of threads over the lifetime of the benchmark. On pid constrained systems (such as OpenShift) we can run out of threads during longer tests or with shorter requests.

Activity

self-assigned this
on Jun 24, 2025
sjmonson

sjmonson commented on Jun 26, 2025

@sjmonson
CollaboratorAuthor

This issue still occurs after replacing the SyncManager with shared queues.

sjmonson

sjmonson commented on Jun 26, 2025

@sjmonson
CollaboratorAuthor

After a bunch of testing I've found that the issue only occurs with Python 3.12.

markurtz

markurtz commented on Aug 13, 2025

@markurtz
Collaborator

Need to double check this after #251 lands

added this to the v0.3.0 milestone on Aug 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

Type

Projects

No projects

Relationships

None yet

    Development

    No branches or pull requests

      Participants

      @markurtz@sjmonson

      Issue actions

        Long running test spawn too many threads · Issue #196 · vllm-project/guidellm