-
Notifications
You must be signed in to change notification settings - Fork 237
[POC] Image generation multi-concurrency idea #2113
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
[POC] Image generation multi-concurrency idea #2113
Conversation
6565cf3
to
a141d7d
Compare
@dkalinowski, we've discussed this POC with @Wovchena and @ilya-lavrenov. It looks like the simplest and most transparent solution is to create new The
Example: Text2ImagePipeline: When calling
|
Thank you for the review. Here is the corrected version with the clone idea: #2190 Could you review before I proceed with remaining pipeline types? @likholat |
Increased number of infer requests for each model
Added a way to select infer request by
request_idx
Added GenerationRequest class to manage assignment of
request_idx