Closed
Description
It would be great to have an official container image with guidellm pre-packaged that can be easily consumed for running guidellm from inside a container.
As a reference, I have started a repo to help build an "unofficial" container here:
https://github.com/redhat-ai-services/guidellm-helper
Which publishes an image here:
https://quay.io/repository/redhat-ai-services/guidellm?tab=tags
I'm happy to help contribute it back to this repo if there is interest.
Metadata
Metadata
Assignees
Labels
No labels