-
Notifications
You must be signed in to change notification settings - Fork 6
Open
Description
Can I know the python version and triton version you are using, I have an issue with 3.12.7 that I am using without a suitable version of triton, which cannot be done in a certain step: vllm serve OpenGVLab/InternVL2-Llama3-76B --served-model-name internlm2 --tensor-parallel-size 4
and the libraries in the requirements do not seem to be complete, and I have encountered installation problems with other libraries (e.g. triton) when configuring the environment, can you provide some more configuration details to help me reproduce the paper
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels