Popular repositories Loading

1. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

2. recipes recipes Public

   Forked from vllm-project/recipes

   Common recipes to run vLLM

3. gpt-oss gpt-oss Public

   Forked from openai/gpt-oss

   gpt-oss-120b and gpt-oss-20b are two open-weight language models by OpenAI

   Python

4. vllm-ascend vllm-ascend Public

   Forked from vllm-project/vllm-ascend

   Community maintained hardware plugin for vLLM on Ascend

   Python

5. llm-service llm-service Public

   Forked from JiusiServe/LM-service

   Python

6. vllm-omni vllm-omni Public

   Forked from vllm-project/vllm-omni

   A high-throughput and memory efficient inference and serving engine for Omni-modality models

   Python