Pinned Loading

1. vllm-omni vllm-omni Public

   Forked from vllm-project/vllm-omni

   A framework for efficient model inference with omni-modality models

   Python

2. MoonshotAI/checkpoint-engine MoonshotAI/checkpoint-engine Public

   Checkpoint-engine is a simple middleware to update model weights in LLM inference engines

   Python 993 101

3. gprMax/gprMax gprMax/gprMax Public

   gprMax is open source software that simulates electromagnetic wave propagation using the Finite-Difference Time-Domain (FDTD) method for numerical modelling of Ground Penetrating Radar (GPR)

   Python 867 390

4. vllm-project/afd-plugin vllm-project/afd-plugin Public

   vLLM plugin for attention-ffn disaggregation support

   Python 107 22

5. canhazgpu canhazgpu Public

   Forked from russellb/canhazgpu

   A simple GPU reservation tool for single host shared development systems

   Go 1

6. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python