Popular repositories Loading

1. model_analyzer model_analyzer Public

   Forked from triton-inference-server/model_analyzer

   Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Server models.

   Python

2. claw-code claw-code Public

   Forked from ultraworkers/claw-code

   An agent-managed museum exhibit, built in Rust with Gajae-Code / LazyCodex — developed and maintained with no human intervention.

   Rust

3. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

4. flash-attention flash-attention Public

   Forked from Dao-AILab/flash-attention

   Fast and memory-efficient exact attention

   Python

5. miles miles Public

   Forked from radixark/miles

   Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.

   Python

6. tokenspeed tokenspeed Public

   Forked from lightseekorg/tokenspeed

   TokenSpeed is a speed-of-light LLM inference engine.

   Python