@@ -41,11 +41,16 @@ For more details or customization options (including multinode deployments), see
4141
4242Each backend has deployment examples and configuration options:
4343
44- | Backend | Available Configurations |
45- | ---------| --------------------------|
46- | ** [ vLLM] ( /components/backends/vllm/deploy/README.md ) ** | Aggregated, Aggregated + Router, Disaggregated, Disaggregated + Router, Disaggregated + Planner, Disaggregated Multi-node |
47- | ** [ SGLang] ( /components/backends/sglang/deploy/README.md ) ** | Aggregated, Aggregated + Router, Disaggregated, Disaggregated + Planner, Disaggregated Multi-node |
48- | ** [ TensorRT-LLM] ( /components/backends/trtllm/deploy/README.md ) ** | Aggregated, Aggregated + Router, Disaggregated, Disaggregated + Router, Disaggregated Multi-node |
44+ ## Backend Configuration Matrix
45+
46+ | Configuration | [ vLLM] ( /components/backends/vllm/deploy/README.md ) | [ SGLang] ( /components/backends/sglang/deploy/README.md ) | [ TensorRT-LLM] ( /components/backends/trtllm/deploy/README.md ) |
47+ | ---------------| :---:| :-------:| :------------:|
48+ | ** Aggregated** | [ ✅] ( /components/backends/vllm/deploy/agg.yaml ) | [ ✅] ( /components/backends/sglang/deploy/agg.yaml ) | [ ✅] ( /components/backends/trtllm/deploy/agg.yaml ) |
49+ | ** Aggregated + Router** | [ ✅] ( /components/backends/vllm/deploy/agg_router.yaml ) | [ ✅] ( /components/backends/sglang/deploy/agg_router.yaml ) | [ ✅] ( /components/backends/trtllm/deploy/agg_router.yaml ) |
50+ | ** Disaggregated** | [ ✅] ( /components/backends/vllm/deploy/disagg.yaml ) | [ ✅] ( /components/backends/sglang/deploy/disagg.yaml ) | [ ✅] ( /components/backends/trtllm/deploy/disagg.yaml ) |
51+ | ** Disaggregated + Router** | [ ✅] ( /components/backends/vllm/deploy/disagg_router.yaml ) | ❌ | [ ✅] ( /components/backends/trtllm/deploy/disagg_router.yaml ) |
52+ | ** Disaggregated + Planner** | [ ✅] ( /components/backends/vllm/deploy/disagg_planner.yaml ) | [ ✅] ( /components/backends/sglang/deploy/disagg_planner.yaml ) | [ ✅] ( /components/backends/trtllm/deploy/disagg_planner.yaml ) |
53+ | ** Disaggregated Multi-node** | [ ✅] ( /components/backends/vllm/deploy/disagg-multinode.yaml ) | [ ✅] ( /components/backends/sglang/deploy/disagg-multinode.yaml ) | [ ✅] ( /components/backends/trtllm/deploy/disagg-multinode.yaml ) |
4954
5055## 3. Deploy Your First Model
5156
0 commit comments