Enable DeepSeek-V3 Wide-EP disaggregated inference + fix DP=32 correctness - #181

Open

raviguptaamd wants to merge 6 commits into

ROCm:developfrom

raviguptaamd:dsv3-wideep-disagg-enablement

Commits on Jul 25, 2026

vllm_dissag: generalize NIAH harness (multi-seed, warmup, thinking-model-neutral)

raviguptaamd
and
claude
committed
390b9aa
vllm_dissag: 3-tier models.yaml env precedence (image-baked < yaml < submit -e)

raviguptaamd
and
claude
committed
98a616f
vllm_dissag: capture submit-time recipe-env protect-list + add niah benchmark selector

raviguptaamd
and
claude
committed
c80cad2
vllm_dissag: bound DeepSeek-V3 attention workspace with --max-model-len

raviguptaamd
and
claude
committed
d7d8cc3
vllm_disagg docker: build from shikpate MoRI-1.2.3 base + GLM-stripped vLLM

raviguptaamd
and
claude
committed
3db2228

Commits on Jul 26, 2026

vllm_dissag: default prefill MoRI backend to low_latency at EP>=32

raviguptaamd
and
claude
committed
a5f074f