[ROCm][MoRI] WRITE mode support (layerwise xfer)#157

Merged

BugenZhao merged 32 commits into

vllm-project:mainfrom

simondanielsson:feature/mori-write-mode

May 6, 2026

Commits on Apr 23, 2026

Commits on Apr 27, 2026

fix: add do_remote_* to WRITE path creation of kv transfer params
simondanielsson
committed
refactor: use tokio::join! rather than spawn to avoid race condition
simondanielsson
committed

Commits on Apr 29, 2026

Commits on Apr 30, 2026

fix: propagate prefill errors
simondanielsson
committed
fix: support logsprobs from prefill also in WRITE mode
simondanielsson
committed
fix: enforce mori runs with zmq svc discovery
simondanielsson
committed
fix: commit xfer mode only after registration validation succeeds
simondanielsson
committed
fix: use send_client_request for prefill request in WRITE mode
simondanielsson
committed
fix: record failed prefills in WRITE mode with record_pd_prefill_error
simondanielsson
committed
fix: stop profile decode instance upon prefill error in WRITE mode
simondanielsson
committed

Commits on May 5, 2026

Commits on May 6, 2026