Skip to content

[None][feat] Shared drafter KV pools, FP8 MLA context inputs and KV cache V2 copy/memory fixes for hybrid speculative models - #21972

Open
xguannv wants to merge 11 commits into
NVIDIA:mainfrom
xguannv:xguan/k3-rubin-runtime
Open

[None][feat] Shared drafter KV pools, FP8 MLA context inputs and KV cache V2 copy/memory fixes for hybrid speculative models#21972
xguannv wants to merge 11 commits into
NVIDIA:mainfrom
xguannv:xguan/k3-rubin-runtime

[None][fix] Keep the PyTorch memory cap at or above the memory PyTorc…

1fcae35
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Nov 10, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO