Add compact fixed-page CPU KV offload for packed heterogeneous caches - #32

Merged

jasl merged 6 commits into

jasl:codex/ds4-sm120-min-enablefrom

coltonottley:compact-cpu-kv-offload

Jul 21, 2026

Commits on Jul 20, 2026

Add compact CPU KV foundation

Colton Ottley
authored and
Little TARS
committed
Transport compact CPU KV geometry

Colton Ottley
authored and
Little TARS
committed
Plan compact CPU KV transfers

Colton Ottley
authored and
Little TARS
committed
Add compact CPU KV manager storage

Colton Ottley
authored and
Little TARS
committed
Wire compact CPU KV worker and spec

Colton Ottley
authored and
Little TARS
committed

Commits on Jul 21, 2026

Fix compact transfers to bypass CUDA batch copies
Colton Ottley
committed