feat(ENG-EXPERT-STREAM-DEVICE): W0f — the dense weights were resident twice; --device cuda now decodes, and the token gate fails on a near-tie the alias is measured not to cause (#1299) - #1326

Closed

localai-bot wants to merge 8 commits into

row/ENG-EXPERT-STREAM-DEVICE-W0from

row/ENG-EXPERT-STREAM-DEVICE-W0F

Commits on Aug 19, 2026

feat(ENG-EXPERT-STREAM-DEVICE): W0f — the dense weights were resident twice, and that is what ran the box out (#1299)
mudler
committed
48b96bf
fix(ENG-EXPERT-STREAM-DEVICE): own the aligned block before anything that can throw, and include what W0f uses (#1299)
mudler
committed
af5c9ba
fix(ENG-EXPERT-STREAM-DEVICE): the aliased pointer outlived its host release, and the first device run could not say why it failed (#1299)
mudler
committed
3d34914
refactor(ENG-EXPERT-STREAM-DEVICE): name the invariant the host-mirror release depends on (#1299)
mudler
committed
9c783a8
fix(ENG-EXPERT-STREAM-DEVICE): W0e's numbers, and the review findings the device run did not touch (#1299)
mudler
committed
094ef88
test(ENG-EXPERT-STREAM-DEVICE): gate the two W0f repairs that had no case, so their mutations can fail (#1299)
mudler
committed
4b09703
docs(ENG-EXPERT-STREAM-DEVICE): cite the alignment gate that exists, not the one I remembered (#1299)
mudler
committed
7df165f
record(ENG-EXPERT-STREAM-DEVICE): quote the median decode step, not the ends of the range (#1299)
mudler
committed
a67c448