Skip to content

spec(GDN-MOE-BF16-OUT): the GDN recurrence output and the z gate are f32 on every MoE checkpoint, and both references keep them bf16 - #1173

Merged
localai-bot merged 2 commits into
mainfrom
row/SPEC-GDN-MOE-BF16-OUT
Aug 18, 2026
Merged

spec(GDN-MOE-BF16-OUT): the GDN recurrence output and the z gate are f32 on every MoE checkpoint, and both references keep them bf16#1173
localai-bot merged 2 commits into
mainfrom
row/SPEC-GDN-MOE-BF16-OUT

Commits

Commits on Aug 18, 2026