Record: 0.1582 BPB — Learned Mixer Head + No TTT + Matrix LR 0.03#859

Closed

bigbag wants to merge 5 commits intoopenai:mainfrom

bigbag:submission/learned-mixer-noTTT-lr03-0.1582

Commits on Mar 26, 2026

Record: 0.1582 BPB — Learned Mixer Head + No TTT + Matrix LR 0.03

Pavel Liashkov
and
claude
committed
Add 3-seed validation: mean 0.1583 ± 0.0001 BPB

Pavel Liashkov
and
claude
committed
Remove seed 2024 (truncated log) — rerunning

Pavel Liashkov
and
claude
committed

Commits on Mar 27, 2026

Update 2-seed validation: mean 0.1583 ± 0.0001 BPB

Pavel Liashkov
and
claude
committed
3-seed validation: mean 0.1584 ± 0.0008 BPB

Pavel Liashkov
and
claude
committed