Record: pcloadloveletter v6 — Novel Codebook+Huffman Compression + AdamW TTT (val_bpb=1.0487)#532

Closed

NotADevIAmaMeatPopsicle wants to merge 12 commits intoopenai:mainfrom

NotADevIAmaMeatPopsicle:stacked-wins

Commits on Mar 19, 2026

Add pcloadloveletter stacked wins submission

NotADevIAmaMeatPopsicle
and
claude
committed
Rename submission to pcloadloveletter v1

NotADevIAmaMeatPopsicle
and
claude
committed
Add pcloadloveletter v2: int6+zstd, MLP 3x, SmearGate, late-K passthrough

NotADevIAmaMeatPopsicle
and
claude
committed
Fix int6 quantization: add outlier clipping + symmetric range

NotADevIAmaMeatPopsicle
and
claude
committed
Fix int6 scale clamp_min: 1/31 -> 1e-12

NotADevIAmaMeatPopsicle
and
claude
committed
Reduce MLP hidden 1536->1500 to fit 16MB artifact limit

NotADevIAmaMeatPopsicle
and
claude
committed
v3 upgrades: SWA, grad clip 0.3, batch 786K, stride 256

NotADevIAmaMeatPopsicle
and
claude
committed
Replace Muon with NorMuon: per-row second-moment normalization

NotADevIAmaMeatPopsicle
and
claude
committed

Commits on Mar 20, 2026

Commits on Mar 22, 2026

v5: Partial RoPE + LN Scale + XSA4 + Late QAT + Tight SWA + Novel Compression

NotADevIAmaMeatPopsicle
and
claude
committed

Commits on Mar 23, 2026

Record: pcloadloveletter v6 — 1.0487 BPB (Artie AI)
NotADevIAmaMeatPopsicle
committed