Skip to content

Commit 03ea861

Browse files
koltondrakeclaude
andcommitted
Record: EGGROLL v2 — val_bpb 1.1161 (3-seed mean, std 0.0001)
val_bpb: 1.1161 | val_loss: 1.884 nats | ~15.3 MB | 8×H100 SXM | Legal TTT Seeds: 42=1.1163, 1337=1.1160, 2024=1.1161 | Mean=1.1161, Std=0.0001 Novel: EGGROLL Antithetic Ternary Bin Search — post-GPTQ bin refinement Also: adds missing TTT call to PR openai#1130 eval pipeline Built on PR openai#1130 by @Gusanidas, PR openai#549 by @abaybektursun Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
1 parent 9d070df commit 03ea861

5 files changed

Lines changed: 2778 additions & 0 deletions

File tree

Lines changed: 43 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,43 @@
1+
{
2+
"val_bpb": {
3+
"seed_42": 1.11625848,
4+
"seed_1337": 1.11604482,
5+
"seed_2024": 1.11605138,
6+
"mean": 1.11611823,
7+
"std": 0.00012151
8+
},
9+
"val_loss": {
10+
"seed_42": 1.88475069,
11+
"seed_1337": 1.88438993,
12+
"seed_2024": 1.88440101
13+
},
14+
"artifact_bytes": {
15+
"seed_42": 15227040,
16+
"seed_1337": 15427072,
17+
"seed_2024": 15398172
18+
},
19+
"code_bytes": 129638,
20+
"model_params": 27605108,
21+
"training_steps": {
22+
"seed_42": 8458,
23+
"seed_1337": 8457,
24+
"seed_2024": 8475
25+
},
26+
"training_time_ms": {
27+
"seed_42": 586085,
28+
"seed_1337": 586048,
29+
"seed_2024": 586082
30+
},
31+
"eval_method": "legal_ttt_sliding_window",
32+
"eval_stride": 64,
33+
"ttt_enabled": true,
34+
"ttt_lr": 0.002,
35+
"ttt_epochs": 3,
36+
"ttt_freeze_blocks": 2,
37+
"novel_contributions": [
38+
"EGGROLL: Antithetic Ternary Bin Search post-GPTQ refinement",
39+
"TTT call integration (missing from PR #1130)"
40+
],
41+
"base": "PR #1130 by @Gusanidas (Kitchen Sink V2)",
42+
"foundation": "PR #549 by @abaybektursun"
43+
}

0 commit comments

Comments
 (0)