10L MLP3x + BigramHash(2048) + SWA + Stride-32: 1.1487 BPB#331
Open
Rhodrium wants to merge 1 commit intoopenai:mainfrom
Open
10L MLP3x + BigramHash(2048) + SWA + Stride-32: 1.1487 BPB#331Rhodrium wants to merge 1 commit intoopenai:mainfrom
Rhodrium wants to merge 1 commit intoopenai:mainfrom