Skip to content

perf(v4): batch decode sampling into a single sync (+3.6-11.7% tps) - #88

Merged
nosyndicate merged 1 commit into
mainfrom
phase4_40
Jul 23, 2026
Merged

perf(v4): batch decode sampling into a single sync (+3.6-11.7% tps)#88
nosyndicate merged 1 commit into
mainfrom
phase4_40

Commits

Commits on Jul 22, 2026