Skip to content

[Feature] Vanilla speculative decoding (standalone, opt-in offline interface) - #134

Open
javierlimt6 wants to merge 12 commits into
sgl-project:mainfrom
javierlimt6:feat/spec-decoding
Open

[Feature] Vanilla speculative decoding (standalone, opt-in offline interface)#134
javierlimt6 wants to merge 12 commits into
sgl-project:mainfrom
javierlimt6:feat/spec-decoding

[Fix] Skip special tokens when decoding CLI output

a8335e4
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs