Skip to content

feat: batch a request's chunks through turbo in one forward pass (~2x) - #161

Open
malammar wants to merge 4 commits into
devnen:mainfrom
malammar:upstream-pr/chunk-batching
Open

feat: batch a request's chunks through turbo in one forward pass (~2x)#161
malammar wants to merge 4 commits into
devnen:mainfrom
malammar:upstream-pr/chunk-batching

fix: close a conds race and an unguarded index in chunk batching

d8925dd
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs