[Feature] Add optional FP8 (float8_e4m3fn) KV cache pool - #132
Open
javierlimt6 wants to merge 7 commits into
Open
[Feature] Add optional FP8 (float8_e4m3fn) KV cache pool#132javierlimt6 wants to merge 7 commits into
javierlimt6 wants to merge 7 commits into
Commits
Commits on May 17, 2026
- committed
- committed
- committed
- committed
- committed
- committed
