Skip to content

[https://nvbugs/7067295][fix] Reserve eager logits memory when sizing KV cache - #21985

Open
trtllm-agent wants to merge 1 commit into
NVIDIA:mainfrom
tensorrt-cicd:repair-bot-v2/nvbug-7067295-r281
Open

trtllm-agent wants to merge 1 commit into
NVIDIA:mainfrom
tensorrt-cicd:repair-bot-v2/nvbug-7067295-r281