Issues

• [Performance]: Streamed responses search the whole output text for stop strings on every response

  General perf
  NVIDIA/TensorRT-LLM#22020 · Filter by author Hang-get opened on Nov 10, 2026

• [Performance]: SpecSampler.update_requests converts every preallocated slot to Python lists each step

  Speculative Decoding
  NVIDIA/TensorRT-LLM#22016 · Filter by author Hang-get opened on Nov 10, 2026

• [Performance]: Keep relayed prompt IDs on the int32 array path

  General perf
  NVIDIA/TensorRT-LLM#21998 · Filter by author Hang-get opened on Nov 10, 2026

• [Performance]: Avoid dense Python conversion for sparse TorchSampler logprobs

  General perf
  NVIDIA/TensorRT-LLM#21980 · Filter by author Hang-get opened on Nov 10, 2026

• [Infra] Declare Docs-only suffix rules in the changed-file group map

  Infra
  NVIDIA/TensorRT-LLM#21936 · Filter by author chzblych opened on Nov 9, 2026

• [Docs] Clarify test waive matching and platform scope

  Doc
  NVIDIA/TensorRT-LLM#21932 · Filter by author chzblych opened on Nov 9, 2026

• [Performance]: Avoid full priority-queue scans for bounded admission peeks

  General perf
  NVIDIA/TensorRT-LLM#21912 · Filter by author Hang-get opened on Nov 9, 2026

• [Bug]: qwen3 tool parser: strict tool calls pick the wrong function because the grammar forbids the spaces Qwen3 writes

  bugCustomized kernels
  NVIDIA/TensorRT-LLM#21903 · Filter by author arulster17 opened on Nov 9, 2026

• [Bug]: Qwen4-Exp PLE table allocated in BF16 for NVFP4 checkpoints that declare ple_embedding_dtype float8_e4m3fn

  Customized kernels
  NVIDIA/TensorRT-LLM#21902 · Filter by author hokwangchoi opened on Nov 9, 2026

• [Bug]: trtllm-bench warmup requests share KV cache blocks with the measured requests

  KV-Cache Management
  NVIDIA/TensorRT-LLM#21901 · Filter by author hokwangchoi opened on Nov 9, 2026

• [Performance]: FORCE_CHUNK prefills concurrent prompts in lockstep, so every TTFT waits for the last prompt

  General perf
  NVIDIA/TensorRT-LLM#21891 · Filter by author hokwangchoi opened on Nov 9, 2026

• [Bug] trtllm-bench KV-cache sizing and reporting ignore the selected modeling_v2 target

  KV-Cache Management
  NVIDIA/TensorRT-LLM#21889 · Filter by author dongfengy opened on Nov 8, 2026
  1

• [Feature]: Report prefix tokens lost to evicted recurrent-state snapshots (hybrid Mamba, KV cache manager V2)

  KV-Cache Management
  NVIDIA/TensorRT-LLM#21884 · Filter by author hokwangchoi opened on Nov 8, 2026

• [Performance]: SM120 FP8 block-scale MoE uses 16-row tiles at every batch size, which halves prefill MoE throughput

  Model optimization
  NVIDIA/TensorRT-LLM#21882 · Filter by author hokwangchoi opened on Nov 8, 2026

• LongBench V2 blog command breaks on inline comments after continuations

  Doc
  NVIDIA/TensorRT-LLM#21879 · Filter by author ddlw opened on Nov 8, 2026

• DSpark rejects requested token and prompt log-probability outputs

  Speculative Decoding
  NVIDIA/TensorRT-LLM#21859 · Filter by author yifjiang opened on Nov 7, 2026

• Precompiled package extraction omits direct NIXL and UCX libraries

  Infra
  NVIDIA/TensorRT-LLM#21858 · Filter by author yifjiang opened on Nov 7, 2026

• [Bug]: V2 scheduler deadlocks when a recompute-paused request's replay exceeds max_num_tokens (chunked prefill off)

  KV-Cache Management
  NVIDIA/TensorRT-LLM#21826 · Filter by author maxwbuckley opened on Nov 6, 2026
  1

• [Bug]: Suffix automaton returns other requests' draft tokens when the draft length is below the workspace width (draft_len_schedule)

  Speculative Decoding
  NVIDIA/TensorRT-LLM#21820 · Filter by author maxwbuckley opened on Nov 6, 2026
  1

• [Bug]: Ray orchestrator: the DeepEP buffers bootstrap from an MPI_COMM_WORLD split, so DeepEPLowLatency gets a 1-rank group (same pattern as #20083)

  Disaggregated serving
  NVIDIA/TensorRT-LLM#21809 · Filter by author dmvevents opened on Nov 6, 2026

• [Feature]: Port the FLA Triton kernels off tl.make_block_ptr before the move to Triton 3.9

  Triton backend
  NVIDIA/TensorRT-LLM#21801 · Filter by author waynehacking8 opened on Nov 6, 2026

• [Bug]: Eagle3 loads a d2t that does not match t2d without any error

  Speculative Decoding
  NVIDIA/TensorRT-LLM#21800 · Filter by author waynehacking8 opened on Nov 6, 2026

• Export speculative verification rounds for aggregate acceptance length

  Speculative Decoding
  NVIDIA/TensorRT-LLM#21731 · Filter by author yifjiang opened on Nov 5, 2026

• [Bug]: MiniMax-M3 streaming tool parser leaks the next call as text when one chunk ends a call and starts another

  NVIDIA/TensorRT-LLM#21728 · Filter by author paolo-perrone opened on Nov 5, 2026

• [Bug] Kimi K2 parser drops tool calls with multiline JSON arguments

  NVIDIA/TensorRT-LLM#21648 · Filter by author 0z5a opened on Nov 4, 2026