Issues

• [Bug]: V2 scheduler deadlocks when a recompute-paused request's replay exceeds max_num_tokens (chunked prefill off)

  KV-Cache Management
  NVIDIA/TensorRT-LLM#21826 · Filter by author maxwbuckley opened on Nov 6, 2026
  1

• [Bug]: Suffix automaton returns other requests' draft tokens when the draft length is below the workspace width (draft_len_schedule)

  Speculative Decoding
  NVIDIA/TensorRT-LLM#21820 · Filter by author maxwbuckley opened on Nov 6, 2026
  1

• [Bug]: Ray orchestrator: the DeepEP buffers bootstrap from an MPI_COMM_WORLD split, so DeepEPLowLatency gets a 1-rank group (same pattern as #20083)

  Disaggregated serving
  NVIDIA/TensorRT-LLM#21809 · Filter by author dmvevents opened on Nov 6, 2026

• [Feature]: Port the FLA Triton kernels off tl.make_block_ptr before the move to Triton 3.9

  Triton backend
  NVIDIA/TensorRT-LLM#21801 · Filter by author waynehacking8 opened on Nov 6, 2026

• [Bug]: Eagle3 loads a d2t that does not match t2d without any error

  Speculative Decoding
  NVIDIA/TensorRT-LLM#21800 · Filter by author waynehacking8 opened on Nov 6, 2026

• Export speculative verification rounds for aggregate acceptance length

  Speculative Decoding
  NVIDIA/TensorRT-LLM#21731 · Filter by author yifjiang opened on Nov 5, 2026

• [Bug]: MiniMax-M3 streaming tool parser leaks the next call as text when one chunk ends a call and starts another

  NVIDIA/TensorRT-LLM#21728 · Filter by author paolo-perrone opened on Nov 5, 2026

• [Bug] Kimi K2 parser drops tool calls with multiline JSON arguments

  NVIDIA/TensorRT-LLM#21648 · Filter by author 0z5a opened on Nov 4, 2026

• [Bug] Chat benchmark counts metadata-only stream events as output tokens

  NVIDIA/TensorRT-LLM#21647 · Filter by author 0z5a opened on Nov 4, 2026

• [Bug]: Poolside streaming parser drops buffered text at completion

  NVIDIA/TensorRT-LLM#21643 · Filter by author 0z5a opened on Nov 4, 2026

• [Bug]: Non-string enum tool arguments are returned as strings

  OpenAI API
  NVIDIA/TensorRT-LLM#21642 · Filter by author 0z5a opened on Nov 4, 2026

• [Bug] MiniMax M3 streaming reuses tool-call indices across blocks

  NVIDIA/TensorRT-LLM#21636 · Filter by author 0z5a opened on Nov 4, 2026

• [Bug] MiniMax M2 streaming parser loses buffered text at finish

  NVIDIA/TensorRT-LLM#21634 · Filter by author 0z5a opened on Nov 4, 2026

• [Bug]: SamplingParams with an explicit end_id fails when stop or bad strings are set

  bugLLM API
  NVIDIA/TensorRT-LLM#21613 · Filter by author Anshtyagi1729 opened on Nov 4, 2026

• [Bug]: /v1/completions logprobs text_offset points at the wrong character for every token after the first

  NVIDIA/TensorRT-LLM#21577 · Filter by author paolo-perrone opened on Nov 3, 2026

• [Bug]: MiniMax-M3 tool parser drops the end of a streamed response

  NVIDIA/TensorRT-LLM#21573 · Filter by author paolo-perrone opened on Nov 3, 2026

• [Performance] Nemotron-H prefill on B300: five measured speedups, which would you like as PRs?

  General perf
  NVIDIA/TensorRT-LLM#21571 · Filter by author jvpflum opened on Nov 3, 2026

• [Bug]: trtllm-bench multi-turn acceptance statistics use only the last turn's decoding iterations

  NVIDIA/TensorRT-LLM#21519 · Filter by author codebreaker77 opened on Nov 3, 2026

• [Bug]: Executor crashes with "User-provided base page indices is too short" when the KV pool is smaller than one max_num_tokens context chunk

  Customized kernelsKV-Cache Management
  NVIDIA/TensorRT-LLM#21470 · Filter by author benchislett opened on Nov 2, 2026
  3

• [Bug] DFlash drafter with attention_backend VANILLA ignores a reused prefix: acceptance roughly halves on cached turns

  Speculative Decoding
  NVIDIA/TensorRT-LLM#21462 · Filter by author jvpflum opened on Nov 2, 2026

• [Bug] CUTEDSL (b12x) NVFP4 MoE on SM120/SM121: weight-scale conversion underflows into E4M3 subnormals, 8-10% error per MoE layer

  Customized kernels
  NVIDIA/TensorRT-LLM#21461 · Filter by author jvpflum opened on Nov 2, 2026
  2

• [Performance] Guided decoding with one-model speculative decoding drains the GPU 4 times per eager step, even when no request is guided

  General perfSpeculative Decoding
  NVIDIA/TensorRT-LLM#21460 · Filter by author jvpflum opened on Nov 2, 2026

• [Feature]: Export KV cache capacity of each cache level (V2 secondaryMaxNumBlocks) as a Prometheus gauge

  KV-Cache Management
  NVIDIA/TensorRT-LLM#21395 · Filter by author ahg-g opened on Nov 1, 2026
  1

• [Bug]: SWA per-layer KV page-table staging can read overwritten host data

  KV-Cache Management
  NVIDIA/TensorRT-LLM#21385 · Filter by author peter941221 opened on Nov 1, 2026

• [Feature]: Remove stale entries from legacy-files.txt

  feature request
  NVIDIA/TensorRT-LLM#21383 · Filter by author morteza89 opened on Nov 1, 2026