All pull requests

Pull requests

• [ROCm][CI] Cache a PR's ROCm base image before it merges with /amd-ci cache

  ci/builddocumentationrocm
  #65276·AndreasKaratzas opened Nov 3, 2026Member·

  ·
  1

• [Bugfix][MRV2] Use promised max_query_len for encoder-only FULL CUDA graphs

  bugmrv2nvidia
  #65275·pst2154 opened Nov 3, 2026Contributor·

  ·

• [Bugfix] Step3 tool parser: coerce nullable and object/array parameters by schema

  bugreadytool-calling
  #65274·0xDexe opened Nov 3, 2026·4 of 6 tasks·

  ·
  1

  6

• [Quantization] Support ModelOpt W8A16 (INT8 weight-only) linear layers

  documentationquantization
  #65272·cjluo-nv opened Nov 3, 2026·6 tasks done·

  ·
  2

• [Bugfix][Scheduler] Don't split a multimodal item when a prefix cache hit ends inside it

  bugscheduler
  #65271·Anieca opened Nov 3, 2026·6 tasks done·

  ·
  5

• [MRV2][Spec Decode] Fix mixed draft-model warmup token budget

  mrv2
  #65270·wxsIcey opened Nov 3, 2026Contributor·

  ·

• [Bugfix][Frontend] Decode each streaming-input chunk after its own prompt

  bug
  #65269·paolo-perrone opened Nov 3, 2026Contributor·6 tasks done·

  ·

• [Feature] Segment attention layout for one-pass multi-candidate scoring

  frontendmrv2performancepooling
  #65268·pst2154 opened Nov 3, 2026Contributor·

  ·

• [Perf][ROCm][MiniMax-M3.1] Add opt-in parallel decode top-k

  ci/buildminimaxreciperocm
  #65267·jiacao-amd opened Nov 3, 2026Contributor·3 of 5 tasks·

  ·
  2

• [Bugfix][Frontend] Share the max_num_queued_tokens count across API servers

  bugdocumentation
  #65266·sohom-cs opened Nov 3, 2026Contributor·5 of 6 tasks·

  ·
  1

  1

• [Bugfix][Core] Fix Gemma-4 MTP prefix-cache hit loss when lookahead block hashes are off

  bugkv-cache-manager
  #65263·xuanzic opened Nov 3, 2026·5 of 6 tasks·

  ·
  1

• [Feature][KV Connector][Mooncake] Export store usage metrics for MooncakeStoreConnector

  documentationkv-connectormooncake
  #65262·skaulintel opened Nov 3, 2026·2 of 6 tasks·

  ·
  2

• [MoE][Model Loader] Fused fast path in RoutedExperts.load_weights; HY-V3 delegates expert loading

  ci/build
  #65261·hao-aaron opened Nov 3, 2026Collaborator·

  ·

• [Bugfix][KV Connector] Forward num_threads to non-UCX NIXL backends

  bugdocumentationkv-connectornixl
  #65260·mujtaba1747 opened Nov 3, 2026·5 of 9 tasks·

  ·
  2

• [RL][Model Loader] Make expert scale and Mamba v2 sharded loaders copy_-only

  ci/build
  #65259·zzhisyyds2 opened Nov 3, 2026·6 tasks done·

  ·
  1

• [Doc] MiniMax-M3.1-Flash: drop DEP4 c96 and c128 from the GB300 AgentX presets

  minimaxrecipe
  #65258·hshrivastava-droid opened Nov 3, 2026Contributor·

  ·
  1

• [ROCm] Split-K bf16x3 router GEMV for fp32 router gates at 33-2047 tokens

  rocm
  #65257·micah-wil opened Nov 3, 2026Collaborator·6 tasks·

  ·

• [Quantization] Keep E8M0 scale bytes when loading into uint8 params

  ci/buildquantization
  #65256·hao-aaron opened Nov 2, 2026Collaborator·

  ·

• [MoE][RL] MegaMoE NVFP4: load each scale on its own, combine after loading

  minimax
  #65254·hao-aaron opened Nov 2, 2026Collaborator·

  ·

• [Bugfix][Benchmark] Preserve inactive expert IDs in synthetic forward routing

  bugci/builddocumentationperformanceready
  #65253·WoosukKwon opened Nov 2, 2026Collaborator·6 tasks done·

  ·
  3

• [Bugfix][Frontend] Fix 500s on degenerate previous_input_messages content in Harmony Responses path

  bugfrontendgpt-oss
  #65252·herniqeu opened Nov 2, 2026·

  ·
  1

• [ROCm] Move AITER MXFP4 linear op registration into _aiter_ops

  batch-invariancerocm
  #65251·afriedri opened Nov 2, 2026Contributor·

  ·

• [WIP][ROCm][DSv4.1] Enable prefix-cache SWA replay on gfx942

  deepseekDSv4.1kv-cache-managerrocm
  #65249·frida-andersson opened Nov 2, 2026Contributor·6 tasks done·

  ·

• [ROCm] AITER gluon attention backend for Qwen3.8-27B

  qwenrocm
  #65248·eky-amd opened Nov 2, 2026Contributor·4 of 6 tasks·

  ·

• [Bugfix][Frontend] Stop Hermes streaming tool parser leaking keys that follow "arguments"

  bugtool-calling
  #65247·stanley-zhou opened Nov 2, 2026·5 of 6 tasks·

  ·
  1

  1