All pull requests

Pull requests

• [CI][ROCm] Keep FLA's shared memory probe from initializing HIP

  rocm
  #66434·AndreasKaratzas opened Nov 9, 2026Member·6 tasks done·

  ·
  2

• [Recipe] Kimi-K3.1-Pro: add B300 AgentX presets, align with InferenceX#4871

  kimirecipe
  #66433·mispa-ms opened Nov 9, 2026Contributor·6 tasks done·

  ·
  1

• [Bugfix][Multimodal] Fill the Qwen2-VL video budget up to the context length

  bugdocumentationmulti-modalityqwen
  #66432·subhashpolisetti opened Nov 8, 2026Contributor·5 of 6 tasks·

  ·
  1

• [Bugfix] Reserve SWA decode gather workspace in Dots3Note MLA backend

  bug
  #66431·peterzhang987723 opened Nov 8, 2026·

  ·
  1

• docs(spec-decode): update stale V0 test links to current V1 paths

  documentation
  #66429·allicai opened Nov 8, 2026·

  ·
  2

• [Bugfix][Spec Decode] Don't compile multi-module MTP drafters that pick their module by draft step

  bugdeepseekqwenspeculative-decoding
  #66428·spandantiwari opened Nov 8, 2026Contributor·6 tasks done·

  ·

• [CI][Deps] Bump truststore to 0.10.5 to stop the OpenSSL segfault in HF downloads

  ci/buildcpurust
  #66425·AndreasKaratzas opened Nov 8, 2026Member·6 tasks done·

  ·

• [ROCm][Perf] Route sink-less sparse MLA prefill to AITER OPUS on gfx950

  rocm
  #66424·eppaneamd opened Nov 8, 2026·6 tasks done·

  ·
  1

• fix(scope): handle return_prompt_text with kv_transfer_params.prompt_token_ids

  #66421·cf3901646 opened Nov 8, 2026·

  ·
  1

  1

• [DBO] Support DBO in the DeepEP v2 backend on MRV2

  mrv2
  #66420·algebra-MCX opened Nov 8, 2026Contributor·

  ·

• [Bugfix][Offload] Apply --cpu-offload-gb to models served by the Transformers modeling backend

  bug
  #66419·technovelist opened Nov 8, 2026·6 tasks done·

  ·
  1

• [Bugfix][Pooling] Keep CLIP and SigLIP special tokens for chat text embeddings

  bugdocumentationpooling
  #66417·Alex-Wengg opened Nov 8, 2026Contributor·6 tasks done·

  ·
  1

• [Transformers backend] Migrate InternLM3, IQuestCoder, TeleChat and TeleChat3

  documentation
  #66416·hmellor opened Nov 8, 2026Member·6 tasks done·

  ·
  1

• [ROCm][Perf][Muse Spark] Specialized decode for PTPC FP8 on gfx942 (--monokernel, TP8 EP8)

  rocm
  #66415·mjkvaak-amd opened Nov 8, 2026Contributor·6 tasks done·

  ·
  1

• [CI] Rebalance Arm CPU test shards

  ci/buildcpu
  #66414·latioswang opened Nov 8, 2026·6 tasks done·

  ·
  10

• [Transformers backend] Support LoRA on lm_head and aux hidden state layer 0

  kv-connectorllamamrv2speculative-decoding
  #66413·hmellor opened Nov 8, 2026Member·6 tasks done·

  ·

• [CI][KV Connector] Use decode-only CUDA graphs for NIXL PD accuracy core decoders

  kv-connectornixlnvidia
  #66412·ZJY0516 opened Nov 8, 2026Member·5 of 6 tasks·

  ·
  2

• [Bugfix] Cap compile-range warmup at reachable batch sizes

  bugtorch.compile
  #66410·AjinkyaGokhale opened Nov 8, 2026·5 of 6 tasks·

  ·
  1

  1

• [CI][Test] Remove the failure mechanisms of five flaky tests

  kv-connectormulti-modality
  #66409·latioswang opened Nov 8, 2026·6 tasks done·

  ·
  1

• [Bugfix][Frontend] Fix speech-to-text chunk spacing and unsupported verbose_json errors

  bugfrontend
  #66408·Alex-Wengg opened Nov 8, 2026Contributor·6 tasks done·

  ·

• [Bugfix][KV Offload] Engine crash when a request hands over several partial-tail boundaries

  bugkv-connector
  #66407·luoyuctl opened Nov 8, 2026Contributor·3 of 4 tasks·

  ·

• [Perf][Multimodal][CG] Enable encoder CUDA Graph for MiniCPM-V-4.6 and 4.7

  documentationmulti-modalitynvidia
  #66405·YunzhuLu opened Nov 8, 2026Contributor·6 tasks·

  ·
  1

• [Bugfix][Frontend] Render messages for return_prompt_text with reused prompt token ids

  bugdocumentation
  #66403·roytman opened Nov 8, 2026·6 tasks done·

  ·
  1

  3

• [Bugfix][MRV2] Allow non 8-bytes aligned --max-num-batched-tokens for DeepSeek-v4

  bugdeepseekdflashmrv2speculative-decoding
  #66401·wtdcode opened Nov 8, 2026Contributor·6 tasks done·

  ·
  1

• [ROCm][Bugfix] Drop sparse MLA metadata host sync; use persistent AITER for gfx950 long BF16 prefills

  bugrocm
  #66400·AndreasKaratzas opened Nov 8, 2026Member·5 of 9 tasks·

  ·
  2