Commits

Breadcrumbs

History for

onmain

User selector

All users

All time

Commit History

Commits on Apr 19, 2026

• [None][feat] Support sparse mqa/gqa attention (#12470)

  Show description for cf9963f
  heyuhhh

  authored
  cf9963f

  Copy full SHA for cf9963f

Commits on Apr 18, 2026

• [None][bug] fix SM90 full-mask skip-softmax dispatch (#13120)

  Show description for b5d18e0
  bobboli

  authored
  b5d18e0

  Copy full SHA for b5d18e0

• [None][feat] Batch addSequence with two-phase claim and unified VSWA/non-reuse support (#13029)

  Show description for 66d7711
  liji-nv

  authored
  66d7711

  Copy full SHA for 66d7711

• [None][fix] Fix compute token accounting for KV cache reuse with context chunking (#12976)

  Show description for ea117de
  lancelly

  authored
  ea117de

  Copy full SHA for ea117de

• [None][feat] Update rms_norm + fp4_qaunt kernel supporting more dim (#13033)

  Show description for 74c57d1
  Wanli-Jiang

  authored
  74c57d1

  Copy full SHA for 74c57d1

Commits on Apr 16, 2026

• [None][fix] Remove leftover onboardBlocks param in kvCacheManagerTest (#13107)

  Show description for 90fe0d3
  eopXD

  authored
  90fe0d3

  Copy full SHA for 90fe0d3

• [None][chore] Remove onboard block switch for KV cache manager (#12449)

  Show description for ec34644
  eopXD

  authored
  ec34644

  Copy full SHA for ec34644

Commits on Apr 14, 2026

• [TRTLLM-11540][feat] Revert EAGLE3 dynamic tree speculative decoding support (#12062) (#13006)

  Show description for e31d8d7
  

  brb-nv

  and

  yiqingy0

  authored
  e31d8d7

  Copy full SHA for e31d8d7

• [None][chore] Unify code path for reuse/non-reuse when adding sequence in the kv cache manager (#10437)

  Show description for bdd5ec6
  eopXD

  authored
  bdd5ec6

  Copy full SHA for bdd5ec6

Commits on Apr 13, 2026

• [https://nvbugs/5963665][refactor] Refactor warmup orchestration in M… (#12407)

  Show description for a0b53e6
  liji-nv

  authored
  a0b53e6

  Copy full SHA for a0b53e6

• [https://nvbugs/5983390][perf] Reduce host overhead in DSA MLA attent… (#12631)

  Show description for ae84aad
  liji-nv

  authored
  ae84aad

  Copy full SHA for ae84aad

Commits on Apr 12, 2026

• [TRTLLM-11540][feat] Add EAGLE3 dynamic tree speculative decoding support (#12062)

  Show description for 4ece13c
  sunnyqgg

  authored
  4ece13c

  Copy full SHA for 4ece13c

Commits on Apr 10, 2026

• [TRTLLM-11421][feat] Support better kv cache statistics monitoring (#12413)

  Show description for 580c7a6
  eopXD

  authored
  580c7a6

  Copy full SHA for 580c7a6

Commits on Apr 9, 2026

• [https://nvbugs/6018647][test] Add unit test for Lifecycle Race Condition error in disagg sever (#12803)

  Show description for b56807a
  yingguo-trt

  authored
  b56807a

  Copy full SHA for b56807a

Commits on Apr 8, 2026

• [#11879][fix] Clamp usedNumBlocks to non-negative in KV cache stats (#11922)

  Show description for 6776857
  

  3 peopleauthored
  6776857

  Copy full SHA for 6776857

• [https://nvbugs/5961736][fix] Prebuild disagg ctx response to avoid ctx_request_id race (#12466)

  Show description for 3bd37ae
  peihu-nv

  authored
  3bd37ae

  Copy full SHA for 3bd37ae

Commits on Apr 7, 2026

• [None][Fix] Remove clone in fp8 quant. (#12687)

  Show description for 740f110
  Tracin

  authored
  740f110

  Copy full SHA for 740f110

• [None][feat] retune causalConv1d fwd dispatch for varlen and short sequences (#12739)

  Show description for a03aeb1
  nv-guomingz

  authored
  a03aeb1

  Copy full SHA for a03aeb1

• [None][feat] Trtllm-gen FMHA JIT support (#12612)

  Show description for 88bbb4d
  

  3 peopleauthored
  88bbb4d

  Copy full SHA for 88bbb4d

Commits on Apr 6, 2026

• [https://nvbugs/6025177][fix] Fix KV cache issue (#12673)

  Show description for b3a7381
  thorjohnsen

  authored
  b3a7381

  Copy full SHA for b3a7381

Commits on Apr 5, 2026

• [None][fix] Update codes to support nemotron-h corner cases (#12620)

  Show description for 56e6961
  Wanli-Jiang

  authored
  56e6961

  Copy full SHA for 56e6961

Commits on Apr 4, 2026

• [None][feat] Add fused DiT QK Norm + RoPE CUDA kernel for FLUX (#11869)

  Show description for 8f76476
  karljang

  authored
  8f76476

  Copy full SHA for 8f76476

Commits on Apr 3, 2026

• [None][feat] Temporally-Correlated Heuristic-guided Indexer TopK for Sparse Attention (#12385)

  Show description for 29fac6b
  longcheng-nv

  authored
  29fac6b

  Copy full SHA for 29fac6b

• [TRTLLM-10061][feat] Add support of linear attention state for C++ KV cache manager (#12531)

  Show description for 4feaa92
  VALLIS-NERIA

  authored
  4feaa92

  Copy full SHA for 4feaa92

Commits on Apr 2, 2026

• [#12560][fix] Fix disaggserving hang on block reuse after eviction (#12667)

  Show description for 59aa486
  Tabrizian

  authored
  59aa486

  Copy full SHA for 59aa486

• [TRTLLM-11043][feat] Add global pool support for suffix automaton speculative decoding (#12130)

  Show description for 11c40bb
  cascade812

  authored
  11c40bb

  Copy full SHA for 11c40bb

• [TRTLLM-11237][fix] [fix] Synchronize NCCL memory allocation error handling (#12125)

  Show description for bba6ca4
  nv-lschneider

  authored
  bba6ca4

  Copy full SHA for bba6ca4

• [None][revert] Revert "[TRTLLM-11119][feat] Blackwell SageAttention, Integrate into AttentionOp API (#11718)" (#12679)

  Show description for de6200d
  yunruis

  authored
  de6200d

  Copy full SHA for de6200d

• [None][fix] Correct reused block counting on corner case (#12404)

  Show description for e76d89a
  tongyuantongyu

  authored
  e76d89a

  Copy full SHA for e76d89a

• [https://nvbugs/5983390][perf] Multiple host perf optimizations for DSA part (#12581)

  Show description for edbb4b2
  hyukn

  authored
  edbb4b2

  Copy full SHA for edbb4b2

• [TRTLLM-10232][feat] Support LoRA adapter for nemotron-h models (#12154)

  Show description for dbb1c8c
  Wanli-Jiang

  authored
  dbb1c8c

  Copy full SHA for dbb1c8c

• [None][fix] fix mooncake dynamic load in transfer_agent_binding (#12181)

  Show description for d309646
  chuangz0

  authored
  d309646

  Copy full SHA for d309646

• [None][feat] Add DWDP (Distributed Weight Data Parallelism) support for MoE inference (#12136)

  Show description for e92ee4f
  

  4 peopleauthored
  e92ee4f

  Copy full SHA for e92ee4f

• [TRTLLM-11119][feat] Blackwell SageAttention, Integrate into AttentionOp API (#11718)

  Show description for 1b66e96
  xrq-phys

  authored
  1b66e96

  Copy full SHA for 1b66e96

Commits on Apr 1, 2026

• [TRTLLM-11551][feat] Support EPLB with various MoE backends for nemotron-h models (#12280)

  Show description for 3a71062
  Wanli-Jiang

  authored
  3a71062

  Copy full SHA for 3a71062