All pull requests

Pull requests

• Fix comms logger IndexError when the tensor is passed by keyword

  #8998·ZhuLinsen opened Nov 3, 2026·

  ·
  1

• feat(comm): one-shot P2P custom all-reduce for TP=2 inference

  #8997·delock opened Nov 3, 2026Collaborator·

  ·
  12

• AutoEP activation tests: skip the Triton grouped-GEMM path when Triton cannot run

  #8996·GuCarpenter opened Nov 3, 2026Contributor·

  ·
  1

• Fix quantized storage of nontrainable weights in ZeRO-3

  #8995·VenusTZZ opened Nov 3, 2026Contributor·7 tasks done·

  ·
  1

• ZeRO-3: build the partial-offload device string from the public accelerator API

  #8994·GuCarpenter opened Nov 3, 2026Contributor·

  ·
  1

• Fix DynamicLossScaler never lowering scale when hysteresis <= 0

  #8993·siddhant-rajhans opened Nov 3, 2026·

  ·
  1

  3

• Keep float32 intermediates in the clamped SwiGLU eager fallback

  #8992·GuCarpenter opened Nov 3, 2026Contributor·

  ·
  1

• Fix BF16 AutoEP folding: avoid BF16 round-trip in FP32 accumulation

  #8989·siddhant-rajhans opened Nov 2, 2026·

  ·
  1

  5

• Fix zero.Init: respect explicit dtype in tensor constructors

  #8988·siddhant-rajhans opened Nov 2, 2026·

  ·
  1

  4

• Fix FP16 optimizer init: suppress weight decay and reset step counter

  #8987·siddhant-rajhans opened Nov 2, 2026·

  ·
  1

  4

• ZeRO-3 CPU offload: fix the step() device memory regression from #8840

  #8986·xylian86 opened Nov 2, 2026Collaborator·

  ·
  1

• DeepNVMe: fix silent I/O failures on misaligned buffers

  #8985·xylian86 opened Nov 2, 2026Collaborator·

  ·
  4

• ZeRO-3 NVMe offload: restore the optimizer state on resume

  #8984·xylian86 opened Nov 2, 2026Collaborator·

  ·
  1

• Fix DynamicLossScaler never lowering the scale when fp16 hysteresis is 0 or less

  #8983·damienen opened Nov 2, 2026·

  ·
  1

  5

• ZeRO-3: fix stale and lost gradients of unused parameters

  #8981·xylian86 opened Nov 2, 2026Collaborator·

  ·
  9

• [Hybrid Engine] Require an explicit accelerator opt-in for graph capture

  #8980·VenusTZZ opened Nov 2, 2026Contributor·

  ·
  15

• Fix OneCycle initial momentum: use cycle_max_mom, not cycle_min_mom

  #8979·siddhant-rajhans opened Nov 2, 2026·

  ·
  1

  3

• Propagate the user script's exit code from launcher_helper

  #8978·vineethsaivs opened Nov 1, 2026Contributor·

  ·

• Keep --venv_script out of the pdsh pkill pattern

  #8977·vineethsaivs opened Nov 1, 2026Contributor·

  ·

• Fix bug in Adagrad optimizer initialization

  #8976·hwchen2017 opened Nov 1, 2026Contributor·

  ·
  7

• Check that converting through an affine map writes every element once

  #8975·Achyuthan-S opened Nov 1, 2026Contributor·

  ·
  5

• Keep fp32 CPU optimizer states in fp32 when loading a state_dict

  #8974·xylian86 opened Nov 1, 2026Collaborator·

  ·
  3

• ZeRO-3 partial offload: fix LR schedules and checkpoints of the device sub-groups

  #8973·xylian86 opened Nov 1, 2026Collaborator·

  ·
  4

• SuperOffload: checkpoint the CPU Adam state, fix unused parameters and rollbacks, speculate with clipping

  #8972·xylian86 opened Nov 1, 2026Collaborator·

  ·
  5

• Log Train/Samples/train_loss to monitors again

  #8971·arun-elr opened Nov 1, 2026·

  ·
  5