Commits

Branch selector

 master

User selector

All users

All time

Commit History

Commits on Jun 29, 2022

• Comms Benchmarks (#2040)

  Show description for 9b70ce5
  

  Quentin-Anthony

  and

  jeffra

  authored
  9b70ce5

  Copy full SHA for 9b70ce5

• Fix missing import in replace_module.py (#2050)

  Show description for 76ea053
  aphedges

  authored
  76ea053

  Copy full SHA for 76ea053

Commits on Jun 27, 2022

• correct partition_id in fp32 param -> fp16 param for MoE+z2 (#2058)

  siddharth9820

  authored
  38a00be

  Copy full SHA for 38a00be

Commits on Jun 23, 2022

• Fix for AMD unit tests (#2047)

  Show description for 7bae53d
  mrwyattii

  authored
  7bae53d

  Copy full SHA for 7bae53d

• Fix the half-precision version of CPU-Adam (#2032)

  Show description for a04480e
  

  4 peopleauthored
  a04480e

  Copy full SHA for a04480e

Commits on Jun 22, 2022

• Add compression papers (#2042)

  conglongli

  authored
  ff87c4e

  Copy full SHA for ff87c4e

• fixed print statement (#2038)

  Show description for 5218177
  

  mrwyattii

  and

  tjruwase

  authored
  5218177

  Copy full SHA for 5218177

Commits on Jun 21, 2022

• Split parameter offload from z3 (#2009)

  Show description for 678c3fe
  tjruwase

  authored
  678c3fe

  Copy full SHA for 678c3fe

• Retain available params until last use (#2016)

  Show description for 2a1a409
  tjruwase

  authored
  2a1a409

  Copy full SHA for 2a1a409

• Fix inference unit test import error catching (#2024)

  Show description for ec1ec20
  

  3 peopleauthored
  ec1ec20

  Copy full SHA for ec1ec20

Commits on Jun 20, 2022

• fix import errors (#2026)

  Show description for 735406e
  

  KMFODA

  and

  mrwyattii

  authored
  735406e

  Copy full SHA for 735406e

• Use partition size (#2011)

  tjruwase

  authored
  d86a2de

  Copy full SHA for d86a2de

Commits on Jun 16, 2022

• DeepSpeed Monitor Module (Master) (#2013)

  Show description for c87f6ee
  

  Quentin-Anthony

  and

  jeffra

  authored
  c87f6ee

  Copy full SHA for c87f6ee

• DataLoader Length Fix (#1718)

  Sanger2000

  authored
  ae198e2

  Copy full SHA for ae198e2

• Fix transformer API for training-evaluation pipeline (#2018)

  Show description for 5dce73f
  

  RezaYazdaniAminabadi

  and

  jeffra

  authored
  5dce73f

  Copy full SHA for 5dce73f

• DeepSpeed examples refresh (#2021)

  jeffra

  authored
  7c3344e

  Copy full SHA for 7c3344e

Commits on Jun 15, 2022

• [inference] test suite for ds-kernels (bert, roberta, gpt2, gpt-neo, gpt-j) (#1992)

  Show description for b666d5c
  

  4 peopleauthored
  b666d5c

  Copy full SHA for b666d5c

• [CI] force upgrade HF dependencies & output py env (#2015)

  jeffra

  authored
  e6f444a

  Copy full SHA for e6f444a

Commits on Jun 14, 2022

• update CODEOWNERS (#2017)

  conglongli

  authored
  117c9cd

  Copy full SHA for 117c9cd

Commits on Jun 13, 2022

• Relax assertion to allow Megatron-DeepSpeed MoE to use ZeRO-1 (#2007)

  Show description for 25b2fc2
  

  Quentin-Anthony

  and

  tjruwase

  authored
  25b2fc2

  Copy full SHA for 25b2fc2

Commits on Jun 10, 2022

• DeepSpeed comm backend v1 (#1985)

  Show description for 36ad311
  

  3 peopleauthored
  36ad311

  Copy full SHA for 36ad311

Commits on Jun 7, 2022

• [docs] add new build badges to landing page (#1998)

  jeffra

  authored
  828ab71

  Copy full SHA for 828ab71

• Propagate max errorcode to deepspeed when using PDSH launcher (#1994)

  Show description for d0eae5a
  jerrymannil

  authored
  d0eae5a

  Copy full SHA for d0eae5a

Commits on Jun 6, 2022

• [bug] Add user-defined launcher args for MPI launcher (#1933)

  Show description for 3678ee1
  

  mrwyattii

  and

  jeffra

  authored
  3678ee1

  Copy full SHA for 3678ee1

• Add torch-latest and torch-nightly CI workflows (#1990)

  Show description for 7fc3065
  

  mrwyattii

  and

  jeffra

  authored
  7fc3065

  Copy full SHA for 7fc3065

Commits on May 31, 2022

• fix typo when getting kernel dim in conv calculation (#1989)

  cli99

  authored
  6719b46

  Copy full SHA for 6719b46

• added temp fix for our CI jobs (#1988)

  mrwyattii

  authored
  b6f2a56

  Copy full SHA for b6f2a56

• Add unit test for various model families and inference tasks (#1981)

  Show description for 5d3c671
  

  mrwyattii

  and

  jeffra

  authored
  5d3c671

  Copy full SHA for 5d3c671

• small fix for the HF Bert models (#1984)

  RezaYazdaniAminabadi

  authored
  0ebd81d

  Copy full SHA for 0ebd81d

Commits on May 25, 2022

• add 530b paper (#1979)

  jeffra

  authored
  3da8418

  Copy full SHA for 3da8418

• bump to 0.6.6

  jeffra

  committed
  eb2ec7f

  Copy full SHA for eb2ec7f

Commits on May 24, 2022

• Fixing several bugs in the inference-api and the kernels (#1951)

  Show description for 8164ea9
  

  RezaYazdaniAminabadi

  and

  jeffra

  authored
  8164ea9

  Copy full SHA for 8164ea9

Commits on May 23, 2022

• Fix: Sparse tensors not updating (#1914)

  Show description for b8ff482
  

  3 peopleauthored
  b8ff482

  Copy full SHA for b8ff482

Commits on May 20, 2022

• Add Unidirectional Sparse Attention Type to BigBird and BSLongformer (#1959)

  Show description for 5208eb7
  

  Quentin-Anthony

  and

  jeffra

  authored
  5208eb7

  Copy full SHA for 5208eb7

Commits on May 19, 2022

• Update cpu_adam.py (#1968)

  jeffra

  authored
  737fee6

  Copy full SHA for 737fee6