Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Mar 31, 2023

• Update DeepSpeed copyright license to Apache 2.0 (#3111)

  Show description for b361c72
  

  mrwyattii

  and

  jeffra

  authored
  b361c72

  Copy full SHA for b361c72

Commits on Mar 27, 2023

• update formatter version and style settings (#3098)

  jeffra

  authored
  91d63e0

  Copy full SHA for 91d63e0

Commits on Mar 7, 2023

• [RFC] add device abstraction to allow other device than CUDA be used (#2221)

  Show description for 0acf7e9
  

  3 peopleauthored
  0acf7e9

  Copy full SHA for 0acf7e9

Commits on Feb 27, 2023

• add missing license info to top of all source code (#2889)

  Show description for da84e60
  

  4 peopleauthored
  da84e60

  Copy full SHA for da84e60

Commits on Oct 14, 2022

• fixes #2389 (#2411)

  Show description for cfead55
  

  3 peopleauthored
  cfead55

  Copy full SHA for cfead55

Commits on Oct 4, 2022

• Refactor remaining distributed tests (#2216)

  Show description for ff42743
  

  mrwyattii

  and

  tjruwase

  authored
  ff42743

  Copy full SHA for ff42743

Commits on Jun 10, 2022

• DeepSpeed comm backend v1 (#1985)

  Show description for 36ad311
  

  3 peopleauthored
  36ad311

  Copy full SHA for 36ad311

Commits on Feb 28, 2022

• Refactor MoE and Groups API to simplify model creation and mangement (#1798)

  Show description for c0af6d9
  

  3 peopleauthored
  c0af6d9

  Copy full SHA for c0af6d9

Commits on Jan 14, 2022

• [ZeRO] Default disable elastic ckpt in stage 1+2 and reduce CPU memory overhead during ckpt load (#1525)

  Show description for 3293cf7
  

  jeffra

  and

  tjruwase

  authored
  3293cf7

  Copy full SHA for 3293cf7

Commits on Nov 19, 2021

• Enables ZeRO-3 inference (#1514)

  jeffra

  authored
  2332cb3

  Copy full SHA for 2332cb3

Commits on Sep 21, 2021

• Sparse attn triton v1.0 support + torch1.8 test runner (#1374)

  Show description for 6996bb0
  

  jeffra

  and

  Reza Yazdani

  authored
  6996bb0

  Copy full SHA for 6996bb0

Commits on Sep 1, 2021

• Added drop_last to DeepSpeedDataLoader (#1321)

  Show description for c0b27fb
  

  3 peopleauthored
  c0b27fb

  Copy full SHA for c0b27fb

Commits on Aug 17, 2021

• DeepSpeed MoE (#1310)

  Show description for f284324
  

  10 peopleauthored
  f284324

  Copy full SHA for f284324

Commits on Aug 16, 2021

• Curriculum learning (#1307)

  Show description for b2b34ae
  

  conglongli

  and

  jeffra

  authored
  b2b34ae

  Copy full SHA for b2b34ae

Commits on Aug 2, 2021

• ZeRO-1 empty grads fix + tests (#1273)

  Show description for adc21a4
  jeffra

  authored
  adc21a4

  Copy full SHA for adc21a4

Commits on Apr 25, 2021

• Add find_unused_parameters option to DeepSpeedEngine (#945)

  Show description for d0b61f1
  ghosthamlet

  authored
  d0b61f1

  Copy full SHA for d0b61f1

Commits on Jan 29, 2021

• Dist testing backend fixes, etc. (#708)

  jeffra

  authored
  2e2dd86

  Copy full SHA for 2e2dd86

Commits on Jan 4, 2021

• Support initialization with dict configuration (#632)

  tjruwase

  authored
  e6ac731

  Copy full SHA for e6ac731

Commits on Nov 21, 2020

• Support non-tensor state in checkpoint (#548)

  tjruwase

  authored
  6021b70

  Copy full SHA for 6021b70

Commits on Nov 20, 2020

• Fix unbalanced gradients bug in ZeRO-2 gradient accumulation (#545)

  Show description for 0178e6c
  tjruwase

  authored
  0178e6c

  Copy full SHA for 0178e6c

Commits on Nov 10, 2020

• PLD release (#513)

  Show description for be1147c
  

  4 peopleauthored
  be1147c

  Copy full SHA for be1147c

Commits on Sep 10, 2020

• Pipeline parallel training engine. (#392)

  Show description for 65c2f97
  

  Shaden Smith

  and

  jeffra

  authored
  65c2f97

  Copy full SHA for 65c2f97

Commits on Jul 15, 2020

• Empty grad fix (#291)

  Show description for 376818e
  jeffra

  authored
  376818e

  Copy full SHA for 376818e

• Fix bug in fp32 optimizer state loading (#289)

  tjruwase

  authored
  607814f

  Copy full SHA for 607814f

Commits on Mar 27, 2020

• Add "zero_allow_untested_optimizer" option in conf file (#173)

  Show description for 43f2733
  CalogeroZarbo

  authored
  43f2733

  Copy full SHA for 43f2733

Commits on Feb 20, 2020

• Refactor simple model test, fix pythonpath issue (#96)

  Show description for 001abe2
  jeffra

  authored
  001abe2

  Copy full SHA for 001abe2

Loading