Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Feb 26, 2021

• document the requirement to call for all ranks (#801)

  stas00

  authored
  7eb083c

  Copy full SHA for 7eb083c

Commits on Feb 19, 2021

• Update engine.py (#767)

  jeffra

  authored
  29fa4b2

  Copy full SHA for 29fa4b2

Commits on Feb 17, 2021

• [dist] set args.local_rank to LOCAL_RANK (#764)

  jeffra

  authored
  68e138b

  Copy full SHA for 68e138b

Commits on Feb 11, 2021

• Only initialize distributed if required (#734)

  Show description for 59eed17
  

  Sean Naren

  and

  jeffra

  authored
  59eed17

  Copy full SHA for 59eed17

• Add flops profiler tutorial (#682)

  Show description for e2dfe0d
  cli99

  authored
  e2dfe0d

  Copy full SHA for e2dfe0d

Commits on Feb 1, 2021

• local rank of -1 means not set (#720)

  jeffra

  authored
  45c33ee

  Copy full SHA for 45c33ee

• properly set engine.local_rank if it's set to -1

  jeffra

  committed
  3cecbc1

  Copy full SHA for 3cecbc1

Commits on Jan 29, 2021

• Dist testing backend fixes, etc. (#708)

  jeffra

  authored
  2e2dd86

  Copy full SHA for 2e2dd86

Commits on Jan 15, 2021

• Support optimizer AdamW type (#670)

  tjruwase

  authored
  865104b

  Copy full SHA for 865104b

Commits on Jan 14, 2021

• Validate consistent ckpt tags across ranks (#667)

  jeffra

  authored
  f032e56

  Copy full SHA for f032e56

Commits on Jan 13, 2021

• squash latest flops profiling changes (#1) (#664)

  Show description for e2fbe4d
  

  cli99

  and

  jeffra

  authored
  e2fbe4d

  Copy full SHA for e2fbe4d

Commits on Jan 8, 2021

• Remove a very verbose print statement. (#649)

  Show description for af212f6
  awan-10

  authored
  af212f6

  Copy full SHA for af212f6

Commits on Jan 5, 2021

• Fix docstring format (#640)

  tjruwase

  authored
  5ab1279

  Copy full SHA for 5ab1279

• Allow DeepSpeed models to be initialized with optimizer=None (#469)

  Show description for a9a83a6
  

  gcooper-isi

  and

  Shaden Smith

  authored
  a9a83a6

  Copy full SHA for a9a83a6

Commits on Jan 4, 2021

• Support initialization with dict configuration (#632)

  tjruwase

  authored
  e6ac731

  Copy full SHA for e6ac731

Commits on Dec 23, 2020

• Elastic training support (#602)

  Show description for 81aeea3
  

  jeffra

  and

  samyam

  authored
  81aeea3

  Copy full SHA for 81aeea3

Commits on Dec 18, 2020

• Ability to initialize distributed backend outside deepspeed runtime (#608)

  jeffra

  authored
  7435b2f

  Copy full SHA for 7435b2f

Commits on Dec 11, 2020

• Supported customizing kwargs for lr_scheduler (#584)

  Show description for a4763f5
  

  carefree0910

  and

  jeffra

  authored
  a4763f5

  Copy full SHA for a4763f5

Commits on Dec 8, 2020

• Pipeline warnings and checkpoint portability (#588)

  Show description for 2f62697
  

  Shaden Smith

  authored
  2f62697

  Copy full SHA for 2f62697

Commits on Dec 3, 2020

• [engine] train should be able to get `mode` arg (#571)

  stas00

  authored
  2d1f7c0

  Copy full SHA for 2d1f7c0

Commits on Dec 2, 2020

• Add 'latest' checkpoint save/load support (#569)

  jeffra

  authored
  845921b

  Copy full SHA for 845921b

Commits on Nov 25, 2020

• Simplify dist init and only init if needed. (#553)

  Show description for 0e831e2
  

  awan-10

  and

  jeffra

  authored
  0e831e2

  Copy full SHA for 0e831e2

Commits on Nov 24, 2020

• Deprecate client ability to disable gradient reduction (#552)

  Show description for 6e65c2c
  

  tjruwase

  and

  jeffra

  authored
  6e65c2c

  Copy full SHA for 6e65c2c

Commits on Nov 23, 2020

• Adding static_loss_scale to unfused optimizer (#546)

  samyam

  authored
  bcd56f9

  Copy full SHA for bcd56f9

Commits on Nov 19, 2020

• Discover variables for NCCL backend on AML without mpi4py (#542)

  Show description for 1b45917
  

  awan-10

  and

  jeffra

  authored
  1b45917

  Copy full SHA for 1b45917

• ZeRO-1 tune max-elems + bug fix (#532)

  Show description for 08c96a1
  jeffra

  authored
  08c96a1

  Copy full SHA for 08c96a1

Commits on Nov 18, 2020

• append job-name if explicit output dir is given (#539)

  jeffra

  authored
  5b09be6

  Copy full SHA for 5b09be6

• Fix layout bug in ZeRO Stage 1 checkpoint logic (#531)

  Show description for 7752dc5
  tjruwase

  authored
  7752dc5

  Copy full SHA for 7752dc5

Commits on Nov 12, 2020

• DeepSpeed JIT op + PyPI support (#496)

  Show description for 31f46fe
  

  3 peopleauthored
  31f46fe

  Copy full SHA for 31f46fe

Commits on Nov 11, 2020

• fix bug on non-DLTS infra when no output path set (#523)

  jeffra

  authored
  eea1c28

  Copy full SHA for eea1c28

Commits on Nov 10, 2020

• PLD release (#513)

  Show description for be1147c
  

  4 peopleauthored
  be1147c

  Copy full SHA for be1147c

Commits on Oct 30, 2020

• Add CPUAdam optimizer for zero-offload in deepspeed engine (#484)

  Show description for f5aa254
  

  RezaYazdaniAminabadi

  and

  jeffra

  authored
  f5aa254

  Copy full SHA for f5aa254

Commits on Oct 7, 2020

• Fix printing momentum for non-deepspeed optimizer (#464)

  Show description for c39a76f
  Zixxy

  authored
  c39a76f

  Copy full SHA for c39a76f

Commits on Oct 5, 2020

• Update engine.py (#458)

  Show description for 6717638
  Zixxy

  authored
  6717638

  Copy full SHA for 6717638

Commits on Sep 10, 2020

• readthedocs upgrade (#402)

  

  Shaden Smith

  authored
  c82756c

  Copy full SHA for c82756c