Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Feb 12, 2021

• Activation checkpointing for non-tensor arguments and return values (#741)

  Show description for ec8b1cb
  tjruwase

  authored
  ec8b1cb

  Copy full SHA for ec8b1cb

Commits on Feb 11, 2021

• Add flops profiler tutorial (#682)

  Show description for e2dfe0d
  cli99

  authored
  e2dfe0d

  Copy full SHA for e2dfe0d

Commits on Jan 29, 2021

• Dist testing backend fixes, etc. (#708)

  jeffra

  authored
  2e2dd86

  Copy full SHA for 2e2dd86

Commits on Jan 27, 2021

• [transformer-kernel] turn off unit test printing (#701)

  jeffra

  authored
  91b1b7f

  Copy full SHA for 91b1b7f

Commits on Jan 20, 2021

• make test_pipe more stable (#683)

  

  Shaden Smith

  authored
  e59ba12

  Copy full SHA for e59ba12

Commits on Jan 15, 2021

• Support optimizer AdamW type (#670)

  tjruwase

  authored
  865104b

  Copy full SHA for 865104b

Commits on Jan 14, 2021

• Validate consistent ckpt tags across ranks (#667)

  jeffra

  authored
  f032e56

  Copy full SHA for f032e56

Commits on Jan 13, 2021

• squash latest flops profiling changes (#1) (#664)

  Show description for e2fbe4d
  

  cli99

  and

  jeffra

  authored
  e2fbe4d

  Copy full SHA for e2fbe4d

Commits on Jan 12, 2021

• Handle actvitation checkpointing args that are None or non-tensors (#660)

  Show description for adcfd26
  

  Shaden Smith

  authored
  adcfd26

  Copy full SHA for adcfd26

Commits on Jan 8, 2021

• LR scheduler unit tests (#429)

  Show description for da5563a
  

  tjruwase

  and

  jeffra

  authored
  da5563a

  Copy full SHA for da5563a

• add additional validation checks in elastic config (#646)

  jeffra

  authored
  bc046dc

  Copy full SHA for bc046dc

Commits on Jan 6, 2021

• Module replacement support (#586)

  Show description for 44bd538
  

  3 peopleauthored
  44bd538

  Copy full SHA for 44bd538

Commits on Jan 5, 2021

• Allow DeepSpeed models to be initialized with optimizer=None (#469)

  Show description for a9a83a6
  

  gcooper-isi

  and

  Shaden Smith

  authored
  a9a83a6

  Copy full SHA for a9a83a6

Commits on Jan 4, 2021

• Support initialization with dict configuration (#632)

  tjruwase

  authored
  e6ac731

  Copy full SHA for e6ac731

Commits on Dec 23, 2020

• Elastic training support (#602)

  Show description for 81aeea3
  

  jeffra

  and

  samyam

  authored
  81aeea3

  Copy full SHA for 81aeea3

Commits on Dec 18, 2020

• Ability to initialize distributed backend outside deepspeed runtime (#608)

  jeffra

  authored
  7435b2f

  Copy full SHA for 7435b2f

Commits on Dec 17, 2020

• Transformer-kernel - supporting any arbitrary sequence-length (#587)

  Show description for fd2f970
  

  RezaYazdaniAminabadi

  and

  jeffra

  authored
  fd2f970

  Copy full SHA for fd2f970

Commits on Dec 2, 2020

• Add 'latest' checkpoint save/load support (#569)

  jeffra

  authored
  845921b

  Copy full SHA for 845921b

Commits on Dec 1, 2020

• supporting different hidden dimensions (#559)

  Show description for c78c29f
  

  RezaYazdaniAminabadi

  and

  jeffra

  authored
  c78c29f

  Copy full SHA for c78c29f

Commits on Nov 25, 2020

• Turn back on PP tests (#558)

  jeffra

  authored
  eec44af

  Copy full SHA for eec44af

Commits on Nov 21, 2020

• Support non-tensor state in checkpoint (#548)

  tjruwase

  authored
  6021b70

  Copy full SHA for 6021b70

Commits on Nov 20, 2020

• Fix unbalanced gradients bug in ZeRO-2 gradient accumulation (#545)

  Show description for 0178e6c
  tjruwase

  authored
  0178e6c

  Copy full SHA for 0178e6c

Commits on Nov 19, 2020

• ZeRO-1 tune max-elems + bug fix (#532)

  Show description for 08c96a1
  jeffra

  authored
  08c96a1

  Copy full SHA for 08c96a1

Commits on Nov 18, 2020

• Fix layout bug in ZeRO Stage 1 checkpoint logic (#531)

  Show description for 7752dc5
  tjruwase

  authored
  7752dc5

  Copy full SHA for 7752dc5

Commits on Nov 12, 2020

• DeepSpeed JIT op + PyPI support (#496)

  Show description for 31f46fe
  

  3 peopleauthored
  31f46fe

  Copy full SHA for 31f46fe

Commits on Nov 10, 2020

• PLD release (#513)

  Show description for be1147c
  

  4 peopleauthored
  be1147c

  Copy full SHA for be1147c

Commits on Oct 30, 2020

• Add CPUAdam optimizer for zero-offload in deepspeed engine (#484)

  Show description for f5aa254
  

  RezaYazdaniAminabadi

  and

  jeffra

  authored
  f5aa254

  Copy full SHA for f5aa254

Commits on Oct 7, 2020

• turning off different tests (temp)

  jeffra

  committed
  679fc13

  Copy full SHA for 679fc13

• temporarily disable lr unit tests

  jeffra

  committed
  11cf47e

  Copy full SHA for 11cf47e

Commits on Sep 29, 2020

• Disable default installation of CPU Adam (#450)

  Show description for 7b8be2a
  tjruwase

  authored
  7b8be2a

  Copy full SHA for 7b8be2a

Commits on Sep 25, 2020

• unit test rename (#442)

  

  Shaden Smith

  authored
  5412a33

  Copy full SHA for 5412a33

Commits on Sep 22, 2020

• support dynamic sequence length in transformer kernels (#424)

  Show description for f0f2a70
  

  RezaYazdaniAminabadi

  and

  conglongli

  authored
  f0f2a70

  Copy full SHA for f0f2a70

Commits on Sep 21, 2020

• Add configurable intermediate size to transformer kernels (#423)

  RezaYazdaniAminabadi

  authored
  a148bd3

  Copy full SHA for a148bd3

Commits on Sep 18, 2020

• Fix activation checkpoint unit tests for GPU systems (#421)

  

  Shaden Smith

  authored
  a825f99

  Copy full SHA for a825f99

• Revert "Activation checkpointing bugfix and unit tests (#420)" (#422)

  Show description for a74a604
  

  jeffra

  and

  ShadenSmith

  authored
  a74a604

  Copy full SHA for a74a604