Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Jun 5, 2020

• Support migration to FP16 optimizer (#249)

  Show description for 2312f04
  tjruwase

  authored
  2312f04

  Copy full SHA for 2312f04

Commits on Jun 4, 2020

• Specify num_replicas and rank when creating sampler (#216)

  vidushv

  authored
  0f72988

  Copy full SHA for 0f72988

• Add log util (#230)

  Show description for e1ad880
  chunyang-wen

  authored
  e1ad880

  Copy full SHA for e1ad880

Commits on Jun 3, 2020

• reduce memcpy between host and device (#248)

  eltonzheng

  authored
  8353c59

  Copy full SHA for 8353c59

Commits on May 29, 2020

• Transformer kernel release (#242)

  Show description for 734d899
  

  8 peopleauthored
  734d899

  Copy full SHA for 734d899

Commits on May 28, 2020

• fix: typo (#238)

  Show description for b652395
  chunyang-wen

  authored
  b652395

  Copy full SHA for b652395

• remove redundant init code (#234)

  Show description for 6fe0edb
  

  3 peopleauthored
  6fe0edb

  Copy full SHA for 6fe0edb

Commits on May 27, 2020

• if using lamb force legacy_fusion=True (#236)

  jeffra

  authored
  a2b7552

  Copy full SHA for a2b7552

• add support for predivide as a config option (#235)

  Show description for bc36b91
  jeffra

  authored
  bc36b91

  Copy full SHA for bc36b91

• Default Contiguous Gradients False (#239)

  Show description for 01e848b
  samyam

  authored
  01e848b

  Copy full SHA for 01e848b

• Samyamr/cpu memory bloat fix zero (#233)

  Show description for d24d3de
  samyam

  authored
  d24d3de

  Copy full SHA for d24d3de

• Support fp32 grad clipping and fix max_grad_norm confusion (#232)

  Show description for abe2204
  jeffra

  authored
  abe2204

  Copy full SHA for abe2204

Commits on May 19, 2020

• ZeRO-2 (#217)

  Show description for f2ac7ea
  

  8 peopleauthored
  f2ac7ea

  Copy full SHA for f2ac7ea

Commits on May 11, 2020

• Support dynamic loss scale args in fp16 optimizers (#212)

  Show description for 0be026e
  tjruwase

  authored
  0be026e

  Copy full SHA for 0be026e

Commits on May 6, 2020

• Fix global_steps checkpoint loading. (#139)

  

  Shaden Smith

  authored
  b2c87ed

  Copy full SHA for b2c87ed

• check for model_parallel attr (#204)

  

  Shaden Smith

  authored
  4f42bbb

  Copy full SHA for 4f42bbb

Commits on May 4, 2020

• Bug fix for sparse grads (#208)

  jeffra

  authored
  a90a32d

  Copy full SHA for a90a32d

Commits on Apr 30, 2020

• Upgrade apex version, turn off legacy fusion (#205)

  Show description for 3ce531c
  jeffra

  authored
  3ce531c

  Copy full SHA for 3ce531c

Commits on Apr 29, 2020

• CSR+FP32 fix (#206)

  Show description for 6cb332f
  samyam

  authored
  6cb332f

  Copy full SHA for 6cb332f

Commits on Apr 24, 2020

• Fix index out of range error when parameter count is not multiple of ranks (#202)

  tjruwase

  authored
  512a0d4

  Copy full SHA for 512a0d4

Commits on Apr 22, 2020

• README and RTD improvements. (#198)

  

  Shaden Smith

  authored
  dd166ee

  Copy full SHA for dd166ee

Commits on Apr 21, 2020

• Fix perf bug (#194)

  Show description for bf4797c
  

  tjruwase

  and

  Shaden Smith

  authored
  bf4797c

  Copy full SHA for bf4797c

Commits on Apr 20, 2020

• Early Return Pattern "if return else return" -> "if return return" (#197)

  archsyscall

  authored
  b7f5cb7

  Copy full SHA for b7f5cb7

Commits on Apr 12, 2020

• AllReduce bucket fix. (#186)

  samyam

  authored
  90017d3

  Copy full SHA for 90017d3

Commits on Apr 7, 2020

• refactoring: Deduplication (#185)

  archsyscall

  authored
  63da7f5

  Copy full SHA for 63da7f5

Commits on Apr 3, 2020

• add representation to optimizer (#181)

  kouml

  authored
  3637b86

  Copy full SHA for 3637b86

Commits on Mar 27, 2020

• Support multi-output models (#170)

  Show description for 53c73fe
  tjruwase

  authored
  53c73fe

  Copy full SHA for 53c73fe

• Add "zero_allow_untested_optimizer" option in conf file (#173)

  Show description for 43f2733
  CalogeroZarbo

  authored
  43f2733

  Copy full SHA for 43f2733

Commits on Mar 26, 2020

• Fix ThroughputTimer with hybrid parallelism. (#171)

  

  Shaden Smith

  authored
  20557f7

  Copy full SHA for 20557f7

Commits on Mar 25, 2020

• Adding static loss scaling for ZeRO. (#166)

  

  Shaden Smith

  authored
  a76572d

  Copy full SHA for a76572d

Commits on Mar 23, 2020

• Export all python environment variables, not just PYTHONPATH (#165)

  tjruwase

  authored
  012d91d

  Copy full SHA for 012d91d

Commits on Mar 22, 2020

• removed restrictions for custom optimizer (#161)

  CalogeroZarbo

  authored
  ac9cc7f

  Copy full SHA for ac9cc7f

• removed session_params from deepspeed_constants.py (#162)

  Show description for 62d3272
  kouml

  authored
  62d3272

  Copy full SHA for 62d3272

Commits on Mar 12, 2020

• PyTorch 1.3+ build support (#135)

  Show description for 3d3f8d3
  jeffra

  authored
  3d3f8d3

  Copy full SHA for 3d3f8d3

Commits on Mar 10, 2020

• Enhancement: Ability to load checkpoint without loading the optimizer… (#128)

  Show description for 936117b
  samyam

  authored
  936117b

  Copy full SHA for 936117b