Commits

Breadcrumbs

History for

onSA_tutorial_update

User selector

All users

All time

Commit History

Commits on Sep 1, 2020

• Switches BBS example to use mbsize=3 and gas=2 to fit in 16GB of memory. (#341)

  

  Shaden Smith

  authored
  838f53b

  Copy full SHA for 838f53b

• Update run_func_test.py

  Show description for f4726b7
  samyam

  authored
  f4726b7

  Copy full SHA for f4726b7

• Rename ds_config_func_bs8_zero0_gas10.json to ds_config_func_bs8_zero0_gas3.json

  samyam

  authored
  6122a74

  Copy full SHA for 6122a74

• Rename ds_config_func_bs8_zero2_gas10.json to ds_config_func_bs8_zero2_gas3.json

  samyam

  authored
  7a356b2

  Copy full SHA for 7a356b2

• Samyamr/grad acc stage2 (#338)

  Show description for 7240abf
  

  samyam

  and

  jeffra

  authored
  7240abf

  Copy full SHA for 7240abf

Commits on Jul 14, 2020

• Support loading and saving ZeRO checkpoints with changing DP degree (#240)

  Show description for 7ccc9da
  

  tjruwase

  and

  jeffra

  authored
  7ccc9da

  Copy full SHA for 7ccc9da

Commits on May 27, 2020

• Support fp32 grad clipping and fix max_grad_norm confusion (#232)

  Show description for abe2204
  jeffra

  authored
  abe2204

  Copy full SHA for abe2204

Commits on May 20, 2020

• reduce size of megatron tests (#223)

  jeffra

  authored
  53ac794

  Copy full SHA for 53ac794

Commits on May 19, 2020

• ZeRO-2 (#217)

  Show description for f2ac7ea
  

  8 peopleauthored
  f2ac7ea

  Copy full SHA for f2ac7ea

Commits on May 18, 2020

• adding BingSqaud e2e test (#214)

  Show description for c61e23b
  arashashari

  authored
  c61e23b

  Copy full SHA for c61e23b

Commits on Apr 30, 2020

• Upgrade apex version, turn off legacy fusion (#205)

  Show description for 3ce531c
  jeffra

  authored
  3ce531c

  Copy full SHA for 3ce531c

Commits on Mar 27, 2020

• Support multi-output models (#170)

  Show description for 53c73fe
  tjruwase

  authored
  53c73fe

  Copy full SHA for 53c73fe

Commits on Mar 10, 2020

• Enhancement: Ability to load checkpoint without loading the optimizer… (#128)

  Show description for 936117b
  samyam

  authored
  936117b

  Copy full SHA for 936117b

Commits on Feb 22, 2020

• Support legacy optimizer fusion as config option (#75)

  Show description for 6d60206
  tjruwase

  authored
  6d60206

  Copy full SHA for 6d60206

Commits on Feb 14, 2020

• Porting BingBertSquad test (#70)

  Show description for 37ff62c
  

  Shaden Smith

  authored
  37ff62c

  Copy full SHA for 37ff62c

Commits on Feb 12, 2020

• remove the undefined variable in ckpt testing (#67)

  eltonzheng

  authored
  4f7d016

  Copy full SHA for 4f7d016

Commits on Feb 7, 2020

• Samyamr/batchconfig (#33)

  Show description for 5a0abc6
  samyam

  authored
  5a0abc6

  Copy full SHA for 5a0abc6

Commits on Feb 4, 2020

• Model tests executable fix

  

  Shaden Smith

  authored
  caaae99

  Copy full SHA for caaae99

Commits on Feb 3, 2020

• examples -> DeepSpeedExamples

  

  Shaden Smith

  authored and

  Shaden Smith

  committed
  e9b097f

  Copy full SHA for e9b097f

• Update model examples path.

  

  Shaden Smith

  authored and

  Shaden Smith

  committed
  9a5717e

  Copy full SHA for 9a5717e

• add test model Megatron_GPT2

  eltonzheng

  committed
  98f5131

  Copy full SHA for 98f5131

Loading