Commits

Branch selector

 samyamr/zero3-client

User selector

All users

All time

Commit History

Commits on Sep 16, 2020

• reuse buffers enabled

  samyam

  committed
  c094c06

  Copy full SHA for c094c06

Commits on Aug 5, 2020

• Seems to be working with prefetching + overlap + persistent parameters for small layers

  samyam

  committed
  94885ee

  Copy full SHA for 94885ee

Commits on Jul 31, 2020

• Prefetcher seems to be working as expected

  samyam

  committed
  9ac8e90

  Copy full SHA for 9ac8e90

Commits on Jul 23, 2020

• adding pretrain script for zero 3

  samyam

  committed
  9f51324

  Copy full SHA for 9f51324

• 19.7B model running on 1 DGX-2 node

  samyam

  committed
  b6022a3

  Copy full SHA for b6022a3

• Train step with forward backward and step seems to be running

  samyam

  committed
  b444aa4

  Copy full SHA for b444aa4

Commits on Jul 17, 2020

• removing manual partitioning

  samyam

  committed
  5a5f7c1

  Copy full SHA for 5a5f7c1

Commits on Jul 16, 2020

• register parameter for shared weights in gpt2_modeling, other minor edits

  samyam

  committed
  057d74b

  Copy full SHA for 057d74b

Commits on Jun 4, 2020

• Fix bert bug with dist.init

  jeffra

  committed
  8610e5e

  Copy full SHA for 8610e5e

Commits on May 29, 2020

• update squad to add dropout

  jeffra

  committed
  10b60d1

  Copy full SHA for 10b60d1

Commits on May 28, 2020

• Update deepspeed_bsz32k_lamb_config_seq512.json

  Show description for 1b576d6
  samyam

  authored
  1b576d6

  Copy full SHA for 1b576d6

Commits on May 27, 2020

• cleanup of bert/squad code

  jeffra

  committed
  c66ce65

  Copy full SHA for c66ce65

• enable stochastic mode for bing_bert model (#16)

  Show description for 91cc01a
  

  jeffra

  and

  eltonzheng

  committed
  91cc01a

  Copy full SHA for 91cc01a

Commits on May 14, 2020

• DeepSpeed 0.2 support (#21)

  Show description for 5426d18
  

  7 peopleauthored
  5426d18

  Copy full SHA for 5426d18

Commits on Apr 30, 2020

• New apex compatible squad (#19)

  Show description for 9e2c735
  jeffra

  authored
  9e2c735

  Copy full SHA for 9e2c735

Commits on Apr 8, 2020

• aml datastore support using a data_path_prefix (#16)

  jeffra

  authored
  6a698b2

  Copy full SHA for 6a698b2

• Bert pretraining refactor (#15)

  Show description for 91a794c
  jeffra

  authored
  91a794c

  Copy full SHA for 91a794c

Commits on Apr 6, 2020

• Adds DS config for bing_bert tutorial. (#14)

  

  Shaden Smith

  authored
  da38821

  Copy full SHA for da38821

Commits on Mar 28, 2020

• Bing bert squad scripts update (#12)

  Show description for b873ccc
  arashashari

  authored
  b873ccc

  Copy full SHA for b873ccc

Commits on Mar 26, 2020

• Fix formatting issues (#10)

  tjruwase

  authored
  32ae819

  Copy full SHA for 32ae819

Commits on Mar 16, 2020

• Update ds_train_bert_bsz16k_seq512.sh (#7)

  Show description for 0401afe
  dadebarr

  authored
  0401afe

  Copy full SHA for 0401afe

Commits on Mar 7, 2020

• BERT example (#6)

  

  Shaden Smith

  authored
  0b69ada

  Copy full SHA for 0b69ada

Commits on Feb 13, 2020

• Fixing Apex calls (#4)

  

  Shaden Smith

  authored
  e0d2d7f

  Copy full SHA for e0d2d7f

Commits on Feb 7, 2020

• Initial add of example models

  

  jeffra

  authored and

  Shaden Smith

  committed
  07d1ce0

  Copy full SHA for 07d1ce0

Commits on Jan 30, 2020

• add link to deepspeed repo

  jeffra

  committed
  991bfbf

  Copy full SHA for 991bfbf

Commits on Jan 29, 2020

• Initial LICENSE commit

  microsoftopensource

  committed
  a55857d

  Copy full SHA for a55857d

• Initial README.md commit

  microsoftopensource

  committed
  700cfc1

  Copy full SHA for 700cfc1

• Initial SECURITY.md commit

  microsoftopensource

  committed
  ee23a3c

  Copy full SHA for ee23a3c

• Initial CODE_OF_CONDUCT.md commit

  microsoftopensource

  committed
  ba42701

  Copy full SHA for ba42701

• Initial commit

  microsoft-github-operations[bot]

  authored
  31b2ae0

  Copy full SHA for 31b2ae0