Commits

Breadcrumbs

History for

onconglli/data

User selector

All users

All time

Commit History

Commits on Apr 21, 2021

• 1-bit LAMB optimizer example scripts (#97)

  Show description for f94591e
  conglongli

  authored
  f94591e

  Copy full SHA for f94591e

Commits on Mar 16, 2021

• 1-bit Adam v2 example scripts (#89)

  Show description for 590364d
  conglongli

  authored
  590364d

  Copy full SHA for 590364d

Commits on Feb 1, 2021

• Fix transformer kernel call parameters (#81)

  Show description for fde14be
  RezaYazdaniAminabadi

  authored
  fde14be

  Copy full SHA for fde14be

Commits on Jan 15, 2021

• Add deepspeed for the glue finetuning tasks & bert-large scripts (#77)

  Show description for 400cd1b
  RezaYazdaniAminabadi

  authored
  400cd1b

  Copy full SHA for 400cd1b

Commits on Jan 9, 2021

• additional no-decay keys for deepspeed transformer kernel (#75)

  hxbloom

  authored
  2d4282b

  Copy full SHA for 2d4282b

Commits on Dec 29, 2020

• add local rank explicitly for mpirun (#72)

  Show description for 4fc7848
  

  szhengac

  and

  Shuai Zheng

  authored
  4fc7848

  Copy full SHA for 4fc7848

Commits on Dec 17, 2020

• updates across examples to use deepspeed.init_distributed() (see #608) (#71)

  jeffra

  authored
  78d69cb

  Copy full SHA for 78d69cb

• modify scripts for fixing the deepspeed-transformer interface (#69)

  RezaYazdaniAminabadi

  authored
  abb2706

  Copy full SHA for abb2706

Commits on Dec 10, 2020

• Fix small mistake in mpi script.

  Show description for 35b4582
  awan-10

  authored
  35b4582

  Copy full SHA for 35b4582

Commits on Nov 21, 2020

• config fixes for one bit adam example (#63)

  conglongli

  authored
  a3cfec7

  Copy full SHA for a3cfec7

Commits on Nov 10, 2020

• PLD Client (#61) (#62)

  Show description for fa1d1a7
  

  tjruwase

  and

  minjiaz

  authored
  fa1d1a7

  Copy full SHA for fa1d1a7

Commits on Sep 22, 2020

• Fix fp32 model undefined var bug (#54)

  tjruwase

  authored
  5523935

  Copy full SHA for 5523935

Commits on Sep 21, 2020

• add intermediate size in the transformer config (#47)

  RezaYazdaniAminabadi

  authored
  ba63ad0

  Copy full SHA for ba63ad0

Commits on Sep 10, 2020

• 1-bit Adam examples/tutorial (#49)

  Show description for 38f0952
  

  5 peopleauthored
  38f0952

  Copy full SHA for 38f0952

Commits on Sep 2, 2020

• Add sparse attention example (#36)

  Show description for 896831c
  

  jeffra

  and

  arashashari

  authored
  896831c

  Copy full SHA for 896831c

Commits on Aug 28, 2020

• add codeowners and remove deepspeed.pt refs (#33)

  Show description for 2346cb3
  jeffra

  authored
  2346cb3

  Copy full SHA for 2346cb3

Commits on Aug 14, 2020

• bring back turing.sources imports (#30)

  Show description for fd869ae
  

  conglongli

  and

  jeffra

  authored
  fd869ae

  Copy full SHA for fd869ae

Commits on Aug 13, 2020

• remove distributed requirement from model building (#31)

  Show description for 71ab29d
  

  jeffra

  and

  samyam

  authored
  71ab29d

  Copy full SHA for 71ab29d

Commits on Jul 24, 2020

• Support nvidia bert dataset (#27)

  Show description for 47766e0
  tjruwase

  authored
  47766e0

  Copy full SHA for 47766e0

Commits on Jun 17, 2020

• Create README.md

  jeffra

  authored
  fd6fb51

  Copy full SHA for fd6fb51

Commits on Jun 5, 2020

• adding stochastic mode (#24)

  RezaYazdaniAminabadi

  authored
  a8a85a9

  Copy full SHA for a8a85a9

Commits on Jun 4, 2020

• Fix bert bug with dist.init

  jeffra

  committed
  8610e5e

  Copy full SHA for 8610e5e

Commits on May 28, 2020

• Update deepspeed_bsz32k_lamb_config_seq512.json

  Show description for 1b576d6
  samyam

  authored
  1b576d6

  Copy full SHA for 1b576d6

Commits on May 27, 2020

• cleanup of bert/squad code

  jeffra

  committed
  c66ce65

  Copy full SHA for c66ce65

• enable stochastic mode for bing_bert model (#16)

  Show description for 91cc01a
  

  jeffra

  and

  eltonzheng

  committed
  91cc01a

  Copy full SHA for 91cc01a

Commits on May 14, 2020

• DeepSpeed 0.2 support (#21)

  Show description for 5426d18
  

  7 peopleauthored
  5426d18

  Copy full SHA for 5426d18

Commits on Apr 8, 2020

• aml datastore support using a data_path_prefix (#16)

  jeffra

  authored
  6a698b2

  Copy full SHA for 6a698b2

• Bert pretraining refactor (#15)

  Show description for 91a794c
  jeffra

  authored
  91a794c

  Copy full SHA for 91a794c

Commits on Apr 6, 2020

• Adds DS config for bing_bert tutorial. (#14)

  

  Shaden Smith

  authored
  da38821

  Copy full SHA for da38821

Commits on Mar 26, 2020

• Fix formatting issues (#10)

  tjruwase

  authored
  32ae819

  Copy full SHA for 32ae819

Commits on Mar 16, 2020

• Update ds_train_bert_bsz16k_seq512.sh (#7)

  Show description for 0401afe
  dadebarr

  authored
  0401afe

  Copy full SHA for 0401afe

Commits on Mar 7, 2020

• BERT example (#6)

  

  Shaden Smith

  authored
  0b69ada

  Copy full SHA for 0b69ada

Loading