Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Apr 12, 2023

• feat: Add support for `NamedTuple` when sharding parameters [#3029] (#3037)

  Show description for 29aea09
  

  3 peopleauthored
  29aea09

  Copy full SHA for 29aea09

Commits on Apr 11, 2023

• DeepSpeed Chat (#3186)

  Show description for 47f9f13
  

  9 peopleauthored
  47f9f13

  Copy full SHA for 47f9f13

Commits on Apr 10, 2023

• deepspeed/runtime/utils.py: reset_peak_memory_stats when empty cache (#2803)

  Show description for 6eca037
  

  guoyejun

  and

  tjruwase

  authored
  6eca037

  Copy full SHA for 6eca037

Commits on Apr 7, 2023

• zero.Init() should pin params in GPU memory as requested (#2953)

  Show description for 4d27225
  

  tjruwase

  and

  mrwyattii

  authored
  4d27225

  Copy full SHA for 4d27225

Commits on Apr 5, 2023

• Update skip on torch in tests (#3136)

  Show description for ab1f32d
  loadams

  authored
  ab1f32d

  Copy full SHA for ab1f32d

• Update engine.py (#2826)

  Show description for bcb0353
  

  stas00

  and

  tjruwase

  authored
  bcb0353

  Copy full SHA for bcb0353

Commits on Mar 31, 2023

• Update DeepSpeed copyright license to Apache 2.0 (#3111)

  Show description for b361c72
  

  mrwyattii

  and

  jeffra

  authored
  b361c72

  Copy full SHA for b361c72

Commits on Mar 30, 2023

• Make fp32 default communication data type (#2970)

  Show description for 261d637
  tjruwase

  authored
  261d637

  Copy full SHA for 261d637

• ♻️ replace deprecated functions for communication (#2995)

  Show description for a6317eb
  

  3 peopleauthored
  a6317eb

  Copy full SHA for a6317eb

Commits on Mar 28, 2023

• Disable Stage 1&2 CPUAdam pathways (#3097)

  Show description for 4b6d7c1
  

  mrwyattii

  and

  tjruwase

  authored
  4b6d7c1

  Copy full SHA for 4b6d7c1

Commits on Mar 27, 2023

• update formatter version and style settings (#3098)

  jeffra

  authored
  91d63e0

  Copy full SHA for 91d63e0

Commits on Mar 24, 2023

• pre-commit check for torch.cuda in code (#2981)

  Show description for 090d49e
  

  delock

  and

  tjruwase

  authored
  090d49e

  Copy full SHA for 090d49e

• Empty ZeRO3 partition cache (#3060)

  Show description for e80ae08
  

  tjruwase

  and

  jeffra

  authored
  e80ae08

  Copy full SHA for e80ae08

Commits on Mar 23, 2023

• allow list (#3042)

  Show description for 5c2a81c
  

  satpalsr

  and

  jeffra

  authored
  5c2a81c

  Copy full SHA for 5c2a81c

• Fix nebula in save_16bit_model issue (#3023)

  Show description for a78d6b8
  

  FreyaRao

  and

  CodeSkull-1

  authored
  a78d6b8

  Copy full SHA for a78d6b8

Commits on Mar 22, 2023

• Remove bf16 from inference config dtye enum (#3010)

  Show description for 27e1b02
  

  molly-smith

  and

  jeffra

  authored
  27e1b02

  Copy full SHA for 27e1b02

Commits on Mar 15, 2023

• Improve loss overflow logs (#3008)

  Show description for ac2c9ff
  

  Quentin-Anthony

  and

  tjruwase

  authored
  ac2c9ff

  Copy full SHA for ac2c9ff

• Convert model parameters from generator to list. (#3017)

  Show description for 94f7da2
  

  jomayeri

  and

  tjruwase

  authored
  94f7da2

  Copy full SHA for 94f7da2

• adding attribute checks for bf opt with zero (#3022)

  Show description for d7c925e
  

  jomayeri

  and

  tjruwase

  authored
  d7c925e

  Copy full SHA for d7c925e

Commits on Mar 14, 2023

• Update torch_checkpoint_engine.py (#3019)

  stas00

  authored
  e355863

  Copy full SHA for e355863

Commits on Mar 13, 2023

• Fix buffer size for pipeline parallel and communication schedule (#2862)

  Show description for b528f50
  

  4 peopleauthored
  b528f50

  Copy full SHA for b528f50

• ckpt: create directories in checkpoint_engine (#2988)

  Show description for 43d58d9
  

  adammoody

  and

  tjruwase

  authored
  43d58d9

  Copy full SHA for 43d58d9

Commits on Mar 9, 2023

• [zero] prevent poor configs from running w. zero-offload (#2971)

  jeffra

  authored
  457850d

  Copy full SHA for 457850d

Commits on Mar 7, 2023

• Improve overflow handling (#2944)

  Show description for 80d8fcb
  

  tjruwase

  and

  jeffra

  authored
  80d8fcb

  Copy full SHA for 80d8fcb

Commits on Feb 28, 2023

• better eval sampler (#2907)

  Show description for f1d2a15
  

  mayank31398

  and

  tjruwase

  authored
  f1d2a15

  Copy full SHA for f1d2a15

• Enable tensor fragments for zero 2 & 3 (#2727)

  Show description for 541e423
  

  3 peopleauthored
  541e423

  Copy full SHA for 541e423

Commits on Feb 27, 2023

• add missing license info to top of all source code (#2889)

  Show description for da84e60
  

  4 peopleauthored
  da84e60

  Copy full SHA for da84e60

Commits on Feb 24, 2023

• Remove deprecated `torch._six` imports (#2863)

  Show description for d3de737
  

  3 peopleauthored
  d3de737

  Copy full SHA for d3de737

Commits on Feb 22, 2023

• Make z3 respect comm dtype (#2807)

  Show description for 81b4d5d
  tjruwase

  authored
  81b4d5d

  Copy full SHA for 81b4d5d

Commits on Feb 21, 2023

• Data efficiency library update (#2866)

  Show description for 7c99def
  conglongli

  authored
  7c99def

  Copy full SHA for 7c99def

Commits on Feb 15, 2023

• Refactor DS inference API. No longer need replace_method. (#2831)

  Show description for e4b3b61
  

  awan-10

  and

  mrwyattii

  authored
  e4b3b61

  Copy full SHA for e4b3b61

Commits on Feb 6, 2023

• remove outdated comment (#2786)

  Show description for d323abd
  

  3 peopleauthored
  d323abd

  Copy full SHA for d323abd

Commits on Feb 3, 2023

• add support for hjson config files (#2783)

  Show description for 4079077
  

  mrwyattii

  and

  tjruwase

  authored
  4079077

  Copy full SHA for 4079077

Commits on Jan 31, 2023

• Refactor/Pydantify monitoring config (#2640)

  Show description for d923f7c
  

  mrwyattii

  and

  tjruwase

  authored
  d923f7c

  Copy full SHA for d923f7c

• Fix hardcoded instances to fp16 in optimizer creation log messages to the correct dtype. (#2743)

  Show description for 8647753
  

  loadams

  and

  tjruwase

  authored
  8647753

  Copy full SHA for 8647753