Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Apr 5, 2023

• Recover shared parameters (#3033)

  Show description for 30d9770
  

  ShijieZZZZ

  and

  tjruwase

  authored
  30d9770

  Copy full SHA for 30d9770

Commits on Apr 4, 2023

• Fix launch issue (#3137)

  tjruwase

  authored
  fcb868e

  Copy full SHA for fcb868e

Commits on Mar 31, 2023

• Update DeepSpeed copyright license to Apache 2.0 (#3111)

  Show description for b361c72
  

  mrwyattii

  and

  jeffra

  authored
  b361c72

  Copy full SHA for b361c72

Commits on Mar 30, 2023

• ♻️ replace deprecated functions for communication (#2995)

  Show description for a6317eb
  

  3 peopleauthored
  a6317eb

  Copy full SHA for a6317eb

Commits on Mar 27, 2023

• update formatter version and style settings (#3098)

  jeffra

  authored
  91d63e0

  Copy full SHA for 91d63e0

Commits on Mar 15, 2023

• [logger] implement warning_once (#3021)

  Show description for 50a49e4
  

  stas00

  and

  tjruwase

  authored
  50a49e4

  Copy full SHA for 50a49e4

Commits on Feb 28, 2023

• Enable tensor fragments for zero 2 & 3 (#2727)

  Show description for 541e423
  

  3 peopleauthored
  541e423

  Copy full SHA for 541e423

Commits on Feb 27, 2023

• add missing license info to top of all source code (#2889)

  Show description for da84e60
  

  4 peopleauthored
  da84e60

  Copy full SHA for da84e60

Commits on Jan 26, 2023

• Abstract accelerator (step 3) (#2677)

  Show description for 98cc35b
  

  3 peopleauthored
  98cc35b

  Copy full SHA for 98cc35b

Commits on Jan 19, 2023

• Inference Refactor (replace_with_policy, model_implementations) (#2554)

  Show description for 867da30
  

  4 peopleauthored
  867da30

  Copy full SHA for 867da30

Commits on Dec 17, 2022

• fixes #2498 (#2603)

  Show description for 0f0e38c
  

  3 peopleauthored
  0f0e38c

  Copy full SHA for 0f0e38c

Commits on Nov 29, 2022

• Report progress at gradient accumulation boundary (#2553)

  Show description for 340fc0c
  ShijieZZZZ

  authored
  340fc0c

  Copy full SHA for 340fc0c

Commits on Oct 18, 2022

• Universal checkpoint for zero stage 1 (#2284)

  Show description for 799120e
  

  tjruwase

  and

  mrwyattii

  authored
  799120e

  Copy full SHA for 799120e

Commits on Oct 9, 2022

• Checkpoint backwards-compatbility workaround (#2384)

  tjruwase

  authored
  f4a92a1

  Copy full SHA for f4a92a1

Commits on Sep 3, 2022

• Refactor universal checkpointing and tensor fragments (#2253)

  Show description for 5318253
  tjruwase

  authored
  5318253

  Copy full SHA for 5318253

Commits on Aug 15, 2022

• Add support of OPT models (#2205)

  Show description for 8b2a637
  

  4 peopleauthored
  8b2a637

  Copy full SHA for 8b2a637

Commits on Aug 1, 2022

• Tensor parallelism for Mixture of Experts (#2074)

  Show description for 5fe9d61
  

  3 peopleauthored
  5fe9d61

  Copy full SHA for 5fe9d61

Commits on Jul 26, 2022

• Allow turning off loss scaling wrt GAS + update tput calculator (#2140)

  jeffra

  authored
  5bd09a8

  Copy full SHA for 5bd09a8

Commits on Jul 25, 2022

• Add flake8 to pre-commit checks (#2051)

  aphedges

  authored
  316c4a4

  Copy full SHA for 316c4a4

• DeepSpeed Communication Profiling and Logging (#2012)

  Show description for 5349347
  

  3 peopleauthored
  5349347

  Copy full SHA for 5349347

Commits on Jul 18, 2022

• Add Inference support for running the BigScience-BLOOM Architecture (#2083)

  Show description for aa88137
  

  3 peopleauthored
  aa88137

  Copy full SHA for aa88137

Commits on Jul 13, 2022

• fixed "None type has no len()" (#2091)

  Show description for b052378
  

  xiazeyu

  and

  cli99

  authored
  b052378

  Copy full SHA for b052378

Commits on Jun 20, 2022

• fix import errors (#2026)

  Show description for 735406e
  

  KMFODA

  and

  mrwyattii

  authored
  735406e

  Copy full SHA for 735406e

Commits on Jun 10, 2022

• DeepSpeed comm backend v1 (#1985)

  Show description for 36ad311
  

  3 peopleauthored
  36ad311

  Copy full SHA for 36ad311

Commits on May 19, 2022

• Fix timer typo (#1964)

  Show description for 0d36893
  

  Quentin-Anthony

  and

  jeffra

  authored
  0d36893

  Copy full SHA for 0d36893

Commits on Apr 30, 2022

• spell err (#1929)

  Show description for 89e37ef
  

  kisseternity

  and

  jeffra

  authored
  89e37ef

  Copy full SHA for 89e37ef

Commits on Apr 27, 2022

• lazy import fcntl (#1921)

  mrwyattii

  authored
  b7fc00d

  Copy full SHA for b7fc00d

Commits on Apr 20, 2022

• Use cuda events to improve timing for multi-stream execution (#1881)

  Show description for fee7313
  

  tjruwase

  and

  jeffra

  authored
  fee7313

  Copy full SHA for fee7313

Commits on Apr 19, 2022

• fix file ordering (#1822)

  Show description for 801c172
  

  3 peopleauthored
  801c172

  Copy full SHA for 801c172

Commits on Mar 30, 2022

• Add support for AWS SageMaker. (#1868)

  Show description for b47e25b
  

  matherit

  and

  jeffra

  authored
  b47e25b

  Copy full SHA for b47e25b

Commits on Mar 17, 2022

• fix: Fix undefined variable in _create_expert_data_and_model_parallel and make it easier to understand (#1826)

  Show description for 1e61c7a
  

  shjwudp

  and

  jeffra

  authored
  1e61c7a

  Copy full SHA for 1e61c7a

Commits on Feb 28, 2022

• Refactor MoE and Groups API to simplify model creation and mangement (#1798)

  Show description for c0af6d9
  

  3 peopleauthored
  c0af6d9

  Copy full SHA for c0af6d9

Commits on Feb 7, 2022

• Move param_shapes to model files (#1732)

  Show description for 135a625
  

  tjruwase

  and

  jeffra

  authored
  135a625

  Copy full SHA for 135a625

Commits on Jan 30, 2022

• [distributed] print dist init only on rank 0 (#1737)

  stas00

  authored
  e26de20

  Copy full SHA for e26de20

Commits on Jan 21, 2022

• Various ZeRO Stage3 Optimizations + Improvements (including bfloat16 support) (#1453)

  Show description for 4912e0a
  

  4 peopleauthored
  4912e0a

  Copy full SHA for 4912e0a