Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Mar 11, 2022

• 01 adam optimizer (#1790)

  Show description for b80e562
  

  3 peopleauthored
  b80e562

  Copy full SHA for b80e562

Commits on Feb 28, 2022

• Refactor MoE and Groups API to simplify model creation and mangement (#1798)

  Show description for c0af6d9
  

  3 peopleauthored
  c0af6d9

  Copy full SHA for c0af6d9

Commits on Jan 21, 2022

• Various ZeRO Stage3 Optimizations + Improvements (including bfloat16 support) (#1453)

  Show description for 4912e0a
  

  4 peopleauthored
  4912e0a

  Copy full SHA for 4912e0a

Commits on Dec 1, 2021

• Improve pre-commit hooks (#1602)

  Show description for fc2f378
  

  aphedges

  and

  jeffra

  authored
  fc2f378

  Copy full SHA for fc2f378

Commits on Nov 29, 2021

• force set lf instead of crlf (https://github.com/pre-commit/pre-commit-hooks#mixed-line-ending) (#1598)

  jeffra

  authored
  a10e481

  Copy full SHA for a10e481

Commits on Nov 19, 2021

• Several fixes for our read-the-docs build (#1579)

  jeffra

  authored
  a8a17f2

  Copy full SHA for a8a17f2

Commits on Nov 18, 2021

• Render docs for pipe.ProcessTopology (#1505)

  Show description for fafc827
  

  3 peopleauthored
  fafc827

  Copy full SHA for fafc827

Commits on Nov 16, 2021

• Add autotuning news post (#1565)

  cli99

  authored
  bda3d0e

  Copy full SHA for bda3d0e

Commits on Nov 13, 2021

• Update offload parameter names (#1536)

  Show description for 7567c76
  

  tjruwase

  and

  jeffra

  authored
  7567c76

  Copy full SHA for 7567c76

• Autotuning (#1554)

  Show description for 9caa74e
  

  4 peopleauthored
  9caa74e

  Copy full SHA for 9caa74e

Commits on Oct 29, 2021

• Fix typo (#1501)

  manuelciosici

  authored
  e976acc

  Copy full SHA for e976acc

Commits on Oct 20, 2021

• fix typos and add improvements (#1463)

  stas00

  authored
  dd22428

  Copy full SHA for dd22428

Commits on Oct 2, 2021

• Fix many typos (#1423)

  Show description for be789b1
  

  aphedges

  and

  tjruwase

  authored
  be789b1

  Copy full SHA for be789b1

Commits on Aug 17, 2021

• MoE read the docs update (#1312)

  jeffra

  authored
  9cb64a1

  Copy full SHA for 9cb64a1

Commits on Jul 12, 2021

• [model weights] zero_to_fp32 multiple improvements (#1181)

  Show description for 2a92106
  

  stas00

  and

  tjruwase

  authored
  2a92106

  Copy full SHA for 2a92106

Commits on Jun 23, 2021

• ZeRO 2+3 memory estimators (#965)

  Show description for 0c1802c
  

  3 peopleauthored
  0c1802c

  Copy full SHA for 0c1802c

Commits on May 24, 2021

• formatting fix

  jeffra

  committed
  0449cbd

  Copy full SHA for 0449cbd

• Add inference API to RTD (#1096)

  Show description for 0d701ec
  jeffra

  authored
  0d701ec

  Copy full SHA for 0d701ec

Commits on Apr 21, 2021

• 1-bit LAMB optimizer (#970)

  Show description for 67a48aa
  

  3 peopleauthored
  67a48aa

  Copy full SHA for 67a48aa

Commits on Apr 19, 2021

• assert no Z2/Z3 with pipeline and fix some docs links (#980)

  

  Shaden Smith

  authored
  fbece50

  Copy full SHA for fbece50

• ZeRO-Infinity docs (#979)

  Show description for 11279ae
  

  Shaden Smith

  authored
  11279ae

  Copy full SHA for 11279ae

• ZeRO-Infinity (#976)

  Show description for 0d4a54a
  

  4 peopleauthored
  0d4a54a

  Copy full SHA for 0d4a54a

Commits on Apr 14, 2021

• update lr scheduler doc for doing per step or epoch update (#913)

  Show description for c83e49f
  

  cli99

  and

  tjruwase

  authored
  c83e49f

  Copy full SHA for c83e49f

Commits on Apr 7, 2021

• docs (#909)

  Show description for 3169929
  

  3 peopleauthored
  3169929

  Copy full SHA for 3169929

Commits on Mar 16, 2021

• 1-bit Adam v2 (#817)

  Show description for 68c8481
  

  3 peopleauthored
  68c8481

  Copy full SHA for 68c8481

Commits on Mar 11, 2021

• small tweaks (#839)

  stas00

  authored
  7925d0c

  Copy full SHA for 7925d0c

• Add optimizers and schedules to RTD and updated the corresponding part in the website (#799)

  Show description for e0f36ed
  

  cli99

  and

  Shaden Smith

  authored
  e0f36ed

  Copy full SHA for e0f36ed

Commits on Mar 8, 2021

• ZeRO 3 Offload (#834)

  Show description for 599258f
  

  6 peopleauthored
  599258f

  Copy full SHA for 599258f

Commits on Jan 7, 2021

• Add deepspeed.init_distributed to RTD page (#645)

  Show description for 4e2dc4e
  

  jeffra

  and

  tjruwase

  authored
  4e2dc4e

  Copy full SHA for 4e2dc4e

Commits on Dec 15, 2020

• Fixes for RTD build errors (#606)

  Show description for 6380ee3
  

  jeffra

  and

  Shaden Smith

  authored
  6380ee3

  Copy full SHA for 6380ee3

Commits on Oct 30, 2020

• Add CPUAdam optimizer for zero-offload in deepspeed engine (#484)

  Show description for f5aa254
  

  RezaYazdaniAminabadi

  and

  jeffra

  authored
  f5aa254

  Copy full SHA for f5aa254

Commits on Sep 17, 2020

• readthedocs yaml configuration (#410)

  Show description for 5812e84
  

  Shaden Smith

  and

  jeffra

  authored
  5812e84

  Copy full SHA for 5812e84

Commits on Sep 10, 2020

• readthedocs upgrade (#402)

  

  Shaden Smith

  authored
  c82756c

  Copy full SHA for c82756c

• Pipeline parallel training engine. (#392)

  Show description for 65c2f97
  

  Shaden Smith

  and

  jeffra

  authored
  65c2f97

  Copy full SHA for 65c2f97

Commits on May 29, 2020

• Transformer kernel release (#242)

  Show description for 734d899
  

  8 peopleauthored
  734d899

  Copy full SHA for 734d899