Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Feb 12, 2025

• Update weights_only due to change in default in torch 2.6+ (#957)

  Show description for 83757d9
  loadams

  authored
  83757d9

  Copy full SHA for 83757d9

Commits on Feb 7, 2025

• Update references to deepspeedai GH org (#955)

  Show description for b90ffab
  loadams

  authored
  b90ffab

  Copy full SHA for b90ffab

Commits on Jan 6, 2025

• Add DPO support for DeepSpeed-Chat (#828)

  Show description for 1842b4f
  

  3 peopleauthored
  1842b4f

  Copy full SHA for 1842b4f

Commits on Dec 24, 2024

• remove-redundant-code (#947)

  simonJJJ

  authored
  476f600

  Copy full SHA for 476f600

Commits on Oct 30, 2024

• Remove the fixed `eot_token` mechanism for SFT (#927)

  Show description for eefb0ef
  

  3 peopleauthored
  eefb0ef

  Copy full SHA for eefb0ef

Commits on Oct 29, 2024

• Εnable reward model offloading option (#930)

  Show description for aa4459f
  

  3 peopleauthored
  aa4459f

  Copy full SHA for aa4459f

• Replace deprecated transformers.deepspeed module (#872)

  Show description for cab3361
  

  HollowMan6

  and

  loadams

  authored
  cab3361

  Copy full SHA for cab3361

Commits on Sep 17, 2024

• Enable overlap_comm for better performance (#846)

  Show description for f73a6ed
  

  li-plus

  and

  tjruwase

  authored
  f73a6ed

  Copy full SHA for f73a6ed

Commits on Sep 10, 2024

• Fix labels & eos_token for SFT (#819)

  li-plus

  authored
  a256c04

  Copy full SHA for a256c04

Commits on Feb 1, 2024

• Not a bug, just missing a space in README.md (#857)

  stceum

  authored
  6863634

  Copy full SHA for 6863634

Commits on Jan 17, 2024

• deepspeed-chat: Support zero3 params initialization in the last LN (#839)

  Show description for 57dd8fb
  

  deepcharm

  and

  tjruwase

  authored
  57dd8fb

  Copy full SHA for 57dd8fb

Commits on Jan 3, 2024

• Update README.md (#827)

  Show description for ff9a023
  

  chinainfant

  and

  mrwyattii

  authored
  ff9a023

  Copy full SHA for ff9a023

Commits on Dec 11, 2023

• Correction training script filename in README and Fix Bug for Step Running Time Display (#815)

  Show description for dd0f181
  

  UEFI-code

  and

  lekurile

  authored
  dd0f181

  Copy full SHA for dd0f181

Commits on Nov 21, 2023

• deepspeed-chat: filter stage3 too long prompts (#782)

  Show description for 8c551d2
  

  mosheisland

  and

  Moshe Island

  authored
  8c551d2

  Copy full SHA for 8c551d2

Commits on Nov 7, 2023

• fix: using DistributedSampler when evaluating the reward model (#804)

  Show description for ff0e254
  

  xffxff

  and

  yi.luo

  authored
  ff0e254

  Copy full SHA for ff0e254

Commits on Nov 6, 2023

• Update transformers dependency in deepspeed-chat install (#802)

  lekurile

  authored
  4dbff68

  Copy full SHA for 4dbff68

• Refactor deepspeed-chat into a python package. (#731)

  Show description for e86d0c6
  

  4 peopleauthored
  e86d0c6

  Copy full SHA for e86d0c6

Commits on Nov 1, 2023

• deepspeed-chat: display reward ema in stage3 (#779)

  Show description for f52b725
  

  3 peopleauthored
  f52b725

  Copy full SHA for f52b725

Commits on Oct 31, 2023

• deepspeed-chat: handle stage3 generate too short (#778)

  Show description for 86ccf61
  

  3 peopleauthored
  86ccf61

  Copy full SHA for 86ccf61

• deepspeed-chat: fix compute_fp32_loss with llama (#784)

  Show description for 70a24ed
  

  3 peopleauthored
  70a24ed

  Copy full SHA for 70a24ed

• deepspeed-chat: support print answers interval (#781)

  Show description for bb6eb4d
  

  3 peopleauthored
  bb6eb4d

  Copy full SHA for bb6eb4d

Commits on Oct 17, 2023

• deepspeed-chat: add end-of-text special token (#775)

  Show description for e8d879e
  

  3 peopleauthored
  e8d879e

  Copy full SHA for e8d879e

• deepspeed-chat: fix training stage1 ppl calculation (#773)

  Show description for f7ff9dd
  

  3 peopleauthored
  f7ff9dd

  Copy full SHA for f7ff9dd

• deepspeed-chat: fix bf16 stage2 accuracy for bloom-560m (#772)

  Show description for 185e25c
  

  mosheisland

  and

  Moshe Island

  authored
  185e25c

  Copy full SHA for 185e25c

Commits on Oct 16, 2023

• deepspeed-chat: fix weight decay configuration (#755)

  Show description for 8d850ba
  

  3 peopleauthored
  8d850ba

  Copy full SHA for 8d850ba

• deepspeed-chat: train v_head when only optimizing lora (#758)

  Show description for 5161c0f
  

  3 peopleauthored
  5161c0f

  Copy full SHA for 5161c0f

Commits on Oct 12, 2023

• Resolves the issue with evaluation on step2 for single GPU (#766)

  Show description for 3517c6d
  

  PareesaMS

  and

  mrwyattii

  authored
  3517c6d

  Copy full SHA for 3517c6d

Commits on Oct 9, 2023

• Fix typo (#749)

  Show description for 0855679
  

  xu-song

  and

  tjruwase

  authored
  0855679

  Copy full SHA for 0855679

Commits on Oct 8, 2023

• add the path to load the local dataset (#761)

  ys950902

  authored
  10aef97

  Copy full SHA for 10aef97

Commits on Oct 4, 2023

• deepspeed-chat: support periodic eval in stage2 (#747)

  Show description for bfad08f
  

  3 peopleauthored
  bfad08f

  Copy full SHA for bfad08f

• deepspeed-chat: calculate loss in fp32 (#754)

  Show description for e6f400a
  

  mosheisland

  and

  Moshe Island

  authored
  e6f400a

  Copy full SHA for e6f400a

Commits on Oct 3, 2023

• Update README.md (#757)

  xiaoxiawu-microsoft

  authored
  4364031

  Copy full SHA for 4364031

• Deepspeed-VisualChat (#753)

  Show description for 6c05e03
  

  3 peopleauthored
  6c05e03

  Copy full SHA for 6c05e03

• Add default value for tokenizer path (#699)

  Show description for 0d11c63
  

  3 peopleauthored
  0d11c63

  Copy full SHA for 0d11c63

• deepspeed-chat: fix incorrect lr when using lora only (#756)

  Show description for ca03bd7
  

  mosheisland

  and

  Moshe Island

  authored
  ca03bd7

  Copy full SHA for ca03bd7