Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Apr 5, 2023

• Enable autoTP for bloom (#3035)

  Show description for 6ba0024
  

  sywangyi

  and

  tjruwase

  authored
  6ba0024

  Copy full SHA for 6ba0024

Commits on Mar 31, 2023

• Update DeepSpeed copyright license to Apache 2.0 (#3111)

  Show description for b361c72
  

  mrwyattii

  and

  jeffra

  authored
  b361c72

  Copy full SHA for b361c72

Commits on Mar 27, 2023

• update formatter version and style settings (#3098)

  jeffra

  authored
  91d63e0

  Copy full SHA for 91d63e0

Commits on Mar 7, 2023

• Check for local CUDA graphs when enable_cuda_graph=True (#2941)

  lekurile

  authored
  87eaf8f

  Copy full SHA for 87eaf8f

Commits on Feb 15, 2023

• Refactor DS inference API. No longer need replace_method. (#2831)

  Show description for e4b3b61
  

  awan-10

  and

  mrwyattii

  authored
  e4b3b61

  Copy full SHA for e4b3b61

Commits on Feb 3, 2023

• Reset KV-cache at the beginning of text-generation (#2669)

  Show description for 9f41ffe
  

  3 peopleauthored
  9f41ffe

  Copy full SHA for 9f41ffe

Commits on Feb 2, 2023

• Fix broken kernel inject bug (#2776)

  molly-smith

  authored
  c5b983e

  Copy full SHA for c5b983e

Commits on Jan 26, 2023

• Abstract accelerator (step 3) (#2677)

  Show description for 98cc35b
  

  3 peopleauthored
  98cc35b

  Copy full SHA for 98cc35b

Commits on Jan 24, 2023

• Automatic tensor parallelism v2 (#2670)

  Show description for d59b572
  

  molly-smith

  and

  mrwyattii

  authored
  d59b572

  Copy full SHA for d59b572

Commits on Jan 19, 2023

• Inference Refactor (replace_with_policy, model_implementations) (#2554)

  Show description for 867da30
  

  4 peopleauthored
  867da30

  Copy full SHA for 867da30

Commits on Jan 6, 2023

• Fix Opt injection (#2541)

  Show description for 95d9a1b
  

  3 peopleauthored
  95d9a1b

  Copy full SHA for 95d9a1b

Commits on Dec 19, 2022

• [inference] check for unsupported model generate args (#2627)

  jeffra

  authored
  5676f5e

  Copy full SHA for 5676f5e

Commits on Dec 16, 2022

• Remove GatheredParameters context from replace_with_policy (#2591)

  Show description for 503706a
  lekurile

  authored
  503706a

  Copy full SHA for 503706a

Commits on Nov 23, 2022

• Pass down the new DS inference config to replace_transformer_layer. (#2539)

  Show description for 90ae688
  awan-10

  authored
  90ae688

  Copy full SHA for 90ae688

Commits on Nov 22, 2022

• Ensure is initialized for SD (#2534)

  cmikeh2

  authored
  57e0a55

  Copy full SHA for 57e0a55

Commits on Nov 15, 2022

• DeepSpeed inference config. (#2459) (#2472)

  Show description for b5d18a6
  

  awan-10

  and

  mrwyattii

  authored
  b5d18a6

  Copy full SHA for b5d18a6

Commits on Nov 10, 2022

• Stable Diffusion Enhancements (#2491)

  Show description for e7e7595
  

  3 peopleauthored
  e7e7595

  Copy full SHA for e7e7595

Commits on Nov 2, 2022

• fixing the checkpoint loading at inference-engine (#2429)

  Show description for 39bdc14
  

  RezaYazdaniAminabadi

  and

  awan-10

  authored
  39bdc14

  Copy full SHA for 39bdc14

• Cache Allocation and Softmax Fixes (#2433)

  Show description for 10e9d04
  

  3 peopleauthored
  10e9d04

  Copy full SHA for 10e9d04

Commits on Oct 26, 2022

• Use CUDA events for inference model profiling (#2371)

  Show description for e772f16
  mrwyattii

  authored
  e772f16

  Copy full SHA for e772f16

Commits on Oct 14, 2022

• fix checkpoint loading when it is a dictionary (#2425)

  RezaYazdaniAminabadi

  authored
  537e858

  Copy full SHA for 537e858

Commits on Oct 13, 2022

• add SD injection policy (#2381)

  Show description for ec13da6
  

  3 peopleauthored
  ec13da6

  Copy full SHA for ec13da6

Commits on Sep 23, 2022

• Inference profiling updates/fixes (#2348) (#2349)

  Show description for 9932643
  

  3 peopleauthored
  9932643

  Copy full SHA for 9932643

Commits on Sep 14, 2022

• only override forward if using cuda-graph (#2291)

  jeffra

  authored
  cf638be

  Copy full SHA for cf638be

Commits on Aug 30, 2022

• Ds-inference Int8 support through ZeroQuant technology (#2217)

  Show description for afdc728
  

  RezaYazdaniAminabadi

  and

  jeffra

  authored
  afdc728

  Copy full SHA for afdc728

Commits on Aug 15, 2022

• Add support of OPT models (#2205)

  Show description for 8b2a637
  

  4 peopleauthored
  8b2a637

  Copy full SHA for 8b2a637

Commits on Jul 29, 2022

• Fix random token-generation issue + MP-checkpoint loading/saving (#2132)

  Show description for 556f005
  

  3 peopleauthored
  556f005

  Copy full SHA for 556f005

Commits on Jul 28, 2022

• Trajepl/nebula ckpt engine (#2085)

  Show description for e669aaf
  

  4 peopleauthored
  e669aaf

  Copy full SHA for e669aaf

Commits on Jul 25, 2022

• Add flake8 to pre-commit checks (#2051)

  aphedges

  authored
  316c4a4

  Copy full SHA for 316c4a4

Commits on Jul 20, 2022

• reduce ds-inference log verbosity (#2111)

  jeffra

  authored
  844d9f3

  Copy full SHA for 844d9f3

Commits on Jul 18, 2022

• Add Inference support for running the BigScience-BLOOM Architecture (#2083)

  Show description for aa88137
  

  3 peopleauthored
  aa88137

  Copy full SHA for aa88137

Commits on Jun 20, 2022

• fix import errors (#2026)

  Show description for 735406e
  

  KMFODA

  and

  mrwyattii

  authored
  735406e

  Copy full SHA for 735406e

Commits on Jun 15, 2022

• [inference] test suite for ds-kernels (bert, roberta, gpt2, gpt-neo, gpt-j) (#1992)

  Show description for b666d5c
  

  4 peopleauthored
  b666d5c

  Copy full SHA for b666d5c

Commits on Jun 10, 2022

• DeepSpeed comm backend v1 (#1985)

  Show description for 36ad311
  

  3 peopleauthored
  36ad311

  Copy full SHA for 36ad311

Commits on May 17, 2022

• Enabling CUDA-graph for the bert-type models (#1952)

  Show description for a5adb90
  

  3 peopleauthored
  a5adb90

  Copy full SHA for a5adb90