Commits

Breadcrumbs

History for

onmaster

User selector

All users

Datepicker

All time

Commit History

Commits on Nov 28, 2023

• use all_gather_into_tensor instead of all_gather (deepspeedai#4705)

  Show description for fd0a52c
  

  taozhiwei

  and

  --local

  authored
  fd0a52c

  Copy full SHA for fd0a52c

Commits on Nov 17, 2023

• Add get and set APIs for the ZeRO-3 partitioned parameters (deepspeedai#4681)

  Show description for 0ec2d3e
  

  4 peopleauthored
  0ec2d3e

  Copy full SHA for 0ec2d3e

Commits on Nov 14, 2023

• KV Cache Improved Flexibility (deepspeedai#4668)

  Show description for 901d807
  

  cmikeh2

  and

  tjruwase

  authored
  901d807

  Copy full SHA for 901d807

• Inference Checkpoints in V2 (deepspeedai#4664)

  Show description for 5411030
  

  8 peopleauthored
  5411030

  Copy full SHA for 5411030

Commits on Nov 13, 2023

• Add stable diffusion unit test (deepspeedai#2496)

  Show description for efd4556
  

  4 peopleauthored
  efd4556

  Copy full SHA for efd4556

• [NPU] Add NPU support for unit test (deepspeedai#4569)

  Show description for 4b7cae7
  

  3 peopleauthored
  4b7cae7

  Copy full SHA for 4b7cae7

Commits on Nov 10, 2023

• Update lr_schedules.py (deepspeedai#4563)

  Show description for 4388a60
  

  3 peopleauthored
  4388a60

  Copy full SHA for 4388a60

Commits on Nov 9, 2023

• Fix the openfold training. (deepspeedai#4657)

  Show description for 1d1a20c
  

  cctry

  and

  conglongli

  authored
  1d1a20c

  Copy full SHA for 1d1a20c

Commits on Nov 8, 2023

• Enhance the robustness of module_state_dict (deepspeedai#4587)

  Show description for 01af3e1
  LZHgrla

  authored
  01af3e1

  Copy full SHA for 01af3e1

Commits on Nov 7, 2023

• Isolate src code and testing for DeepSpeed-FastGen (deepspeedai#4610)

  Show description for f6fce50
  

  6 peopleauthored
  f6fce50

  Copy full SHA for f6fce50

Commits on Nov 6, 2023

• Guanhua/partial offload rebase v2 (deepspeedai#590) (deepspeedai#4636)

  Show description for b1cb0df
  

  3 peopleauthored
  b1cb0df

  Copy full SHA for b1cb0df

Commits on Nov 3, 2023

• DeepSpeed-FastGen (deepspeedai#4604)

  Show description for 38b41df
  

  6 peopleauthored
  38b41df

  Copy full SHA for 38b41df

Commits on Oct 25, 2023

• [AutoTP] Make AutoTP work when num_heads not divisible by number of workers (deepspeedai#4011)

  Show description for f15cccf
  

  6 peopleauthored
  f15cccf

  Copy full SHA for f15cccf

Commits on Oct 11, 2023

• adding 8bit dequantization kernel for asym fine-grained block quantization in zero-inference (deepspeedai#4450)

  Show description for 6c86ff3
  

  3 peopleauthored
  6c86ff3

  Copy full SHA for 6c86ff3

Commits on Oct 9, 2023

• Introduce pydantic_v1 compatibility module for pydantic>=2.0.0 support (deepspeedai#4407)

  Show description for 604d701
  ringohoffman

  authored
  604d701

  Copy full SHA for 604d701

Commits on Oct 5, 2023

• feat: add Lion optimizer (deepspeedai#4331)

  Show description for 8e64c3b
  

  enneamer

  and

  loadams

  authored
  8e64c3b

  Copy full SHA for 8e64c3b

• CI fix for torch 2.1 release (deepspeedai#4452)

  Show description for 4294ea1
  mrwyattii

  authored
  4294ea1

  Copy full SHA for 4294ea1

Commits on Sep 27, 2023

• add CPU autotp UT (deepspeedai#4263)

  Yejing-Lai

  authored
  388c848

  Copy full SHA for 388c848

Commits on Sep 20, 2023

• adds triton flash attention2 kernel (deepspeedai#4337)

  Show description for 0e0748c
  

  3 peopleauthored
  0e0748c

  Copy full SHA for 0e0748c

• Fix min torch version (deepspeedai#4375)

  tjruwase

  authored
  463dea2

  Copy full SHA for 463dea2

• Openfold fix (deepspeedai#4368)

  Show description for c581464
  

  cctry

  and

  conglongli

  authored
  c581464

  Copy full SHA for c581464

Commits on Sep 19, 2023

• Enable workflow dispatch on Torch 1.10 CI tests (deepspeedai#4361)

  loadams

  authored
  dcd3ae1

  Copy full SHA for dcd3ae1

Commits on Sep 18, 2023

• DeepSpeed4Science (deepspeedai#4357)

  Show description for f876d81
  

  22 peopleauthored
  f876d81

  Copy full SHA for f876d81

Commits on Sep 14, 2023

• Fix skipped inference tests (deepspeedai#4336)

  Show description for 8c7f7fd
  mrwyattii

  authored
  8c7f7fd

  Copy full SHA for 8c7f7fd

• Fix a bug in the implementation of dequantization for inference (deepspeedai#3433)

  Show description for 9bf7778
  

  3 peopleauthored
  9bf7778

  Copy full SHA for 9bf7778

Commits on Sep 13, 2023

• Clean up modeling code (deepspeedai#4320)

  Show description for 180dd39
  loadams

  authored
  180dd39

  Copy full SHA for 180dd39

• Handle empty parameter groups (deepspeedai#4277)

  tjruwase

  authored
  9adc73f

  Copy full SHA for 9adc73f

Commits on Sep 11, 2023

• ZeRO-Inference refresh (deepspeedai#4197)

  Show description for aa4a740
  

  21 peopleauthored
  aa4a740

  Copy full SHA for aa4a740

Commits on Sep 7, 2023

• update deepspeed to run with the most recent triton 2.1.0 (deepspeedai#4278)

  Show description for e8ed741
  

  3 peopleauthored
  e8ed741

  Copy full SHA for e8ed741

Commits on Sep 6, 2023

• use non_reentrant_checkpoint fix requires_grad of input must be true for activation checkpoint layer in pipeline train. (deepspeedai#4224)

  Show description for 60a3e89
  

  9 peopleauthored
  60a3e89

  Copy full SHA for 60a3e89

Commits on Sep 5, 2023

• skipping redundant MoE optimizer state loading (deepspeedai#4120)

  Show description for e801e6d
  

  Alexander Jipa

  and

  azzhipa

  authored
  e801e6d

  Copy full SHA for e801e6d

• Code Refactoring (deepspeedai#4262)

  Show description for 9894c06
  

  tosemml

  and

  loadams

  authored
  9894c06

  Copy full SHA for 9894c06

Commits on Sep 1, 2023

• Allow modification of zero partitioned parameters (deepspeedai#4192)

  Show description for a23cda6
  

  3 peopleauthored
  a23cda6

  Copy full SHA for a23cda6

Commits on Aug 29, 2023

• added port argument for ssh (deepspeedai#4117)

  Show description for 8145b5e
  

  3 peopleauthored
  8145b5e

  Copy full SHA for 8145b5e

• feat(activation_checkpointing): add non_reentrant_checkpoint to support inputs require no grad (deepspeedai#4118)

  Show description for 42c1e91
  

  7 peopleauthored
  42c1e91

  Copy full SHA for 42c1e91

Pagination

Previous

Next