Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Aug 16, 2024

• Add and Remove ZeRO 3 Hooks (microsoft#5658)

  Show description for c2e3a70
  

  5 peopleauthored
  c2e3a70

• Enable dynamic shapes for pipeline parallel engine inputs (microsoft#5481)

  Show description for 1ab1928
  

  tohtana

  and

  tjruwase

  authored
  1ab1928

Commits on Aug 15, 2024

• Move inf_or_nan_tracker to cpu for cpu offload (microsoft#5826)

  Show description for 4d4ff0e
  

  3 peopleauthored
  4d4ff0e

• add moe topk(k>2) gate support (microsoft#5881)

  Show description for 9a3ede7
  

  6 peopleauthored
  9a3ede7

• move pynvml install to setup.py (microsoft#5840)

  Show description for 30428d0
  Rohan138

  authored
  30428d0

• Update version.txt after 0.14.5 release (microsoft#5982)

  Show description for 3f6df9a
  loadams

  authored
  3f6df9a

• Allow accelerator to instantiate the device (microsoft#5255)

  Show description for eb07d41
  

  4 peopleauthored
  eb07d41

Commits on Aug 14, 2024

• Update xpu-max1100.yml with new config and add some tests (microsoft#5668)

  Show description for 4ba49dd
  

  3 peopleauthored
  4ba49dd

• Z3: optimizations for grad norm calculation and gradient clipping (microsoft#5504)

  Show description for 6eed634
  

  5 peopleauthored
  6eed634

• Add accelerator setup guides (microsoft#5827)

  Show description for 19b01e1
  

  4 peopleauthored
  19b01e1

• HPUAccelerator: remove support in set_visible_devices_envs (microsoft#5929)

  Show description for a8d1b44
  

  nelyahu

  and

  tjruwase

  authored
  a8d1b44

• Update LR scheduler configuration (microsoft#5846)

  Show description for f994fb2
  

  xiyang-aads-lilly

  and

  tjruwase

  authored
  f994fb2

• Fix missing ds_id bug (microsoft#5824)

  Show description for e3177de
  

  tjruwase

  and

  loadams

  authored
  e3177de

• Update container version for Gaudi2 CI (microsoft#5937)

  Show description for 051c993
  raza-sikander

  authored
  051c993

• [Zero2] Reduce the unnecessary all-reduce when tensor size is 0. (microsoft#5868)

  Show description for 24d1d86
  

  ys950902

  and

  tjruwase

  authored
  24d1d86

• Use torch.nan_to_num replace numpy wrapper one (microsoft#5877)

  Show description for 862aff3
  

  jinyouzhi

  and

  loadams

  authored
  862aff3

• Log operator warnings only in verbose mode (microsoft#5917)

  tjruwase

  authored
  0f2d485

Commits on Aug 13, 2024

• OptimizedLinear updates (microsoft#5791)

  Show description for 6e5d58d
  

  jeffra

  and

  sfc-gh-reyazda

  authored
  6e5d58d

• Upgrade HPU image to v1.16.2. (microsoft#5610)

  Show description for 1890b81
  

  vshekhawat-hlab

  and

  loadams

  authored
  1890b81

Commits on Aug 8, 2024

• Fix the bug of deepspeed sequence parallel working with batch size larger than 1 (microsoft#5823)

  Show description for ffe0af2
  

  5 peopleauthored
  ffe0af2

Commits on Aug 6, 2024

• Add Japanese translation of DeepNVMe blog (microsoft#5845)

  Show description for ade7149
  tohtana

  authored
  ade7149

• Update clang-format version from 16 to 18. (microsoft#5839)

  Show description for 297a684
  loadams

  authored
  297a684

Commits on Aug 5, 2024

• Fix docs building guide (microsoft#5825)

  Show description for 0584689
  

  tjruwase

  and

  loadams

  authored
  0584689

Commits on Aug 2, 2024

• Fix NV references (microsoft#5821)

  Show description for 2ef8223
  

  tjruwase

  and

  loadams

  authored
  2ef8223

• Non-reentrant checkpointing hook fix (microsoft#5781)

  Show description for 3a2d526
  

  3 peopleauthored
  3a2d526

Commits on Aug 1, 2024

• Link GDS blog to site (microsoft#5820)

  tjruwase

  authored
  029bb52

• Use accelerator to replace cuda in setup and runner (microsoft#5769)

  Show description for 3c490f9
  

  Andy666G

  and

  loadams

  authored
  3c490f9

• Add fp16 support of Qwen1.5MoE models (A2.7B) to DeepSpeed-FastGen (microsoft#5403)

  Show description for 249c1db
  

  4 peopleauthored
  249c1db

• Update to ROCm6 (microsoft#5491)

  loadams

  authored
  23d0e02

• sequence parallel with communication overlap (microsoft#5691)

  Show description for 17ed7c7
  

  3 peopleauthored
  17ed7c7

• [ROCm] Get rocm version from /opt/rocm/.info/version (microsoft#5815)

  Show description for f82d088
  

  rraminen

  and

  loadams

  authored
  f82d088

• GDS AIO Blog (microsoft#5817)

  Show description for 324ee65
  

  3 peopleauthored
  324ee65

Commits on Jul 31, 2024

• Fix CPU Adam JIT compilation (microsoft#5780)

  Show description for 681be6f
  

  lekurile

  and

  loadams

  authored
  681be6f

• Find ROCm on Fedora (microsoft#5705)

  Show description for 550f9c7
  

  trixirt

  and

  loadams

  authored
  550f9c7

• Fix op_builder for CUDA 12.5 (microsoft#5806)

  Show description for 08598db
  

  3 peopleauthored
  08598db

Pagination

PreviousNext