Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Aug 30, 2024

• Add Unittest For Distributed Adam With CUDA Graph (NVIDIA#1836)

  Show description for b7a4acc
  

  alpha0422

  and

  crcrpar

  authored
  b7a4acc

  Copy full SHA for b7a4acc

• Reformat grad_output if it's not channels last. (NVIDIA#1837)

  alpha0422

  authored
  c3e4adf

  Copy full SHA for c3e4adf

• Enhance Distributed Fused Adam (NVIDIA#1832)

  Show description for 7d5ecf1
  

  alpha0422

  and

  timmoon10

  authored
  7d5ecf1

  Copy full SHA for 7d5ecf1

• Traceable GroupNorm (NVIDIA#1835)

  Show description for 2d2db12
  

  alpha0422

  and

  crcrpar

  authored
  2d2db12

  Copy full SHA for 2d2db12

Commits on Aug 19, 2024

• add **kwargs to DistributedTestBase._run (NVIDIA#1829)

  xwang233

  authored
  7001836

  Copy full SHA for 7001836

Commits on Aug 17, 2024

• Fix illegal memory access with multi_tensor_apply size above INT_MAX (NVIDIA#1825)

  Show description for 79e3dc4
  gdb

  authored
  79e3dc4

  Copy full SHA for 79e3dc4

Commits on Jul 25, 2024

• Allow Configurable Cache Directory (NVIDIA#1821)

  Show description for 59b80ee
  leimao

  authored
  59b80ee

  Copy full SHA for 59b80ee

Commits on Jul 24, 2024

• Do not monkey-patch class methods when registering distopt pre-forward hooks (NVIDIA#1820)

  Show description for f9f19d5
  timmoon10

  authored
  f9f19d5

  Copy full SHA for f9f19d5

Commits on Jul 2, 2024

• release gil (NVIDIA#1816)

  Show description for 23c1f86
  crcrpar

  authored
  23c1f86

  Copy full SHA for 23c1f86

Commits on Jun 29, 2024

• deprecate uses of torch.cuda.amp (NVIDIA#1813)

  Show description for f8e60c4
  Fuzzkatt

  authored
  f8e60c4

  Copy full SHA for f8e60c4

Commits on Jun 8, 2024

• Use torch.testing.all_close instead of get_max_diff in test_lamb.py (NVIDIA#1806)

  Fuzzkatt

  authored
  7b73b12

  Copy full SHA for 7b73b12

Commits on Apr 26, 2024

• Fix reduce_blocks_into_lanes race condition (NVIDIA#1798)

  Show description for a7de60e
  Fuzzkatt

  authored
  a7de60e

  Copy full SHA for a7de60e

Commits on Apr 24, 2024

• NCCL userbuffer for DP RS in DistOpt (NVIDIA#1797)

  Show description for f3f0492
  

  3 peopleauthored
  f3f0492

  Copy full SHA for f3f0492

• Add nccl_allocator for zero-copy user buffer (NVIDIA#1796)

  Show description for 6038fc1
  Aidyn-A

  authored
  6038fc1

  Copy full SHA for 6038fc1

Commits on Apr 19, 2024

• Add 2D Fused RoPE (NVIDIA#1784)

  Show description for b5df1cc
  yaox12

  authored
  b5df1cc

  Copy full SHA for b5df1cc

• move to correct device for v1 state (NVIDIA#1783)

  acphile

  authored
  c5f6b79

  Copy full SHA for c5f6b79

Commits on Mar 12, 2024

• Update test_fused_softmax.py (NVIDIA#1782)

  eqy

  authored
  810ffae

  Copy full SHA for 810ffae

Commits on Feb 8, 2024

• Support scaled optimizer state in distributed Adam optimizer (NVIDIA#1771)

  Show description for b496d85
  timmoon10

  authored
  b496d85

  Copy full SHA for b496d85

Commits on Feb 7, 2024

• Add GPUDirect Storage (NVIDIA#1774)

  Show description for 5b67cd5
  Aidyn-A

  authored
  5b67cd5

  Copy full SHA for 5b67cd5

• Skip the p2p test on single GPU platforms (NVIDIA#1775)

  nWEIdia

  authored
  7e239f7

  Copy full SHA for 7e239f7

Commits on Jan 25, 2024

• Update test_adam.py (NVIDIA#1772)

  eqy

  authored
  141bbf1

  Copy full SHA for 141bbf1

Commits on Jan 18, 2024

• Update test_bottleneck_module.py - Skip BottleNeck Peer Memory Test if Not Supported (NVIDIA#1769)

  Show description for 6c8f384
  nWEIdia

  authored
  6c8f384

  Copy full SHA for 6c8f384

Commits on Jan 12, 2024

• Update test_transducer_joint.py (NVIDIA#1767)

  Show description for 48c4894
  nWEIdia

  authored
  48c4894

  Copy full SHA for 48c4894

• Fused RoPE for thd format (NVIDIA#1756)

  Show description for f058162
  yaox12

  authored
  f058162

  Copy full SHA for f058162

Commits on Jan 10, 2024

• Increase tolerance to workaround tolerance issues on A100 (NVIDIA#1766)

  Show description for e9789cc
  nWEIdia

  authored
  e9789cc

  Copy full SHA for e9789cc

Commits on Jan 5, 2024

• 64-bit indexing Adam (NVIDIA#1765)

  Show description for 87c4deb
  eqy

  authored
  87c4deb

  Copy full SHA for 87c4deb

Commits on Jan 1, 2024

• Make fused layer norm functions backward-compatible (NVIDIA#1760)

  Show description for c07a4cf
  timmoon10

  authored
  c07a4cf

  Copy full SHA for c07a4cf

Commits on Dec 15, 2023

• [contrib] Improve FusedAdamSWA interface and add unit tests (NVIDIA#1759)

  Show description for ccffcc4
  

  lirundong

  and

  crcrpar

  authored
  ccffcc4

  Copy full SHA for ccffcc4

• add async copy for openfold swa (NVIDIA#1758)

  Show description for 5d89c04
  

  azazhu

  and

  Feiwen Zhu

  authored
  5d89c04

  Copy full SHA for 5d89c04

Commits on Nov 29, 2023

• [FusedRoPE] Fuse type conversion and cos/sin (NVIDIA#1752)

  Show description for 37d83fc
  yaox12

  authored
  37d83fc

  Copy full SHA for 37d83fc

Commits on Nov 28, 2023

• Use recommended PyTorch methods to silence warnings (NVIDIA#1754)

  Show description for 7548f68
  deepakn94

  authored
  7548f68

  Copy full SHA for 7548f68

Commits on Nov 23, 2023

• Avoid .contiguous() in fused RoPE (NVIDIA#1751)

  Show description for dc5fa38
  yaox12

  authored
  dc5fa38

  Copy full SHA for dc5fa38

Commits on Nov 20, 2023

• Distributed optimizer support for contiguous param buffer with FP8 params (NVIDIA#1749)

  Show description for a2f6683
  timmoon10

  authored
  a2f6683

  Copy full SHA for a2f6683

Commits on Nov 16, 2023

• fix a bug in fused rope (NVIDIA#1750)

  Show description for fd4ae7d
  yaox12

  authored
  fd4ae7d

  Copy full SHA for fd4ae7d

Commits on Nov 14, 2023

• A fused apply_rotary_pos_emb implementation for Megatron-Core (NVIDIA#1746)

  Show description for 08f7402
  yaox12

  authored
  08f7402

  Copy full SHA for 08f7402

Pagination

Previous

Next