Commits

Breadcrumbs

History for

onmaster

User selector

All users

Datepicker

All time

Commit History

Commits on Jan 15, 2025

• Remove deprecated usage of export_to_pretty_string in apex

  nWEIdia

  committed
  1d887b4

  Copy full SHA for 1d887b4

Commits on Dec 14, 2024

• Traceable LayerNorm (#1864)

  yanboliang

  authored
  73375b3

  Copy full SHA for 73375b3

Commits on Dec 9, 2024

• Traceable RMSNorm part 2: non affine fused rms norm (#1862)

  Show description for 2863aa0
  yanboliang

  authored
  2863aa0

  Copy full SHA for 2863aa0

Commits on Nov 28, 2024

• Traceable RMSNorm (#1861)

  yanboliang

  authored
  ac8214e

  Copy full SHA for ac8214e

Commits on Sep 28, 2024

• remove run_transformer from default lists (#1830)

  crcrpar

  authored
  e13011f

  Copy full SHA for e13011f

Commits on Jun 29, 2024

• deprecate uses of torch.cuda.amp (#1813)

  Show description for f8e60c4
  Fuzzkatt

  authored
  f8e60c4

  Copy full SHA for f8e60c4

Commits on Jun 8, 2024

• Use torch.testing.all_close instead of get_max_diff in test_lamb.py (#1806)

  Fuzzkatt

  authored
  7b73b12

  Copy full SHA for 7b73b12

Commits on Apr 19, 2024

• Add 2D Fused RoPE (#1784)

  Show description for b5df1cc
  yaox12

  authored
  b5df1cc

  Copy full SHA for b5df1cc

Commits on Mar 12, 2024

• Update test_fused_softmax.py (#1782)

  eqy

  authored
  810ffae

  Copy full SHA for 810ffae

Commits on Jan 25, 2024

• Update test_adam.py (#1772)

  eqy

  authored
  141bbf1

  Copy full SHA for 141bbf1

Commits on Jan 12, 2024

• Fused RoPE for thd format (#1756)

  Show description for f058162
  yaox12

  authored
  f058162

  Copy full SHA for f058162

Commits on Jan 5, 2024

• 64-bit indexing Adam (#1765)

  Show description for 87c4deb
  eqy

  authored
  87c4deb

  Copy full SHA for 87c4deb

Commits on Nov 29, 2023

• [FusedRoPE] Fuse type conversion and cos/sin (#1752)

  Show description for 37d83fc
  yaox12

  authored
  37d83fc

  Copy full SHA for 37d83fc

Commits on Nov 23, 2023

• Avoid .contiguous() in fused RoPE (#1751)

  Show description for dc5fa38
  yaox12

  authored
  dc5fa38

  Copy full SHA for dc5fa38

Commits on Nov 16, 2023

• fix a bug in fused rope (#1750)

  Show description for fd4ae7d
  yaox12

  authored
  fd4ae7d

  Copy full SHA for fd4ae7d

Commits on Nov 14, 2023

• A fused apply_rotary_pos_emb implementation for Megatron-Core (#1746)

  Show description for 08f7402
  yaox12

  authored
  08f7402

  Copy full SHA for 08f7402

Commits on Nov 10, 2023

• Misc Changes (#1747)

  Show description for 97e38d6
  nWEIdia

  authored
  97e38d6

  Copy full SHA for 97e38d6

Commits on Oct 17, 2023

• Use torch.testing.assert_close for better signals (#1742)

  eqy

  authored
  19cc873

  Copy full SHA for 19cc873

Commits on Sep 30, 2023

• Add hysteresis support for AMP gradient scale update (#1733)

  Show description for 6a77872
  

  5 peopleauthored
  6a77872

  Copy full SHA for 6a77872

Commits on Sep 28, 2023

• Massively reduce LayerNorm/RMSNorm GPU memory usage in modern networks by tricking torch autograd (#1715)

  Show description for 6ff4548
  RuiWang1998

  authored
  6ff4548

  Copy full SHA for 6ff4548

Commits on Sep 19, 2023

• Add multi_tensor_unscale_l2norm_cuda (#1727)

  Show description for 741bdf5
  

  minitu

  and

  Jaemin Choi

  authored
  741bdf5

  Copy full SHA for 741bdf5

Commits on Aug 29, 2023

• Update tests/L0/run_fused_layer_norm/test_fused_layer_norm.py

  Show description for 0d47550
  

  borisfom

  and

  crcrpar

  authored
  0d47550

  Copy full SHA for 0d47550

Commits on Aug 28, 2023

• Adjusting test for opset 18

  Show description for a8d9e43
  borisfom

  committed
  a8d9e43

  Copy full SHA for a8d9e43

Commits on Aug 16, 2023

• skip UccP2PCommTest on single GPU (#1711)

  Aidyn-A

  authored
  38a1269

  Copy full SHA for 38a1269

Commits on Aug 8, 2023

• Add BF16 support to FusedMixedPrecisionLamb (#1439)

  Show description for 6309120
  

  nv-joseli

  and

  crcrpar

  authored
  6309120

  Copy full SHA for 6309120

Commits on Jun 2, 2023

• [Test][Transformer] Pre-parse container version (#1673)

  Show description for 05091d4
  Aidyn-A

  authored
  05091d4

  Copy full SHA for 05091d4

Commits on May 12, 2023

• allow for custom directory of xml reports (#1661)

  Show description for 2d876b8
  crcrpar

  authored
  2d876b8

  Copy full SHA for 2d876b8

Commits on Apr 27, 2023

• Using regular layernorm for ONNX and TS export (#1634)

  Show description for 85e9edd
  

  borisfom

  and

  crcrpar

  authored
  85e9edd

  Copy full SHA for 85e9edd

Commits on Apr 26, 2023

• [Transformer][test/L0] Increase max world_size for BERT and GPT (#1651)

  Aidyn-A

  authored
  5b5d410

  Copy full SHA for 5b5d410

Commits on Apr 14, 2023

• Add support for FP32 master weights in FusedAdam optimizer (#1625)

  Show description for 6bd01c4
  

  5 peopleauthored
  6bd01c4

  Copy full SHA for 6bd01c4

Commits on Mar 23, 2023

• check for empty params in group (#1596)

  Show description for 0420735
  

  3 peopleauthored
  0420735

  Copy full SHA for 0420735

Commits on Mar 22, 2023

• Revert "Add support for FP32 master weights in FusedAdam optimizer (#1623)" (#1624)

  Show description for 4060aef
  crcrpar

  authored
  4060aef

  Copy full SHA for 4060aef

• Add support for FP32 master weights in FusedAdam optimizer (#1623)

  Show description for 6952004
  

  4 peopleauthored
  6952004

  Copy full SHA for 6952004

Commits on Jan 31, 2023

• Capturable Adam optimizer (#1560)

  Show description for ad68a2f
  gilshm

  authored
  ad68a2f

  Copy full SHA for ad68a2f

Commits on Jan 26, 2023

• update test routines (#1567)

  Aidyn-A

  authored
  537424d

  Copy full SHA for 537424d

Pagination

Previous

Next