Release 24.09-alpha.rc0: Merge pull request #1126 from mikolajblaz/mblaz/fix-fp8-exchange · TJX2014/Megatron-LM · GitHub

24.09-alpha.rc0
dd18205
Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.

GPG key ID: B5690EEEBB952194

Verified
Learn about vigilant mode
Compare

Choose a tag to compare

Loading

View all tags

24.09-alpha.rc0: Merge pull request #1126 from mikolajblaz/mblaz/fix-fp8-exchange

24.09-alpha.rc0
dd18205
Compare

Choose a tag to compare

Loading

View all tags
Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.

GPG key ID: B5690EEEBB952194

Verified
Learn about vigilant mode

mmarcinkiewicz tagged this 10 Sep 20:05

Fix parallel load convergence issue by ensuring BF16 exchange for FP8 tensors

Assets 2