Skip to content

Tags: TJX2014/Megatron-LM

Tags

core_r0.9.0

Toggle core_r0.9.0's commit message
chore: Fix version number

Signed-off-by: Oliver Koenig <[email protected]>

24.09-alpha.rc0

Toggle 24.09-alpha.rc0's commit message

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
Merge pull request NVIDIA#1126 from mikolajblaz/mblaz/fix-fp8-exchange

Fix parallel load convergence issue by ensuring BF16 exchange for FP8 tensors

core_r0.8.0

Toggle core_r0.8.0's commit message
Merge branch 'ko3n1g/chore/remove-prerelease' into 'core_r0.8.0'

chore: Remove prerelease

See merge request ADLR/megatron-lm!1922

core_v0.7.0

Toggle core_v0.7.0's commit message
Merge branch 'cherry-pick-c4d12e26' into 'core_r0.7.0'

Merge branch 'xuwenc/moe_gmm_infer_fix' into 'main'

See merge request ADLR/megatron-lm!1519

core_v0.7.0.beta

Toggle core_v0.7.0.beta's commit message
Merge branch 'rachitg/ag' into 'core_r0.7.0.beta'

allow disabling qkv or fc1 overlap

See merge request ADLR/megatron-lm!1398

core_v0.6.0

Toggle core_v0.6.0's commit message
Merge branch 'fix_overlap_param_gather' into 'main'

fix EP distopt with overlap param gather

See merge request ADLR/megatron-lm!1345

(cherry picked from commit ccfeda4)

ac93d847 fix EP distopt with overlap param gather
bb7b4307 change golden metrics
0ff731ff Minor fix to thrown value error

core_v0.5.0

Toggle core_v0.5.0's commit message
Merge branch 'update_version' into 'core_r0.5.0'

Update 0.5.0 version in package info

See merge request ADLR/megatron-lm!1158

InstructRetro

Toggle InstructRetro's commit message
Update retro doc following the suggestion of Wei and Lawrence

core_v0.4.0

Toggle core_v0.4.0's commit message
Merge branch 'cherry-pick-25b2723a' into 'core_r0.4.0'

Merge branch 'fix_bert' into 'main'

See merge request ADLR/megatron-lm!1006

23.06

Toggle 23.06's commit message
Merge branch 'jbarker/preprocessing_workers' into 'main'

Make --workers required in preprocess_data.py

See merge request ADLR/megatron-lm!647