Skip to content

Commit

Permalink
docs: Update the recent url for Megatron-LM (microsoft#2564)
Browse files Browse the repository at this point in the history
  • Loading branch information
rapsealk authored Dec 2, 2022
1 parent c77d42d commit bbe030c
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/_tutorials/flops-profiler.md
Original file line number Diff line number Diff line change
Expand Up @@ -184,7 +184,7 @@ When using DeepSpeed for model training, the profiler can be configured in the d

#### Example: Megatron-LM

For information on running Megatron-LM with DeepSpeed, please refer to our tutorial [Megatron-LM](https://github.com/microsoft/DeepSpeedExamples/tree/master/Megatron-LM).
For information on running Megatron-LM with DeepSpeed, please refer to our tutorial [Megatron-LM](https://github.com/microsoft/DeepSpeedExamples/tree/master/megatron/Megatron-LM).

An example output of 12-layer Megatron-LM model (`hidden_size = 8192, num_attention_heads = 32, batch_size = 1024, seq_length = 1024`) is shown below.

Expand Down

0 comments on commit bbe030c

Please sign in to comment.