Megatron-LM/megatron/core at main · hatgit/Megatron-LM · GitHub

Name		Name	Last commit message	Last commit date
parent directory ..
pipeline_parallel		pipeline_parallel
tensor_parallel		tensor_parallel
README.md		README.md
__init__.py		__init__.py
enums.py		enums.py
package_info.py		package_info.py
parallel_state.py		parallel_state.py
requirements.txt		requirements.txt
utils.py		utils.py

README.md

Megatron Core is a library for efficient and scalable training of transformer based models.