Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Mar 9, 2023

• Merge branch 'maanug/gpt-text-gen' into 'main'

  Show description for 636da04
  jaredcasper

  committed
  636da04

  Copy full SHA for 636da04

• Fix GPT text generation

  

  maanug-nv

  authored and

  jaredcasper

  committed
  3c76018

  Copy full SHA for 3c76018

Commits on Feb 22, 2023

• Merge branch 'maanug/readme-pretraining' into 'main'

  Show description for 95f872f
  jaredcasper

  committed
  95f872f

  Copy full SHA for 95f872f

• Pretraining README update

  

  maanug-nv

  authored and

  jaredcasper

  committed
  5ecd52a

  Copy full SHA for 5ecd52a

• Merge branch 'maanug/paper-links' into 'main'

  Show description for f063bbb
  jaredcasper

  committed
  f063bbb

  Copy full SHA for f063bbb

• README: Paper Links

  

  maanug-nv

  authored and

  jaredcasper

  committed
  23a54e0

  Copy full SHA for 23a54e0

• Retro

  

  lmcafee-nvidia

  authored and

  jaredcasper

  committed
  17a6044

  Copy full SHA for 17a6044

Commits on Feb 17, 2023

• Update Distributed Pretraining REAME section

  

  maanug-nv

  authored and

  jaredcasper

  committed
  912ab8a

  Copy full SHA for 912ab8a

Commits on Dec 9, 2022

• Integrate FlashAttention into Megatron-LM

  tridao

  committed
  d693034

  Copy full SHA for d693034

Commits on Nov 24, 2022

• Open sourcing lm detoxification code

  boxin-wbx

  committed
  d48d95a

  Copy full SHA for d48d95a

Commits on Jul 19, 2022

• added title to ZeRO paper.

  

  jaredcasper

  authored and

  lmcafee-nvidia

  committed
  ff8ce3d

  Copy full SHA for ff8ce3d

• fixes.

  lmcafee-nvidia

  committed
  885a042

  Copy full SHA for 885a042

• added dist-op section.

  lmcafee-nvidia

  committed
  69e2514

  Copy full SHA for 69e2514

• added activation checkpointing link.

  lmcafee-nvidia

  committed
  c80b423

  Copy full SHA for c80b423

Commits on Jun 24, 2022

• Merge branch 'main' into checkpoint_util

  jaredcasper

  committed
  80389ef

  Copy full SHA for 80389ef

Commits on May 19, 2022

• More discussion of utilization numbers and data parallelism.

  jaredcasper

  committed
  841f789

  Copy full SHA for 841f789

• Adding papers.

  jaredcasper

  committed
  cc61aa9

  Copy full SHA for cc61aa9

• Update numbers in README

  jaredcasper

  committed
  2e90a34

  Copy full SHA for 2e90a34

• Update readme with sequence parallelism and selective activation recompute.

  jaredcasper

  committed
  b83477a

  Copy full SHA for b83477a

Commits on Feb 18, 2022

• Merge branch 'main' into checkpoint_util

  jaredcasper

  committed
  06fc51c

  Copy full SHA for 06fc51c

Commits on Feb 11, 2022

• Remove specific versions of pytorch, etc. from README so it doesn't go out of date.

  jaredcasper

  committed
  d50e89f

  Copy full SHA for d50e89f

Commits on Jan 28, 2022

• Merge branch 'main' of https://github.com/satpalsr/Megatron-LM into github-pr

  jaredcasper

  committed
  34f5542

  Copy full SHA for 34f5542

• Merge branch 'patch-1' of https://github.com/jamesr66a/Megatron-LM into github-pr

  jaredcasper

  committed
  adebe36

  Copy full SHA for adebe36

• Merge branch 'patch-2' of https://github.com/kvtoraman/Megatron-LM into github-pr

  jaredcasper

  committed
  20f6169

  Copy full SHA for 20f6169

• Merge branch 'patch-1' of https://github.com/rajeshkppt/Megatron-LM into github-pr

  jaredcasper

  committed
  0747e8e

  Copy full SHA for 0747e8e

Commits on Jan 27, 2022

• add clarification about the model parallel size column

  stas00

  authored
  2d767f4

  Copy full SHA for 2d767f4

• [README] specify explicitly which gpu and node size was used

  Show description for 145d2eb
  stas00

  authored
  145d2eb

  Copy full SHA for 145d2eb

Commits on Dec 25, 2021

• Merge branch 'main' into main

  satpalsr

  authored
  a7f882f

  Copy full SHA for a7f882f

Commits on Dec 13, 2021

• Update README.md

  rajeshkppt

  authored
  5352377

  Copy full SHA for 5352377

Commits on Nov 30, 2021

• Mention NeMo Megatron in README

  jaredcasper

  committed
  84529b2

  Copy full SHA for 84529b2

• Update README.md

  Show description for 0fddb8b
  kvtoraman

  authored
  0fddb8b

  Copy full SHA for 0fddb8b

Commits on Nov 2, 2021

• Strike note that PP is not supported for T5 in README.md

  Show description for 98b457b
  

  James Reed

  authored
  98b457b

  Copy full SHA for 98b457b

• Merge branch 'main' into checkpoint_util

  jaredcasper

  committed
  67aa861

  Copy full SHA for 67aa861

Commits on Oct 31, 2021

• Typo corrections in README.md

  satpalsr

  authored
  e64507f

  Copy full SHA for e64507f

Commits on Oct 18, 2021

• Clarify README regarding benchmarks.

  jaredcasper

  committed
  f482bc5

  Copy full SHA for f482bc5

Pagination

Previous

Next