Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Aug 8, 2024

• ADLR/megatron-lm!1797 - Add option to renormalize blend weights

  

  John Kamalu

  authored and

  ericharper

  committed
  bf3e0b9

  Copy full SHA for bf3e0b9

Commits on May 25, 2024

• Change default to use mcore models, not legacy.

  jaredcasper

  committed
  9ad1a56

  Copy full SHA for 9ad1a56

Commits on May 2, 2024

• [MLPerf] GPT dataset features: drop last partial validation sequence, drop extra token, return sample with 1s loss mask, mock dataset testing

  

  BoxiangW

  authored and

  ericharper

  committed
  c90aa16

  Copy full SHA for c90aa16

Commits on Apr 17, 2024

• Support missing size and missing weights in dataset creation and blending

  

  John Kamalu

  authored and

  ericharper

  committed
  dc52e84

  Copy full SHA for dc52e84

Commits on Apr 11, 2024

• Remove vocab_size in pretrain_retro.py.

  

  lmcafee-nvidia

  authored and

  jaredcasper

  committed
  56c3c8b

  Copy full SHA for 56c3c8b

Commits on Mar 26, 2024

• Merge branch 'jcasper/refactor' into 'main'

  Show description for da0afe0
  jaredcasper

  committed
  da0afe0

  Copy full SHA for da0afe0

• Refactor everything outside of core to be out of the main megatron. namespace.

  jaredcasper

  committed
  38644dd

  Copy full SHA for 38644dd

• move is_built_on_rank from config to builder

  

  John Kamalu

  authored and

  ericharper

  committed
  9475bab

  Copy full SHA for 9475bab

Commits on Mar 22, 2024

• Retro M-core Data

  

  lmcafee-nvidia

  authored and

  shanmugamr1992

  committed
  e89cce4

  Copy full SHA for e89cce4

Commits on Nov 22, 2023

• good, except nprocs=8 oom.

  lmcafee-nvidia

  committed
  6ab1688

  Copy full SHA for 6ab1688

• clean up.

  lmcafee-nvidia

  committed
  cdb600d

  Copy full SHA for cdb600d

• gpt running via pretrain_retro.py.

  lmcafee-nvidia

  committed
  6293949

  Copy full SHA for 6293949

Commits on Nov 16, 2023

• Retro for Megatron Core

  

  lmcafee-nvidia

  authored and

  jaredcasper

  committed
  67a0e5d

  Copy full SHA for 67a0e5d

Commits on Oct 26, 2023

• Refactor dataset code and move to core

  

  John Kamalu

  authored and

  jaredcasper

  committed
  a0e190c

  Copy full SHA for a0e190c

Commits on May 26, 2023

• Retro updates.

  

  lmcafee-nvidia

  authored and

  jaredcasper

  committed
  6dba84b

  Copy full SHA for 6dba84b

Commits on Mar 23, 2023

• Move pipeline parallel functionality into core with associated changes.

  jaredcasper

  committed
  3c92fa9

  Copy full SHA for 3c92fa9

Commits on Feb 22, 2023

• Retro

  

  lmcafee-nvidia

  authored and

  jaredcasper

  committed
  17a6044

  Copy full SHA for 17a6044

Loading