Commits

Branch selector

 main

User selector

lmcafee-nvidia

Datepicker

All time

Commit History

Commits on Aug 13, 2024

• ADLR/megatron-lm!1742 - Reduce fragmentation when loading dist-opt + dist-ckpt.

  

  lmcafee-nvidia

  authored and

  ericharper

  committed
  ad729e8

  Copy full SHA for ad729e8

Commits on Aug 9, 2024

• ADLR/megatron-lm!1883 - Checkpoint model converter: Update --ckpt-format.

  

  lmcafee-nvidia

  authored and

  jaredcasper

  committed
  dad054f

  Copy full SHA for dad054f

Commits on Aug 2, 2024

• ADLR/megatron-lm!1727 - Checkpoint format converter

  

  lmcafee-nvidia

  authored and

  jaredcasper

  committed
  2fe2036

  Copy full SHA for 2fe2036

Commits on Jul 30, 2024

• Merge branch 'lmcafee/remove-te-apex-deps' into 'main'

  Show description for 03306e6
  lmcafee-nvidia

  committed
  03306e6

  Copy full SHA for 03306e6

• ADLR/megatron-lm!1751 - Distributed optimizer support for TE/Apex-independent training.

  lmcafee-nvidia

  committed
  de16089

  Copy full SHA for de16089

Commits on May 24, 2024

• updated help string.

  lmcafee-nvidia

  committed
  f993b31

  Copy full SHA for f993b31

Commits on May 16, 2024

• fixed package_info.py.

  lmcafee-nvidia

  committed
  ae83170

  Copy full SHA for ae83170

• Merge remote-tracking branch 'origin/main' into lmcafee/retro-mcore-0.7

  lmcafee-nvidia

  committed
  4fd2624

  Copy full SHA for 4fd2624

• clean up.

  lmcafee-nvidia

  committed
  ee1d34a

  Copy full SHA for ee1d34a

• checking if weights is none.

  lmcafee-nvidia

  committed
  529c5c9

  Copy full SHA for 529c5c9

Commits on May 15, 2024

• debugged dataset type discrepency.

  lmcafee-nvidia

  committed
  80bc60c

  Copy full SHA for 80bc60c

Commits on May 14, 2024

• some updates.

  lmcafee-nvidia

  committed
  7aa9295

  Copy full SHA for 7aa9295

Commits on Apr 11, 2024

• Remove vocab_size in pretrain_retro.py.

  

  lmcafee-nvidia

  authored and

  jaredcasper

  committed
  56c3c8b

  Copy full SHA for 56c3c8b

Commits on Apr 4, 2024

• MCore Bert checkpoint converter.

  

  lmcafee-nvidia

  authored and

  jaredcasper

  committed
  46ac6a4

  Copy full SHA for 46ac6a4

Commits on Apr 3, 2024

• add missing __init__.py.

  lmcafee-nvidia

  committed
  76391ef

  Copy full SHA for 76391ef

Commits on Mar 27, 2024

• Retro example script update.

  

  lmcafee-nvidia

  authored and

  jaredcasper

  committed
  baf9e53

  Copy full SHA for baf9e53

• updated checkpoint converter imports.

  lmcafee-nvidia

  committed
  9a0e41a

  Copy full SHA for 9a0e41a

Commits on Mar 22, 2024

• Retro M-core Data

  

  lmcafee-nvidia

  authored and

  shanmugamr1992

  committed
  e89cce4

  Copy full SHA for e89cce4

Commits on Mar 20, 2024

• M-core checkpoint converter

  

  lmcafee-nvidia

  authored and

  jaredcasper

  committed
  d8e2a19

  Copy full SHA for d8e2a19

Commits on Feb 13, 2024

• Condition TE init_method on config.perform_initialization.

  

  lmcafee-nvidia

  authored and

  jaredcasper

  committed
  9e17a15

  Copy full SHA for 9e17a15

Commits on Nov 30, 2023

• renamed RetroCustomGPTDataset -> MultiSplitGPTDataset.

  lmcafee-nvidia

  committed
  f7a3b90

  Copy full SHA for f7a3b90

• removed scripts.

  lmcafee-nvidia

  committed
  ec0ef71

  Copy full SHA for ec0ef71

• no more verifying data prefix order.

  lmcafee-nvidia

  committed
  c36263e

  Copy full SHA for c36263e

• move retro's custom gpt dataset.

  lmcafee-nvidia

  committed
  22f4e6a

  Copy full SHA for 22f4e6a

• small clean up.

  lmcafee-nvidia

  committed
  544ec55

  Copy full SHA for 544ec55

• Merge branch 'main' into lmcafee/instructretro

  lmcafee-nvidia

  committed
  0802a4b

  Copy full SHA for 0802a4b

Commits on Nov 22, 2023

• renamed blend script.

  lmcafee-nvidia

  committed
  f0c85fb

  Copy full SHA for f0c85fb

• added blend script.

  lmcafee-nvidia

  committed
  0bf7350

  Copy full SHA for 0bf7350

• good, except nprocs=8 oom.

  lmcafee-nvidia

  committed
  6ab1688

  Copy full SHA for 6ab1688

• clean up.

  lmcafee-nvidia

  committed
  cdb600d

  Copy full SHA for cdb600d

• gpt running via pretrain_retro.py.

  lmcafee-nvidia

  committed
  6293949

  Copy full SHA for 6293949

• Merge branch 'main' into lmcafee/instructretro-test

  lmcafee-nvidia

  committed
  5b15e1c

  Copy full SHA for 5b15e1c

Commits on Nov 16, 2023

• Retro for Megatron Core

  

  lmcafee-nvidia

  authored and

  jaredcasper

  committed
  67a0e5d

  Copy full SHA for 67a0e5d

• Llama-2: remove references to apply_query_key_layer_scaling.

  

  lmcafee-nvidia

  authored and

  jaredcasper

  committed
  c268f45

  Copy full SHA for c268f45

• Add Llama-2 tokenizer option to preprocess_data.py.

  

  lmcafee-nvidia

  authored and

  jaredcasper

  committed
  bef9dbb

  Copy full SHA for bef9dbb

Pagination

Previous

Next