Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Sep 7, 2023

• Document, clean, and refactor megatron/data for GPT

  

  John Kamalu

  authored and

  jaredcasper

  committed
  34ac1ad

  Copy full SHA for 34ac1ad

Commits on Mar 23, 2023

• Move pipeline parallel functionality into core with associated changes.

  jaredcasper

  committed
  3c92fa9

  Copy full SHA for 3c92fa9

Commits on Sep 24, 2022

• Alias core.parallel_state as mpu and use it throughout code. RIP mpu.

  jaredcasper

  committed
  5942af9

  Copy full SHA for 5942af9

Commits on Sep 23, 2022

• Clean up licensing.

  Show description for fabad46
  jaredcasper

  committed
  fabad46

  Copy full SHA for fabad46

Commits on Aug 10, 2022

• Timing levels

  

  shoeybi

  authored and

  jaredcasper

  committed
  77efccc

  Copy full SHA for 77efccc

Commits on Jul 30, 2021

• Support for pipeline parallelism in T5 model

  Show description for 46c74b4
  deepakn94

  committed
  46c74b4

  Copy full SHA for 46c74b4

Commits on May 19, 2021

• Fixed issues with ICT pretraining

  mpatwary

  committed
  7577931

  Copy full SHA for 7577931

• renaming the folders

  mpatwary

  committed
  8e44d61

  Copy full SHA for 8e44d61

Commits on May 18, 2021

• cleaning the code

  mpatwary

  committed
  2eaf6c7

  Copy full SHA for 2eaf6c7

Commits on May 12, 2021

• fixing model evaluation of retriver

  

  Mostofa Patwary

  committed
  f926720

  Copy full SHA for f926720

• DPR finetune and evaluation

  

  Mostofa Patwary

  committed
  6d03d7a

  Copy full SHA for 6d03d7a

Commits on Apr 16, 2021

• Integrate code from t5_main into existing code.

  jaredcasper

  committed
  48a5e0d

  Copy full SHA for 48a5e0d

Commits on Feb 15, 2021

• addressed the comments given by Mohammad

  mpatwary

  committed
  447c117

  Copy full SHA for 447c117

Commits on Feb 4, 2021

• updaded examples/pretrain_ict.sh

  mpatwary

  committed
  f7d96a6

  Copy full SHA for f7d96a6

• remove the function get_one_epoch_dataloader and also added assert

  mpatwary

  committed
  8eff2a9

  Copy full SHA for 8eff2a9

Commits on Feb 3, 2021

• fixed alignment

  mpatwary

  committed
  097fa65

  Copy full SHA for 097fa65

• fixed alignment

  mpatwary

  committed
  a96ad63

  Copy full SHA for a96ad63

• Merging megatron with ICT

  mpatwary

  committed
  651cc10

  Copy full SHA for 651cc10

Commits on Feb 1, 2021

• cleared the commented codes

  mpatwary

  committed
  e919dd8

  Copy full SHA for e919dd8

• fixed isse from Initializing ICT from pretrained BERT model

  mpatwary

  committed
  bfc20ec

  Copy full SHA for bfc20ec

Commits on Jan 29, 2021

• WIP: main_retriver_merge

  mpatwary

  committed
  17d897e

  Copy full SHA for 17d897e

Commits on Dec 19, 2020

• Fix TensorBoard writes

  

  shoeybi

  authored and

  deepakn94

  committed
  b81cad6

  Copy full SHA for b81cad6

• Rename --batch-size to --micro-batch-size and drop in-minibatch from --num-micro-batches-in-minibatch

  

  shoeybi

  authored and

  deepakn94

  committed
  9019bbf

  Copy full SHA for 9019bbf

Commits on Nov 12, 2020

• Clarifications in comments and minor refactoring to make main training loop more readable

  deepakn94

  committed
  8fb2bc8

  Copy full SHA for 8fb2bc8

• Intra-layer MP -> Tensor MP, Inter-layer MP -> Pipeline MP

  deepakn94

  committed
  52a5f2f

  Copy full SHA for 52a5f2f

• Pipeline parallelism implementation with periodic full-pipeline syncs

  Show description for 7abd3e9
  deepakn94

  committed
  7abd3e9

  Copy full SHA for 7abd3e9

Commits on Jul 30, 2020

• Remove spurious imports

  kantneel

  committed
  33a666d

  Copy full SHA for 33a666d

Commits on Jul 23, 2020

• Address comments from last week

  kantneel

  committed
  11f76cd

  Copy full SHA for 11f76cd

Commits on Jul 14, 2020

• Merge ict-merge into indexer-merge

  kantneel

  committed
  ca0cdfa

  Copy full SHA for ca0cdfa

• Use the new allgather implementation

  kantneel

  committed
  628bf0d

  Copy full SHA for 628bf0d

Commits on Jul 10, 2020

• added allgather and allreduce

  shoeybi

  committed
  98feae4

  Copy full SHA for 98feae4

Commits on Jul 7, 2020

• Made topk accuracy reporting optional

  kantneel

  committed
  de6640b

  Copy full SHA for de6640b

• Addressed Jared's comments

  kantneel

  committed
  8d7f508

  Copy full SHA for 8d7f508

Loading