Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Sep 9, 2023

• [Fix] Refactor ZeRO Directory Structure (#211)

  Show description for d7c4e32
  yhna940

  authored
  d7c4e32

  Copy full SHA for d7c4e32

Commits on Aug 14, 2023

• Feature/auto model test (#213)

  Show description for 21ef4a1
  

  koliaok

  and

  hyungrak.kim

  authored
  21ef4a1

  Copy full SHA for 21ef4a1

Commits on Aug 5, 2023

• Give num_concurrent as argument (#212)

  Show description for 4cb1ae0
  jinwonkim93

  authored
  4cb1ae0

  Copy full SHA for 4cb1ae0

Commits on Jul 24, 2023

• [Fix] rpc not working on aws (#209)

  Show description for 00e3be5
  jinwonkim93

  authored
  00e3be5

  Copy full SHA for 00e3be5

Commits on Jul 12, 2023

• [Feature] Enhance Distributed Data Parallel wrapper with ZeRO (#207)

  Show description for f16c73b
  yhna940

  authored
  f16c73b

  Copy full SHA for f16c73b

• [Add] copyright for ZeRO3 (#208)

  Show description for 5e14dd6
  yhna940

  authored
  5e14dd6

  Copy full SHA for 5e14dd6

• [Fix] Change the logger of ZeRO3 (#206)

  Show description for 062f7e6
  yhna940

  authored
  062f7e6

  Copy full SHA for 062f7e6

• [Add] ZeRO3 unit test (#205)

  Show description for 5a10b5d
  yhna940

  authored
  5a10b5d

  Copy full SHA for 5a10b5d

• Ohwi/pp use message queue (#204)

  Show description for 1eb0d6c
  

  ohwi

  and

  jinwonkim93

  authored
  1eb0d6c

  Copy full SHA for 1eb0d6c

Commits on Jun 15, 2023

• BART PreTraining code (#200)

  Show description for 7c69e70
  hmy831004

  authored
  7c69e70

  Copy full SHA for 7c69e70

• Add requirement for lightseq2 (#202)

  Show description for c1cc666
  jinwonkim93

  authored
  c1cc666

  Copy full SHA for c1cc666

• Apply Multi-head Attention Layer of LightSeq2 on BERT (#198)

  Show description for 9877855
  dyanos

  authored
  9877855

  Copy full SHA for 9877855

Commits on Jun 14, 2023

• Add DP on Trainer (#199)

  Show description for 1aba8f4
  tree-park

  authored
  1aba8f4

  Copy full SHA for 1aba8f4

Commits on Jun 8, 2023

• [Enhance] Support ZeRO3 (#185)

  Show description for eec6d65
  

  3 peopleauthored
  eec6d65

  Copy full SHA for eec6d65

Commits on May 25, 2023

• [zero] Suggests a minor change to confusing variable names in the ZeRO optimizer (#183)

  Show description for 4bf13ac
  yhna940

  authored
  4bf13ac

  Copy full SHA for 4bf13ac

• [Add] Distributed Logger Utility for PyTorch (#190)

  Show description for 0d1e0cc
  yhna940

  authored
  0d1e0cc

  Copy full SHA for 0d1e0cc

• Trainer updates additional functions (#188)

  Show description for f228a07
  tree-park

  authored
  f228a07

  Copy full SHA for f228a07

• Task Variable Naming change (#191)

  Show description for c6874a9
  hmy831004

  authored
  c6874a9

  Copy full SHA for c6874a9

Commits on May 13, 2023

• Change save_pretrained and from_parallelized annotation (#182)

  Show description for c9fb34f
  

  koliaok

  and

  hyungrak.kim

  authored
  c9fb34f

  Copy full SHA for c9fb34f

Commits on May 11, 2023

• [MOD] BART TASK Update (#176)

  Show description for 3950407
  hmy831004

  authored
  3950407

  Copy full SHA for 3950407

• adding tutorial docs for DataParallel, ZeroOptimizer (#170)

  Show description for 001ffec
  jinwonkim93

  authored
  001ffec

  Copy full SHA for 001ffec

Commits on Apr 19, 2023

• Revert ViT TP2D logic (#179)

  Show description for 3d33e3e
  KKIEEK

  authored
  3d33e3e

  Copy full SHA for 3d33e3e

Commits on Apr 18, 2023

• [Enhance] Support ViT for TensorParallel (#155)

  Show description for ca97853
  KKIEEK

  authored
  ca97853

  Copy full SHA for ca97853

Commits on Apr 17, 2023

• [Fix] minor bug for single output in _DistributedDataParallel (#177)

  Show description for 0d25e02
  yhna940

  authored
  0d25e02

  Copy full SHA for 0d25e02

Commits on Apr 13, 2023

• [Fix] Support gradient accumulation for DDP (#173)

  Show description for 6492075
  KKIEEK

  authored
  6492075

  Copy full SHA for 6492075

Commits on Apr 5, 2023

• Wrong import in zero (#169)

  Show description for ffb324f
  jinwonkim93

  authored
  ffb324f

  Copy full SHA for ffb324f

Commits on Mar 30, 2023

• Make decoder-only models to be able to generate with inputs_embeds (#172)

  Show description for fc2175f
  ingyuseong

  authored
  fc2175f

  Copy full SHA for fc2175f

• Add restarting model from saved model and fix bug (#171)

  Show description for e17960d
  tree-park

  authored
  e17960d

  Copy full SHA for e17960d

Commits on Mar 28, 2023

• [Fix] zero optimizer w/ tensor parallel test (#167)

  Show description for 3357dac
  yhna940

  authored
  3357dac

  Copy full SHA for 3357dac

• [Fix] zero param check (#164)

  Show description for c103c5b
  yhna940

  authored
  c103c5b

  Copy full SHA for c103c5b

Commits on Mar 24, 2023

• import ParallelMode (#166)

  Show description for 910c789
  bzantium

  authored
  910c789

  Copy full SHA for 910c789

Commits on Mar 21, 2023

• Fix typo from 2p5D to 2P5D in docs (#156)

  Show description for 2f6d2a9
  KKIEEK

  authored
  2f6d2a9

  Copy full SHA for 2f6d2a9

• Add Apache License 2.0 copyright notice to ZeRO (#162)

  Show description for ae73d3e
  yhna940

  authored
  ae73d3e

  Copy full SHA for ae73d3e

Commits on Mar 20, 2023

• Fix Tp param (#159)

  Show description for c32266b
  yhna940

  authored
  c32266b

  Copy full SHA for c32266b

• [Doc] add data parallel and zero (#158)

  Show description for 79250d7
  jinwonkim93

  authored
  79250d7

  Copy full SHA for 79250d7

Pagination

Previous

Next