Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Apr 22, 2024

• Remove stale visualization files (#1076)

  Show description for 73d7f48
  kwen2501

  authored
  73d7f48

• Move LoadModule and SaveModule (#1073)

  Show description for 757c286
  kwen2501

  authored
  757c286

Commits on Apr 19, 2024

• Use relative import to simplify migration (#1072)

  Show description for b9a8c85
  kwen2501

  authored
  b9a8c85

• Adjust logging level (#1071)

  Show description for 1a73f6c
  kwen2501

  authored
  1a73f6c

• Zero grad of input buffers (#1070)

  Show description for 9c3bec7
  kwen2501

  authored
  9c3bec7

Commits on Apr 18, 2024

• Add gradient equivalence test (#1066)

  Show description for 485f196
  kwen2501

  authored
  485f196

• Add support for FSDP + interleaved 1f1b

  Show description for eccb9f7
  wconstab

  committed
  eccb9f7

• Add support for FSDP + looped bfs

  Show description for 59a3fc6
  wconstab

  committed
  59a3fc6

• Add support for 1F1B + FSDP

  Show description for 289db25
  wconstab

  committed
  289db25

Commits on Apr 17, 2024

• Add FSDP support for GPipe schedule

  Show description for d024c11
  wconstab

  committed
  d024c11

Commits on Apr 16, 2024

• Interleaved 1f1b supports loss

  Show description for 6c78d48
  H-Huang

  committed
  6c78d48

• Refactor loss logic in schedules

  Show description for 00f830c
  H-Huang

  committed
  00f830c

• add loss to looped_bfs

  Show description for 2407568
  H-Huang

  committed
  2407568

• Pipeline stages share fwd/bwd send/recv ops

  Show description for 73d5c0f
  H-Huang

  committed
  73d5c0f

• Use stage index in PipelineStage's log prefix (#1049)

  Show description for 95a1a67
  kwen2501

  authored
  95a1a67

Commits on Apr 13, 2024

• Fix #1053: wait for comm ops in Interleaved 1F1B

  Show description for 7af23b0
  kwen2501

  committed
  7af23b0

Commits on Apr 12, 2024

• Fix backward microbatch index in 1F1B

  Show description for 8cbcadc
  kwen2501

  committed
  8cbcadc

• Support loss computation in Interleaved 1F1B

  Show description for cad6863
  kwen2501

  committed
  cad6863

• Add base class for multi-stage schedules

  Show description for 975c4c0
  kwen2501

  committed
  975c4c0

• Consolidate step() function

  Show description for cbfe468
  kwen2501

  committed
  cbfe468

• Move GPipe and 1F1B to PipelineScheduleSingle (#1046) (#1057)

  Show description for 0831d72
  kwen2501

  authored
  0831d72

Commits on Apr 10, 2024

• Fix loss calculation in bwd test (#1044)

  Show description for 9cd29d1
  kwen2501

  authored
  9cd29d1

• Move split_inputs and merge_outputs to schedule

  Show description for 4e070c2
  kwen2501

  committed
  4e070c2

• rename schedules

  Show description for 4cf876a
  H-Huang

  committed
  4cf876a

Commits on Apr 9, 2024

• [Re-merge] Use context manager to replace spec arguments of pipeline API (#1035) (#1042)

  Show description for 54f3bab
  kwen2501

  authored
  54f3bab

• fix some small TODOs in pipeline stage (#1040)

  Show description for 311981a
  H-Huang

  authored
  311981a

• Use PiPPy to distribute Mixture of Experts (#1038)

  Show description for 2a09329
  kwen2501

  authored
  2a09329

• Add a print_readable method (#1037)

  Show description for 986eb0f
  kwen2501

  authored
  986eb0f

Commits on Apr 8, 2024

• PP with modified DDP example (#1021)

  Show description for ae964e8
  H-Huang

  authored
  ae964e8

• Unify pipeline stages fwd and bwd, add pipeline stage tests (#1024)

  Show description for 44f949e
  H-Huang

  authored
  44f949e

Commits on Apr 5, 2024

• Remove no-backward warning (#1036)

  Show description for 5d3f183
  kwen2501

  authored
  5d3f183

Commits on Apr 4, 2024

• Bring back stage_backward helper (#1032)

  Show description for adba5c1
  kwen2501

  authored
  adba5c1

• Add stage constructor for stage module

  Show description for c8c3e56
  kwen2501

  committed
  c8c3e56

• Remove qualname remap support

  Show description for 0d053e8
  kwen2501

  committed
  0d053e8

Commits on Apr 3, 2024

• Fix sending values that don't require_grad

  Show description for 7d38c56
  wconstab

  committed
  7d38c56

Pagination

PreviousNext