Commits

Branch selector

 main

User selector

lantiga

Datepicker

All time

Commit History

Commits on Apr 27, 2024

• Add Mixtral MoE to README (Lightning-AI#1365)

  lantiga

  authored
  2288336

  Copy full SHA for 2288336

Commits on Apr 16, 2024

• Temporarily skip thunder test due to timeout (Lightning-AI#1304)

  lantiga

  authored
  02b04ba

  Copy full SHA for 02b04ba

Commits on Jan 5, 2024

• Add License at the top of individual files (Lightning-AI#860)

  lantiga

  authored
  ad65549

  Copy full SHA for ad65549

Commits on Nov 27, 2023

• Add max_seq_length to optionally allow truncating inputs (Lightning-AI#775)

  lantiga

  authored
  e05fc4a

  Copy full SHA for e05fc4a

Commits on Jul 11, 2023

• Update callback

  lantiga

  committed
  f791eba

  Copy full SHA for f791eba

Commits on Jun 22, 2023

• Rename from parrot to gpt (Lightning-AI#190)

  Show description for 69b65ac
  

  lantiga

  and

  carmocca

  authored
  69b65ac

  Copy full SHA for 69b65ac

Commits on May 16, 2023

• Set dtype of kv_caches correctly (Lightning-AI#64)

  lantiga

  authored
  e09ad1d

  Copy full SHA for e09ad1d

• Port packed_dataset hotfix from lit-llama (Lightning-AI#63)

  lantiga

  authored
  57760db

  Copy full SHA for 57760db

Commits on May 10, 2023

• Fix training argument (Lightning-AI#49)

  lantiga

  authored
  ef1ef10

  Copy full SHA for ef1ef10

Commits on May 9, 2023

• Parrot rename (Lightning-AI#38)

  Show description for 0dfae2a
  

  lantiga

  and

  carmocca

  authored
  0dfae2a

  Copy full SHA for 0dfae2a

• Port pre-training scripts (Lightning-AI#35)

  lantiga

  authored
  253a750

  Copy full SHA for 253a750

Commits on May 8, 2023

• Updated README and cleaned up howto (Lightning-AI#36)

  Show description for e5d3cf1
  

  lantiga

  and

  carmocca

  authored
  e5d3cf1

  Copy full SHA for e5d3cf1

Commits on May 6, 2023

• Add mascots to README (Lightning-AI#27)

  lantiga

  authored
  55e2eef

  Copy full SHA for 55e2eef

Commits on May 5, 2023

• Add gif animation (Lightning-AI#17)

  lantiga

  authored
  2025d24

  Copy full SHA for 2025d24

• Add README (Lightning-AI#4)

  Show description for d10ff21
  

  lantiga

  and

  carmocca

  authored
  d10ff21

  Copy full SHA for d10ff21

Commits on May 3, 2023

• Add option to wrap dataset around (Lightning-AI#219)

  lantiga

  authored
  7e95724

  Copy full SHA for 7e95724

• Add tokens/sec/device and new Fabric initialization (Lightning-AI#217)

  lantiga

  authored
  d598aa2

  Copy full SHA for d598aa2

Commits on May 2, 2023

• Pre-training script (Lightning-AI#209)

  Show description for 366bca6
  

  lantiga

  and

  awaelchli

  authored
  366bca6

  Copy full SHA for 366bca6

Commits on Apr 27, 2023

• Make Red Pajama prepare scripts use PackedDataset (Lightning-AI#199)

  lantiga

  authored
  58b6b36

  Copy full SHA for 58b6b36

Commits on Apr 26, 2023

• Add packed dataset (Lightning-AI#192)

  lantiga

  authored
  d3c0075

  Copy full SHA for d3c0075

Commits on Apr 21, 2023

• Add test_prepare_redpajama (Lightning-AI#184)

  lantiga

  authored
  2798552

  Copy full SHA for 2798552

Commits on Apr 20, 2023

• Update README.md

  lantiga

  authored
  32b5ae9

  Copy full SHA for 32b5ae9

Commits on Apr 19, 2023

• Add Red Pajama conversion script for sample and full dataset (Lightning-AI#157)

  lantiga

  authored
  c232f7a

  Copy full SHA for c232f7a

Commits on Apr 17, 2023

• Add generation script for LoRA (Lightning-AI#145)

  Show description for 89f285e
  

  lantiga

  and

  awaelchli

  authored
  89f285e

  Copy full SHA for 89f285e

Commits on Apr 16, 2023

• Batch hf conversion to save ram (Lightning-AI#122)

  Show description for 15d5eee
  

  lantiga

  and

  factoidforrest

  authored
  15d5eee

  Copy full SHA for 15d5eee

• Standardize checkpoint filename and extension (Lightning-AI#142)

  lantiga

  authored
  528fa0d

  Copy full SHA for 528fa0d

Commits on Apr 12, 2023

• Skip eos for inference (Lightning-AI#126)

  lantiga

  authored
  094fa95

  Copy full SHA for 094fa95

Commits on Apr 11, 2023

• Raise exception if checkpoints are not found (Lightning-AI#118)

  lantiga

  authored
  5d98989

  Copy full SHA for 5d98989

• Enable specifying precision during conversion (Lightning-AI#111)

  lantiga

  authored
  bae421f

  Copy full SHA for bae421f

Commits on Apr 7, 2023

• Use flash attention in adapters by moving gating factor out of matmul (Lightning-AI#112)

  lantiga

  authored
  98d7115

  Copy full SHA for 98d7115

Commits on Apr 6, 2023

• Add datasets to requirements.txt

  lantiga

  committed
  c486ab2

  Copy full SHA for c486ab2

• Fix running scripts without installing package (Lightning-AI#105)

  lantiga

  authored
  14dfcd9

  Copy full SHA for 14dfcd9

Commits on Apr 5, 2023

• Fix conversion for sharded models (Lightning-AI#97)

  lantiga

  authored
  ca7efd8

  Copy full SHA for ca7efd8

• Make model readable top to bottom (Lightning-AI#99)

  lantiga

  authored
  75d20f5

  Copy full SHA for 75d20f5

• Update README.md

  lantiga

  authored
  dda6f80

  Copy full SHA for dda6f80

Pagination

Previous

Next