Commits

Branch selector

 main

User selector

lantiga

Datepicker

All time

Commit History

Commits on May 16, 2023

• Set dtype of kv_caches correctly (Lightning-AI#64)

  lantiga

  authored
  e09ad1d

  Copy full SHA for e09ad1d

• Port packed_dataset hotfix from lit-llama (Lightning-AI#63)

  lantiga

  authored
  57760db

  Copy full SHA for 57760db

Commits on May 10, 2023

• Fix training argument (Lightning-AI#49)

  lantiga

  authored
  ef1ef10

  Copy full SHA for ef1ef10

Commits on May 9, 2023

• Parrot rename (Lightning-AI#38)

  Show description for 0dfae2a
  

  lantiga

  and

  carmocca

  authored
  0dfae2a

  Copy full SHA for 0dfae2a

• Port pre-training scripts (Lightning-AI#35)

  lantiga

  authored
  253a750

  Copy full SHA for 253a750

Commits on May 8, 2023

• Updated README and cleaned up howto (Lightning-AI#36)

  Show description for e5d3cf1
  

  lantiga

  and

  carmocca

  authored
  e5d3cf1

  Copy full SHA for e5d3cf1

Commits on May 6, 2023

• Add mascots to README (Lightning-AI#27)

  lantiga

  authored
  55e2eef

  Copy full SHA for 55e2eef

Commits on May 5, 2023

• Add gif animation (Lightning-AI#17)

  lantiga

  authored
  2025d24

  Copy full SHA for 2025d24

• Add README (Lightning-AI#4)

  Show description for d10ff21
  

  lantiga

  and

  carmocca

  authored
  d10ff21

  Copy full SHA for d10ff21

Commits on May 3, 2023

• Add option to wrap dataset around (Lightning-AI#219)

  lantiga

  authored
  7e95724

  Copy full SHA for 7e95724

• Add tokens/sec/device and new Fabric initialization (Lightning-AI#217)

  lantiga

  authored
  d598aa2

  Copy full SHA for d598aa2

Commits on May 2, 2023

• Pre-training script (Lightning-AI#209)

  Show description for 366bca6
  

  lantiga

  and

  awaelchli

  authored
  366bca6

  Copy full SHA for 366bca6

Commits on Apr 27, 2023

• Make Red Pajama prepare scripts use PackedDataset (Lightning-AI#199)

  lantiga

  authored
  58b6b36

  Copy full SHA for 58b6b36

Commits on Apr 26, 2023

• Add packed dataset (Lightning-AI#192)

  lantiga

  authored
  d3c0075

  Copy full SHA for d3c0075

Commits on Apr 21, 2023

• Add test_prepare_redpajama (Lightning-AI#184)

  lantiga

  authored
  2798552

  Copy full SHA for 2798552

Commits on Apr 20, 2023

• Update README.md

  lantiga

  authored
  32b5ae9

  Copy full SHA for 32b5ae9

Commits on Apr 19, 2023

• Add Red Pajama conversion script for sample and full dataset (Lightning-AI#157)

  lantiga

  authored
  c232f7a

  Copy full SHA for c232f7a

Commits on Apr 17, 2023

• Add generation script for LoRA (Lightning-AI#145)

  Show description for 89f285e
  

  lantiga

  and

  awaelchli

  authored
  89f285e

  Copy full SHA for 89f285e

Commits on Apr 16, 2023

• Batch hf conversion to save ram (Lightning-AI#122)

  Show description for 15d5eee
  

  lantiga

  and

  factoidforrest

  authored
  15d5eee

  Copy full SHA for 15d5eee

• Standardize checkpoint filename and extension (Lightning-AI#142)

  lantiga

  authored
  528fa0d

  Copy full SHA for 528fa0d

Commits on Apr 12, 2023

• Skip eos for inference (Lightning-AI#126)

  lantiga

  authored
  094fa95

  Copy full SHA for 094fa95

Commits on Apr 11, 2023

• Raise exception if checkpoints are not found (Lightning-AI#118)

  lantiga

  authored
  5d98989

  Copy full SHA for 5d98989

• Enable specifying precision during conversion (Lightning-AI#111)

  lantiga

  authored
  bae421f

  Copy full SHA for bae421f

Commits on Apr 7, 2023

• Use flash attention in adapters by moving gating factor out of matmul (Lightning-AI#112)

  lantiga

  authored
  98d7115

  Copy full SHA for 98d7115

Commits on Apr 6, 2023

• Add datasets to requirements.txt

  lantiga

  committed
  c486ab2

  Copy full SHA for c486ab2

• Fix running scripts without installing package (Lightning-AI#105)

  lantiga

  authored
  14dfcd9

  Copy full SHA for 14dfcd9

Commits on Apr 5, 2023

• Fix conversion for sharded models (Lightning-AI#97)

  lantiga

  authored
  ca7efd8

  Copy full SHA for ca7efd8

• Make model readable top to bottom (Lightning-AI#99)

  lantiga

  authored
  75d20f5

  Copy full SHA for 75d20f5

• Update README.md

  lantiga

  authored
  dda6f80

  Copy full SHA for dda6f80

Commits on Apr 4, 2023

• Add conversion script for HF checkpoints (Lightning-AI#90)

  lantiga

  authored
  0c3851c

  Copy full SHA for 0c3851c

Commits on Apr 2, 2023

• Update README.md

  lantiga

  authored
  531867f

  Copy full SHA for 531867f

Commits on Mar 31, 2023

• Add vocab_size to Tokenizer.train (Lightning-AI#69)

  lantiga

  authored
  f7aa8b9

  Copy full SHA for f7aa8b9

Commits on Mar 29, 2023

• Update README.md

  lantiga

  authored
  330de5a

  Copy full SHA for 330de5a

• Add LoRA (Lightning-AI#44)

  Show description for a65d9c4
  

  3 peopleauthored
  a65d9c4

  Copy full SHA for a65d9c4

• Update README.md (Lightning-AI#53)

  lantiga

  authored
  b822e1e

  Copy full SHA for b822e1e

Pagination

Previous

Next