Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Oct 23, 2024

• Add token counts to compute performance (Lightning-AI#1801)

  rasbt

  authored
  d741d26

  Copy full SHA for d741d26

• Add Phi 3 128k model (Lightning-AI#1800)

  deveworld

  authored
  7822701

  Copy full SHA for 7822701

• Post-release setup for 0.5.3.dev1 (Lightning-AI#1799)

  rasbt

  authored
  e6a9d73

  Copy full SHA for e6a9d73

Commits on Oct 22, 2024

• 0.5.2 release (Lightning-AI#1798)

  rasbt

  authored
  721b6e3

  Copy full SHA for 721b6e3

Commits on Oct 21, 2024

• Housekeeping: remove unused code and fix tests (Lightning-AI#1795)

  rasbt

  authored
  fe394c4

  Copy full SHA for fe394c4

• Fix step iteration bug in finetuning scripts (Lightning-AI#1794)

  rasbt

  authored
  e14e39f

  Copy full SHA for e14e39f

• Pin to PyTorch 2.4.1 (Lightning-AI#1796)

  rasbt

  authored
  3ea3d93

  Copy full SHA for 3ea3d93

Commits on Oct 11, 2024

• Fix prompt style usage in evaluation example (Lightning-AI#1790)

  rasbt

  authored
  5a771c7

  Copy full SHA for 5a771c7

Commits on Oct 10, 2024

• Post 0.5.1 release setup (Lightning-AI#1789)

  rasbt

  authored
  a66dcc9

  Copy full SHA for a66dcc9

• Bump version for 0.5.1 bugfix release (Lightning-AI#1787)

  rasbt

  authored
  fd0a3fa

  Copy full SHA for fd0a3fa

• Tidy up RoPE (Lightning-AI#1786)

  rasbt

  authored
  6bcee99

  Copy full SHA for 6bcee99

• AMD (MI250X) support (Lightning-AI#1775)

  TensorTemplar

  authored
  46c4337

  Copy full SHA for 46c4337

Commits on Oct 9, 2024

• Use more realistic RoPE tests (Lightning-AI#1785)

  rasbt

  authored
  ad57435

  Copy full SHA for ad57435

Commits on Oct 8, 2024

• Fixing Llama 3.1 and 3.2 Maximum Context Length (Lightning-AI#1782)

  rasbt

  authored
  467fb87

  Copy full SHA for 467fb87

Commits on Oct 7, 2024

• Use correct Llama 3.1 and 3.2 context lengths (Lightning-AI#1779)

  rasbt

  authored
  f0a6e9d

  Copy full SHA for f0a6e9d

• Be more specific about missign RoPE parameters (Lightning-AI#1781)

  rasbt

  authored
  3f4992a

  Copy full SHA for 3f4992a

Commits on Oct 4, 2024

• v0.5.0 post release setup (Lightning-AI#1774)

  rasbt

  authored
  1809a39

  Copy full SHA for 1809a39

• Fix Llama 3.2 tokenizer (Lightning-AI#1772)

  rasbt

  authored
  4e5b81b

  Copy full SHA for 4e5b81b

• [fix][1760] Added fix for the missing context key issue in dolly! (Lightning-AI#1766)

  Show description for c16c72c
  

  pytholic

  and

  rasbt

  authored
  c16c72c

  Copy full SHA for c16c72c

• Add bnb.nn.StableEmbedding for quantized training (Lightning-AI#1770)

  rasbt

  authored
  ae798ab

  Copy full SHA for ae798ab

• Improve rope (Lightning-AI#1745)

  rasbt

  authored
  c03f3f0

  Copy full SHA for c03f3f0

Commits on Oct 2, 2024

• Bump lightning version to latest stable release (2.4.0) (Lightning-AI#1765)

  rasbt

  authored
  a8aa4ba

  Copy full SHA for a8aa4ba

Commits on Sep 27, 2024

• Add missing explanation on how to use a finetuned model (Lightning-AI#1756)

  rasbt

  authored
  e7e8f7c

  Copy full SHA for e7e8f7c

• Post 0.4.13 release set up (Lightning-AI#1755)

  rasbt

  authored
  b8a721b

  Copy full SHA for b8a721b

• Temporarily take out thunder dependency for deployment (Lightning-AI#1754)

  rasbt

  authored
  0fb5847

  Copy full SHA for 0fb5847

• Bump version to 0.4.13 for new release (Lightning-AI#1753)

  rasbt

  authored
  11ac040

  Copy full SHA for 11ac040

• Llama 3.2 weights (Lightning-AI#1750)

  rasbt

  authored
  00af8b0

  Copy full SHA for 00af8b0

Commits on Sep 26, 2024

• Repair json files (Lightning-AI#1752)

  rasbt

  authored
  bd48f36

  Copy full SHA for bd48f36

• Increase rtol and atol in Gemma 2 for macOS (Lightning-AI#1751)

  rasbt

  authored
  fe49d3d

  Copy full SHA for fe49d3d

• Support for optimizers which don't have "fused" parameter such as grokadamw and 8bit bnb (Lightning-AI#1744)

  Show description for b4b8dfc
  

  mtasic85

  and

  rasbt

  authored
  b4b8dfc

  Copy full SHA for b4b8dfc

• Make json parsing more robust (Lightning-AI#1749)

  rasbt

  authored
  87d694d

  Copy full SHA for 87d694d

• Update RoPE tests (Lightning-AI#1746)

  rasbt

  authored
  d36d9ec

  Copy full SHA for d36d9ec

• Fix jsonarparse version (Lightning-AI#1748)

  rasbt

  authored
  60ec41a

  Copy full SHA for 60ec41a

Commits on Sep 25, 2024

• Extend context length for sliding window tests (Lightning-AI#1742)

  rasbt

  authored
  f9aed64

  Copy full SHA for f9aed64

Commits on Sep 24, 2024

• Add sliding window attention to Mistral and Phi 3 (Lightning-AI#1741)

  rasbt

  authored
  be8b28d

  Copy full SHA for be8b28d

Pagination

Previous

Next