Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Aug 1, 2024

• Adds unit test to test for parity between streaming and non-streaming API (Lightning-AI#1650)

  rasbt

  authored
  8005f60

  Copy full SHA for 8005f60

• Bump for 0.4.7 release (Lightning-AI#1649)

  rasbt

  authored
  4571b2f

  Copy full SHA for 4571b2f

Commits on Jul 31, 2024

• Add quantization support to litgpt serve (Lightning-AI#1646)

  rasbt

  authored
  dc30eb9

  Copy full SHA for dc30eb9

• Fix error raising where max_returned_tokens > max_seq_length_setting (Lightning-AI#1648)

  rasbt

  authored
  e79dc55

  Copy full SHA for e79dc55

• Properly clear kv-cache (Lightning-AI#1647)

  rasbt

  authored
  4030c66

  Copy full SHA for 4030c66

Commits on Jul 30, 2024

• Fix autodownload + conversion issue (Lightning-AI#1645)

  rasbt

  authored
  77aaf7f

  Copy full SHA for 77aaf7f

• Use Python API in serve code (Lightning-AI#1644)

  rasbt

  authored
  f0f3be6

  Copy full SHA for f0f3be6

Commits on Jul 29, 2024

• Add tunable kvcache with error handling for nonsense inputs. (Lightning-AI#1636)

  Show description for ce547e0
  

  apaz-cli

  and

  rasbt

  authored
  ce547e0

  Copy full SHA for ce547e0

• Update Lightning version to 2.4.0 pre (Lightning-AI#1640)

  awaelchli

  authored
  11b34d7

  Copy full SHA for 11b34d7

• Add missing super() call in data modules (Lightning-AI#1639)

  awaelchli

  authored
  ba3f9aa

  Copy full SHA for ba3f9aa

• Add Sebastian as code owner (Lightning-AI#1641)

  awaelchli

  authored
  d586ff0

  Copy full SHA for d586ff0

• Faster safetensors conversion when downloading model (Lightning-AI#1624)

  awaelchli

  authored
  31d36dd

  Copy full SHA for 31d36dd

Commits on Jul 26, 2024

• Updates installation requirements to install minimal required packages for basic use (Lightning-AI#1634)

  rasbt

  authored
  16f614f

  Copy full SHA for 16f614f

• Fix kv-cache issue in Python API streaming mode (Lightning-AI#1633)

  rasbt

  authored
  2cf3aa7

  Copy full SHA for 2cf3aa7

• Remove NumPy < 2.0 pin (Lightning-AI#1631)

  rasbt

  authored
  40d88c4

  Copy full SHA for 40d88c4

• Update windows cpu-tests.yml (Lightning-AI#1630)

  rasbt

  authored
  1c6bd1b

  Copy full SHA for 1c6bd1b

Commits on Jul 25, 2024

• Fix prompt docstring in Python API (Lightning-AI#1635)

  rasbt

  authored
  1ede90d

  Copy full SHA for 1ede90d

• Apply prompt style for tp.py and sequentially.py (Lightning-AI#1629)

  Andrei-Aksionov

  authored
  6c99bda

  Copy full SHA for 6c99bda

Commits on Jul 24, 2024

• Bumb version to 0.4.6 for next release (Gemma 2 and Llama 3.1) (Lightning-AI#1626)

  rasbt

  authored
  3142b89

  Copy full SHA for 3142b89

• Add Llama 3.1 405B config (Lightning-AI#1622)

  Show description for 9ebbe82
  

  awaelchli

  and

  rasbt

  authored
  9ebbe82

  Copy full SHA for 9ebbe82

• Remove Python 3.8 workflow

  awaelchli

  committed
  6c4eca0

  Copy full SHA for 6c4eca0

• Llama 3.1 8B and 70B checkpoints (Lightning-AI#1619)

  rasbt

  authored
  fd71063

  Copy full SHA for fd71063

• Enable unbalanced number of layers in sequential generation (Lightning-AI#1623)

  awaelchli

  authored
  3b81aef

  Copy full SHA for 3b81aef

Commits on Jul 23, 2024

• Restore capability to load alternative weights (Lightning-AI#1620)

  rasbt

  authored
  5ff6343

  Copy full SHA for 5ff6343

• Print warning about unsupported repo_ids (Lightning-AI#1617)

  rasbt

  authored
  8ca83b8

  Copy full SHA for 8ca83b8

• Add warning about pretrain preprocessing (Lightning-AI#1618)

  rasbt

  authored
  ccc0d0a

  Copy full SHA for ccc0d0a

• max_returned_tokens -> max_new_tokens (Lightning-AI#1612)

  rasbt

  authored
  562efba

  Copy full SHA for 562efba

Commits on Jul 22, 2024

• Update config hub table qlora sections (Lightning-AI#1611)

  rasbt

  authored
  e549398

  Copy full SHA for e549398

• Gemma 2: 9b and 27b versions (Lightning-AI#1545)

  Show description for 916a84c
  

  Andrei-Aksionov

  and

  rasbt

  authored
  916a84c

  Copy full SHA for 916a84c

• Update LitData version and restore previous LitData assertions in tests (Lightning-AI#1609)

  awaelchli

  authored
  12fb3cb

  Copy full SHA for 12fb3cb

Commits on Jul 20, 2024

• Dynamically set kv-cache size in serve (Lightning-AI#1602)

  rasbt

  authored
  2104b5b

  Copy full SHA for 2104b5b

• Add quantization test and revert lightning version (Lightning-AI#1605)

  rasbt

  authored
  e5137a0

  Copy full SHA for e5137a0

Commits on Jul 19, 2024

• Remove non-used eos_id in Python API (Lightning-AI#1594)

  rasbt

  authored
  6ee05dd

  Copy full SHA for 6ee05dd

• dynamic KV Cache batching (Lightning-AI#1600)

  aniketmaurya

  authored
  f80feff

  Copy full SHA for f80feff

Commits on Jul 18, 2024

• Fix kv-cache clearing in Python API and Serve (Lightning-AI#1596)

  rasbt

  authored
  4e9bc06

  Copy full SHA for 4e9bc06

Pagination

Previous

Next