Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Sep 5, 2024

• Add batched_generate_fn() (Lightning-AI#1702)

  Show description for 1d37f9a
  

  apaz-cli

  and

  rasbt

  authored
  1d37f9a

  Copy full SHA for 1d37f9a

Commits on Aug 29, 2024

• add support for batched input_pos to model (Lightning-AI#1700)

  t-vi

  authored
  fdf6a12

  Copy full SHA for fdf6a12

• bump thunder dependency to main (Lightning-AI#1701)

  t-vi

  authored
  1bfc24d

  Copy full SHA for 1bfc24d

Commits on Aug 28, 2024

• Add batched_next_token() and batched_sample() (Lightning-AI#1693)

  Show description for 3c0c479
  

  apaz-cli

  and

  rasbt

  authored
  3c0c479

  Copy full SHA for 3c0c479

Commits on Aug 26, 2024

• Preserve eos in encoding when max_seq_length = -1 (Lightning-AI#1694)

  Show description for f655f01
  

  sanderland

  and

  awaelchli

  authored
  f655f01

  Copy full SHA for f655f01

Commits on Aug 23, 2024

• Fix falcon prompt template (Lightning-AI#1696)

  rasbt

  authored
  ea01fbc

  Copy full SHA for ea01fbc

• Bumb version to 0.4.11 (Lightning-AI#1695)

  rasbt

  authored
  e712c68

  Copy full SHA for e712c68

Commits on Aug 22, 2024

• Combine generate() functions (Lightning-AI#1675)

  Show description for 59250d3
  

  apaz-cli

  and

  rasbt

  authored
  59250d3

  Copy full SHA for 59250d3

• Avoid error when executing benchmark util outside a git folder (Lightning-AI#1691)

  rasbt

  authored
  2ddf893

  Copy full SHA for 2ddf893

Commits on Aug 21, 2024

• Make number of generated tokens consistent with CLI (Lightning-AI#1690)

  rasbt

  authored
  aaed893

  Copy full SHA for aaed893

• Update check_nvlink_connectivity (Lightning-AI#1684)

  Show description for 68e69c7
  

  sanderland

  and

  rasbt

  authored
  68e69c7

  Copy full SHA for 68e69c7

• Add Microsoft Phi 3.5 checkpoint (Lightning-AI#1687)

  rasbt

  authored
  1bd8600

  Copy full SHA for 1bd8600

Commits on Aug 20, 2024

• Spelling fix (Lightning-AI#1685)

  rasbt

  authored
  b772602

  Copy full SHA for b772602

• Added git hash to benchmark utility. (Lightning-AI#1681)

  apaz-cli

  authored
  0246dee

  Copy full SHA for 0246dee

Commits on Aug 19, 2024

• Add PR benchmark util for internal use (Lightning-AI#1680)

  rasbt

  authored
  61773f9

  Copy full SHA for 61773f9

• Improved benchmark utils (Lightning-AI#1679)

  rasbt

  authored
  7581313

  Copy full SHA for 7581313

Commits on Aug 16, 2024

• Fix KV cache issue in LLM API (Lightning-AI#1678)

  rasbt

  authored
  ea4ea68

  Copy full SHA for ea4ea68

• Auto device handling in LLM API (Lightning-AI#1677)

  rasbt

  authored
  6957d85

  Copy full SHA for 6957d85

Commits on Aug 15, 2024

• Update README.md

  williamFalcon

  authored
  01432c5

  Copy full SHA for 01432c5

• Make LitGPT LLM API compatible with PyTorch Lightning Trainer 1/2 (Lightning-AI#1667)

  rasbt

  authored
  8b6789e

  Copy full SHA for 8b6789e

• Add distribute=None to python-api.md (Lightning-AI#1676)

  rasbt

  authored
  e0718c8

  Copy full SHA for e0718c8

Commits on Aug 14, 2024

• Bumb version to 0.4.10 for next release (Lightning-AI#1674)

  rasbt

  authored
  b042058

  Copy full SHA for b042058

Commits on Aug 13, 2024

• Add Mistral Large 123B (Lightning-AI#1673)

  rasbt

  authored
  c6c2b35

  Copy full SHA for c6c2b35

Commits on Aug 12, 2024

• Multi-gpu serving (Lightning-AI#1670)

  rasbt

  authored
  ef9647c

  Copy full SHA for ef9647c

• Support the refactored API in litgpt serve (Lightning-AI#1668)

  rasbt

  authored
  2433eaf

  Copy full SHA for 2433eaf

• Update azure-gpu-test.yml (Lightning-AI#1669)

  rasbt

  authored
  3eab461

  Copy full SHA for 3eab461

Commits on Aug 8, 2024

• Swap old Llama model with Phi-3 (Lightning-AI#1666)

  rasbt

  authored
  627949d

  Copy full SHA for 627949d

• Support Tensor Parallel in Python API (Lightning-AI#1661)

  rasbt

  authored
  40c293d

  Copy full SHA for 40c293d

• Bumb version for 0.4.9 release (Lightning-AI#1664)

  rasbt

  authored
  b0ea177

  Copy full SHA for b0ea177

Commits on Aug 7, 2024

• Optionally return benchmark info in Python API (Lightning-AI#1660)

  rasbt

  authored
  b4fd601

  Copy full SHA for b4fd601

Commits on Aug 6, 2024

• Fix some issues with circular and relative imports (Lightning-AI#1658)

  rasbt

  authored
  4558463

  Copy full SHA for 4558463

• Refactor Python API to introduce new distribute method (part of a larger refactor for PTL support) (Lightning-AI#1657)

  rasbt

  authored
  9722fdb

  Copy full SHA for 9722fdb

• Add a PyTorch Lightning example (Lightning-AI#1656)

  rasbt

  authored
  6786c42

  Copy full SHA for 6786c42

Commits on Aug 5, 2024

• Support for using large models in the Python API via sequential generation (Lightning-AI#1637)

  rasbt

  authored
  8385d50

  Copy full SHA for 8385d50

Commits on Aug 2, 2024

• Update LitServe version and tests (Lightning-AI#1654)

  rasbt

  authored
  1206cdc

  Copy full SHA for 1206cdc

Pagination

Previous

Next