Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Jun 10, 2023

• Set the config's block size as the max_seq_length data preparation and fine tuning scripts (Lightning-AI#127)

  Show description for c38f191
  

  iskandr

  and

  carmocca

  authored
  c38f191

  Copy full SHA for c38f191

Commits on Jun 9, 2023

• Use init_module(empty_init) (Lightning-AI#131)

  carmocca

  authored
  a9dbfdf

  Copy full SHA for a9dbfdf

• GTX -> RTX typo

  carmocca

  committed
  aa5d2ce

  Copy full SHA for aa5d2ce

• Add datasets to requirements (Lightning-AI#130)

  rasbt

  authored
  8bf9664

  Copy full SHA for 8bf9664

• Add find_multiple assertion

  carmocca

  committed
  675e4ee

  Copy full SHA for 675e4ee

Commits on Jun 8, 2023

• Show the absolute path when check_valid_checkpoint_dir fails

  carmocca

  committed
  0368dbb

  Copy full SHA for 0368dbb

• Fix EmptyInitOnDevice with quantization but no device

  carmocca

  authored
  1af7d6e

  Copy full SHA for 1af7d6e

Commits on Jun 7, 2023

• Fix adapter scripts for multi-gpu training (Lightning-AI#121)

  rasbt

  authored
  41b3b27

  Copy full SHA for 41b3b27

Commits on Jun 6, 2023

• Support the newest RedPajama INCITE 7B release (Lightning-AI#115)

  carmocca

  authored
  5db80b0

  Copy full SHA for 5db80b0

• Ignore DeepSpeed warning about no_backward_sync (Lightning-AI#114)

  carmocca

  authored
  a148946

  Copy full SHA for a148946

• Support large model inference with FSDP (Lightning-AI#111)

  carmocca

  authored
  248d691

  Copy full SHA for 248d691

• Add tests for generate/adapter and generate/adapter_v2 (Lightning-AI#103)

  Show description for a90a105
  

  agmo1993

  and

  carmocca

  authored
  a90a105

  Copy full SHA for a90a105

Commits on Jun 5, 2023

• Fix adapter v2 imports

  carmocca

  committed
  25fb51e

  Copy full SHA for 25fb51e

• no_backward_sync should wrap fwd and loss

  Show description for 9892d1b
  carmocca

  committed
  9892d1b

  Copy full SHA for 9892d1b

Commits on Jun 4, 2023

• Fix to point to correct generation script in Falcon documentation (Lightning-AI#109)

  recursionbane

  authored
  8340c1b

  Copy full SHA for 8340c1b

Commits on Jun 2, 2023

• Fix chat script with quantization

  carmocca

  committed
  35ed033

  Copy full SHA for 35ed033

• Restructure repo into directories as Lit-LLaMA (Lightning-AI#86)

  carmocca

  authored
  a905731

  Copy full SHA for a905731

• Adapter fixes (Lightning-AI#108)

  carmocca

  authored
  dcccbcc

  Copy full SHA for dcccbcc

• Add Falcon 40B gptq.int4 numbers (Lightning-AI#107)

  carmocca

  authored
  350e732

  Copy full SHA for 350e732

• Update howto for finetuning on MPS (Lightning-AI#98)

  Show description for 0eead1c
  

  carmocca

  and

  lantiga

  authored
  0eead1c

  Copy full SHA for 0eead1c

• Arrow length

  carmocca

  authored
  f6b9dd3

  Copy full SHA for f6b9dd3

• Comment spacing

  carmocca

  authored
  d2f16cc

  Copy full SHA for d2f16cc

• Add QKV config ASCII diagram (Lightning-AI#106)

  carmocca

  authored
  01f3a91

  Copy full SHA for 01f3a91

• Support Falcon 40B (Lightning-AI#102)

  carmocca

  authored
  954796e

  Copy full SHA for 954796e

• Support Falcon 7B (Lightning-AI#105)

  carmocca

  authored
  658a76b

  Copy full SHA for 658a76b

• Quantization support (fix llm.int8 and add gptq.int4) (Lightning-AI#104)

  carmocca

  authored
  a2ba35e

  Copy full SHA for a2ba35e

Commits on May 31, 2023

• Add incremental_save to utils, use in convert_hf_checkpoint (Lightning-AI#100)

  carmocca

  authored
  5944ba3

  Copy full SHA for 5944ba3

Commits on May 30, 2023

• max_returned_tokens as a generate input (Lightning-AI#99)

  carmocca

  authored
  443ea2f

  Copy full SHA for 443ea2f

• Update finetune_adapter.md code rendering

  carmocca

  authored
  84a8531

  Copy full SHA for 84a8531

• Add adapter multihead gating (Lightning-AI#82)

  rasbt

  authored
  eb479eb

  Copy full SHA for eb479eb

• Port Adapter_V2 from lit-llama pull request Lightning-AI#303 (Lightning-AI#85)

  Show description for 58ef0f2
  

  3 peopleauthored
  58ef0f2

  Copy full SHA for 58ef0f2

• Update inference.md typo

  carmocca

  authored
  f711a1a

  Copy full SHA for f711a1a

Commits on May 29, 2023

• Be able to set custom accelerator, precision and dtype for MPS accelerators (Apple M1 silicon) (Lightning-AI#94)

  agmo1993

  authored
  b1101fc

  Copy full SHA for b1101fc

• doc: add pip install huggingface_hub to howtos (Lightning-AI#97)

  emilesilvis

  authored
  513c393

  Copy full SHA for 513c393

Commits on May 28, 2023

• Revert "Adding vocab_size to config.py (Lightning-AI#68)" (Lightning-AI#88)

  carmocca

  authored
  e3d2bd2

  Copy full SHA for e3d2bd2

Pagination

Previous

Next