Commits

Branch selector

 main

User selector

Andrei-Aksionov

Datepicker

All time

Commit History

Commits on Mar 26, 2024

• Gemma 7B x LoRA fix (Lightning-AI#1197)

  Show description for 73adb38
  

  Andrei-Aksionov

  and

  carmocca

  authored
  73adb38

  Copy full SHA for 73adb38

• Gemma: WTE scaling for Adapter and LoRA (Lightning-AI#1193)

  Andrei-Aksionov

  authored
  c7ae866

  Copy full SHA for c7ae866

• Chunked CrossEntropyLoss for AdapterV2 (Lightning-AI#1194)

  Andrei-Aksionov

  authored
  8bb5e7b

  Copy full SHA for 8bb5e7b

Commits on Mar 25, 2024

• Annotations for forward method of the Block class. (Lightning-AI#1142)

  Andrei-Aksionov

  authored
  bfe2609

  Copy full SHA for bfe2609

• GemmaMLP: add missing approximation for LoRA and AdapterV2 variants (Lightning-AI#1178)

  Andrei-Aksionov

  authored
  025a668

  Copy full SHA for 025a668

Commits on Mar 24, 2024

• Automated formatting (Lightning-AI#1180)

  Andrei-Aksionov

  authored
  9023c45

  Copy full SHA for 9023c45

Commits on Mar 5, 2024

• GemmaMLP uses 'tanh` approximation for GeLU activation (Lightning-AI#1004)

  Andrei-Aksionov

  authored
  f241d94

  Copy full SHA for f241d94

Commits on Mar 1, 2024

• StableLM-3B-4E1T (Lightning-AI#974)

  Andrei-Aksionov

  authored
  1e045fe

  Copy full SHA for 1e045fe

Commits on Feb 29, 2024

• Add Stable-Code-3B tutorial (Lightning-AI#972)

  Andrei-Aksionov

  authored
  d4b213c

  Copy full SHA for d4b213c

Commits on Feb 23, 2024

• Fix relative import in tests (Lightning-AI#949)

  Andrei-Aksionov

  authored
  7af2e5f

  Copy full SHA for 7af2e5f

Commits on Jan 16, 2024

• Phi model update (Lightning-AI#876)

  Show description for 423b1a8
  

  Andrei-Aksionov

  and

  carmocca

  authored
  423b1a8

  Copy full SHA for 423b1a8

Commits on Dec 29, 2023

• Mixtral: LLaMAMoE wrongly inherited from base LLaMAMLP for Adapter_v2 and LoRA (Lightning-AI#851)

  Andrei-Aksionov

  authored
  cd1c521

  Copy full SHA for cd1c521

Commits on Dec 21, 2023

• LoRA merge with quantization: optimiziations (Lightning-AI#842)

  Andrei-Aksionov

  authored
  70164f8

  Copy full SHA for 70164f8

Commits on Dec 20, 2023

• Updated GitHub markdown alerts (Lightning-AI#841)

  Andrei-Aksionov

  authored
  9a2065e

  Copy full SHA for 9a2065e

Commits on Dec 13, 2023

• LoRA: support merging with quantized weights (Lightning-AI#771)

  Show description for 3e45857
  

  3 peopleauthored
  3e45857

  Copy full SHA for 3e45857

Commits on Dec 11, 2023

• Tests for StableLM Zephyr 3B (Lightning-AI#804)

  Andrei-Aksionov

  authored
  3a6186b

  Copy full SHA for 3a6186b

Commits on Dec 9, 2023

• StableLM Zephyr 3B (Lightning-AI#801)

  Andrei-Aksionov

  authored
  a6059b2

  Copy full SHA for a6059b2

Commits on Dec 5, 2023

• Tests for chat/base.py: decode and main functions (Lightning-AI#787)

  Show description for 2907c08
  

  Andrei-Aksionov

  and

  carmocca

  authored
  2907c08

  Copy full SHA for 2907c08

Commits on Nov 28, 2023

• TinyLlama: Chat version (Lightning-AI#778)

  Andrei-Aksionov

  authored
  64efb7c

  Copy full SHA for 64efb7c

Commits on Nov 27, 2023

• Tests: Pythia-70m --> Pythia-14m (Lightning-AI#784)

  Andrei-Aksionov

  authored
  c72c562

  Copy full SHA for c72c562

• Pythia 14M and 31M (Lightning-AI#783)

  Andrei-Aksionov

  authored
  409cee8

  Copy full SHA for 409cee8

Commits on Nov 24, 2023

• Codebase chores: typos, trailing spaces, markdown linting, Ruff and Black. (Lightning-AI#777)

  Andrei-Aksionov

  authored
  2647dbd

  Copy full SHA for 2647dbd

• Microsoft/Phi-1.5: Update convert script (Lightning-AI#772)

  Andrei-Aksionov

  authored
  aa6ee9e

  Copy full SHA for aa6ee9e

• TinLlama: Update intermediate checkpoint (Lightning-AI#768)

  Andrei-Aksionov

  authored
  6665843

  Copy full SHA for 6665843

Commits on Nov 21, 2023

• Pin revision of Phi-1.5 (Lightning-AI#762)

  Andrei-Aksionov

  authored
  a2400f9

  Copy full SHA for a2400f9

Commits on Nov 20, 2023

• Remove code to force lm_eval to work under Python 3.8 (Lightning-AI#757)

  Andrei-Aksionov

  authored
  9690b70

  Copy full SHA for 9690b70

• Load config from checkpoint_dir if weights are not required (Lightning-AI#755)

  Andrei-Aksionov

  authored
  c85bf01

  Copy full SHA for c85bf01

• Fix seed in all generation scripts. (Lightning-AI#754)

  Show description for f6174d9
  

  Andrei-Aksionov

  and

  carmocca

  authored
  f6174d9

  Copy full SHA for f6174d9

Commits on Nov 13, 2023

• BNB>=0.41.2 uses quant_state as a class, not as a list (Lightning-AI#715)

  Andrei-Aksionov

  authored
  6a11e5f

  Copy full SHA for 6a11e5f

Commits on Oct 30, 2023

• Use deepcopy to avoid accidental config modifications (Lightning-AI#681)

  Andrei-Aksionov

  authored
  4826ab3

  Copy full SHA for 4826ab3

Commits on Oct 23, 2023

• Fix unused arguments (Lightning-AI#657)

  Andrei-Aksionov

  authored
  6ed6a15

  Copy full SHA for 6ed6a15

Commits on Oct 16, 2023

• Automated code fixes with type annotations check. (Lightning-AI#646)

  Andrei-Aksionov

  authored
  39adff8

  Copy full SHA for 39adff8

Commits on Oct 11, 2023

• Type hints (Lightning-AI#633)

  Andrei-Aksionov

  authored
  bf60124

  Copy full SHA for bf60124

• A badge with supported Python versions (Lightning-AI#632)

  Andrei-Aksionov

  authored
  1ec6b75

  Copy full SHA for 1ec6b75

Commits on Oct 9, 2023

• Mention that the numbers in markdowns were obtained with CUDA 11.8 (Lightning-AI#624)

  Andrei-Aksionov

  authored
  807c7bc

  Copy full SHA for 807c7bc

Pagination

Previous

Next