Commits

Breadcrumbs

History for

onmain

User selector

All users

Datepicker

All time

Commit History

Commits on Jul 11, 2024

• Update LitData to latest version 0.2.16 (Lightning-AI#1573)

  awaelchli

  authored
  5a0db06

  Copy full SHA for 5a0db06

Commits on May 20, 2024

• Fix bug where LitData doesn't use seed (Lightning-AI#1425)

  bradfordlynch

  authored
  17e5c77

  Copy full SHA for 17e5c77

Commits on Apr 15, 2024

• Specify UTF-8 encoding for every open function (Lightning-AI#1283)

  Show description for 410a712
  

  Andrei-Aksionov

  and

  williamFalcon

  authored
  410a712

  Copy full SHA for 410a712

Commits on Apr 11, 2024

• Pretraining with plaintext files (Lightning-AI#1235)

  Show description for cbbea05
  

  3 peopleauthored
  cbbea05

  Copy full SHA for cbbea05

Commits on Apr 3, 2024

• Fix NoneType error when reading custom data from a JSON file (Lightning-AI#1241)

  awaelchli

  authored
  c32eddb

  Copy full SHA for c32eddb

• Drop test xfail (Lightning-AI#1239)

  carmocca

  authored
  de1890a

  Copy full SHA for de1890a

Commits on Mar 27, 2024

• Fix tests in MacOS/Windows

  carmocca

  committed
  af8a39d

  Copy full SHA for af8a39d

• litdata backed tinystories (Lightning-AI#1186)

  carmocca

  authored
  d653607

  Copy full SHA for d653607

Commits on Mar 24, 2024

• Automated formatting (Lightning-AI#1180)

  Andrei-Aksionov

  authored
  9023c45

  Copy full SHA for 9023c45

Commits on Mar 20, 2024

• Add extensions/thunder directory (Lightning-AI#1171)

  carmocca

  authored
  fc60043

  Copy full SHA for fc60043

• Global imports (Lightning-AI#1170)

  carmocca

  authored
  9b6475d

  Copy full SHA for 9b6475d

Commits on Mar 15, 2024

• Automated formatting (Lightning-AI#1126)

  

  carmocca

  authored and

  awaelchli

  committed
  43be9c8

  Copy full SHA for 43be9c8

• Add general purpose LitData streaming data module (Lightning-AI#1118)

  awaelchli

  committed
  b6c97e4

  Copy full SHA for b6c97e4

• Add support for loading JSONL (Lightning-AI#1078)

  awaelchli

  committed
  b3b7fdc

  Copy full SHA for b3b7fdc

• Test split -> Val split (Lightning-AI#1065)

  

  rasbt

  authored and

  awaelchli

  committed
  3c1d014

  Copy full SHA for 3c1d014

• Enable loading train and val split in JSON data module (Lightning-AI#1054)

  awaelchli

  committed
  a8069c5

  Copy full SHA for a8069c5

• Install litdata instead of lightning[data] (Lightning-AI#1046)

  

  carmocca

  authored and

  awaelchli

  committed
  b5f4be6

  Copy full SHA for b5f4be6

• Lit-GPT -> LitGPT (Lightning-AI#1038)

  

  carmocca

  authored and

  awaelchli

  committed
  4839345

  Copy full SHA for 4839345

• Make prompt styles configurable in data modules (Lightning-AI#1006)

  awaelchli

  committed
  4e62afe

  Copy full SHA for 4e62afe

• Add Deita dataset (Lightning-AI#986)

  Show description for 67ec8b6
  

  rasbt

  and

  awaelchli

  committed
  67ec8b6

  Copy full SHA for 67ec8b6

• Avoid windows test failure (Lightning-AI#997)

  

  carmocca

  authored and

  awaelchli

  committed
  6486bf9

  Copy full SHA for 6486bf9

• Add TinyStories dataset for pretraining (Lightning-AI#980)

  

  carmocca

  authored and

  awaelchli

  committed
  de303db

  Copy full SHA for de303db

• Data Refactor - Data Modules as Dataclasses (Lightning-AI#975)

  awaelchli

  committed
  57036f0

  Copy full SHA for 57036f0

• Data Refactor - OpenWebText DataModule (Lightning-AI#977)

  awaelchli

  committed
  c5f1f83

  Copy full SHA for c5f1f83

• (4/n) Data Refactor - Finetuning Scripts (Lightning-AI#950)

  Show description for 73baa2d
  

  3 peoplecommitted
  73baa2d

  Copy full SHA for 73baa2d

Commits on Feb 29, 2024

• (3/n) Data Refactor - Add JSON Module (Lightning-AI#971)

  awaelchli

  authored
  fcc74bc

  Copy full SHA for fcc74bc

Commits on Feb 28, 2024

• (2/n) Data Refactor - Data Modules (Lightning-AI#964)

  Show description for 7eafee8
  

  awaelchli

  and

  carmocca

  authored
  7eafee8

  Copy full SHA for 7eafee8

Commits on Feb 27, 2024

• (1/n) Data Refactor - TinyLlama Pretraining (Lightning-AI#958)

  awaelchli

  authored
  1a5e7c0

  Copy full SHA for 1a5e7c0

Loading