Skip to content

Commit

Permalink
Update README.md (Lightning-AI#1291)
Browse files Browse the repository at this point in the history
Co-authored-by: Sebastian Raschka <[email protected]>
  • Loading branch information
williamFalcon and rasbt authored Apr 15, 2024
1 parent c81800f commit d84c5c1
Showing 1 changed file with 13 additions and 4 deletions.
17 changes: 13 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,14 +25,24 @@ Uses the latest state-of-the-art techniques:
<a href="#finetune-an-llm">Finetune, pretrain LLMs</a> •
<a href="#choose-from-20-llms">Models</a> •
<a href="#state-of-the-art-features">Features</a> •
<a href="#training-recipes">Training recipes (YAML)</a> •
<a href="#litgpt-design-principles">Design principles</a>
<a href="#training-recipes">Training recipes (YAML)</a>
</p>

</div>

&nbsp;

## Finetune, pretrain and deploy AI models Lightning fast ⚡⚡
LitGPT is a command-line tool to use, pretrain, finetune and deploy LLMs. It is based on configs with highly-optimized recipes for training the world's largest, most powerful open-source LLMs.

We've reimplemented all the model architectures and training recipes for 3 reasons:

1. Remove all abstraction layers and have single file implementations.
2. Guarantee Apache 2.0 compliance to enable enterprise use without limits.
3. Optimized every detail of every model to get the fastest performance possible to lower cost and training speeds.

&nbsp;

## Install LitGPT

Install LitGPT with all dependencies (including CLI, quantization, tokenizers for all models, etc.):
Expand Down Expand Up @@ -60,8 +70,7 @@ pip install -e '.[all]'
---

# Get started
LitGPT is a command-line tool to use, pretrain, finetune and deploy LLMs.

LitGPT is CLI and config-based. Select the model and the action you want to take on that model (finetune, pretrain, evaluate, deploy, etc...):

&nbsp;

Expand Down

0 comments on commit d84c5c1

Please sign in to comment.