Skip to content

Commit

Permalink
doc: add pip install huggingface_hub to howtos (Lightning-AI#97)
Browse files Browse the repository at this point in the history
  • Loading branch information
emilesilvis authored May 29, 2023
1 parent e3d2bd2 commit 513c393
Show file tree
Hide file tree
Showing 3 changed files with 6 additions and 0 deletions.
2 changes: 2 additions & 0 deletions howto/download_pythia.md
Original file line number Diff line number Diff line change
Expand Up @@ -35,6 +35,8 @@ EleutherAI/pythia-12b-deduped
In order to use a specific Pythia checkpoint, for instance [pythia-1b](https://huggingface.co/EleutherAI/pythia-1b), download the weights and convert the checkpoint to the lit-parrot format:

```bash
pip install huggingface_hub

python scripts/download.py --repo_id EleutherAI/pythia-1b

python scripts/convert_hf_checkpoint.py --checkpoint_dir checkpoints/EleutherAI/pythia-1b
Expand Down
2 changes: 2 additions & 0 deletions howto/download_redpajama_incite.md
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,8 @@ togethercomputer/RedPajama-INCITE-Instruct-7B-v0.1
In order to use a specific RedPajama-INCITE checkpoint, for instance [RedPajama-INCITE-Base-3B-v1](https://huggingface.co/togethercomputer/RedPajama-INCITE-Base-3B-v1), download the weights and convert the checkpoint to the lit-parrot format:

```bash
pip install huggingface_hub

python scripts/download.py --repo_id togethercomputer/RedPajama-INCITE-Base-3B-v1

python scripts/convert_hf_checkpoint.py --checkpoint_dir checkpoints/togethercomputer/RedPajama-INCITE-Base-3B-v1
Expand Down
2 changes: 2 additions & 0 deletions howto/download_stablelm.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,8 @@ stabilityai/stablelm-tuned-alpha-7b
In order to use a specific StableLM checkpoint, for instance [stablelm-base-alpha-3b](http://huggingface.co/stabilityai/stablelm-base-alpha-3b), download the weights and convert the checkpoint to the lit-stablelm format:

```bash
pip install huggingface_hub

python scripts/download.py --repo_id stabilityai/stablelm-base-alpha-3b

python scripts/convert_hf_checkpoint.py --checkpoint_dir checkpoints/stabilityai/stablelm-base-alpha-3b
Expand Down

0 comments on commit 513c393

Please sign in to comment.