Skip to content

Commit

Permalink
add new ports & installation guide
Browse files Browse the repository at this point in the history
  • Loading branch information
cedrickchee committed Mar 12, 2023
1 parent 3070cd9 commit 973014c
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -115,7 +115,7 @@ Well look at [my "transformers-llama" repo](https://github.com/cedrickchee/trans

#### Other ports

- [Text generation web UI](https://github.com/oobabooga/text-generation-webui) - A Gradio Web UI for running Large Language Models like LLaMA, GPT-Neo, OPT, and friends.
- [Text generation web UI](https://github.com/oobabooga/text-generation-webui) - A Gradio Web UI for running Large Language Models like LLaMA, GPT-Neo, OPT, and friends. My guide: ["Installing 8/4-bit LLaMA with text-generation-webui on Linux"](https://gist.github.com/cedrickchee/1f24fa3a5e3371910e1959b96a8dff94)
- [LLaMa CPU fork](https://github.com/markasoftware/llama-cpu) - We need more work like this that lower the compute requirements. Really under appreciated.
- [LLaMA Jax](https://github.com/Sea-Snell/JAX_llama)
- [Minimal LLaMA](https://github.com/cedrickchee/minimal-llama) - Jason's HuggingFace Transformers port using OPT code internally. This version should be more stable. But the code is not well-tested yet. Bonus: you can quickly see how well the model can be fine-tuned either using HuggingFace PEFT with 8-bit or Pipeline Parallelism.
Expand All @@ -126,6 +126,8 @@ Well look at [my "transformers-llama" repo](https://github.com/cedrickchee/trans

We underestimated pre-trained language models (~2019) and overestimated a lot of things.

My [llama.cpp](https://github.com/cedrickchee/llama.cpp) patches for Linux support. (WIP)

<details>
<summary>See more</summary>

Expand Down

0 comments on commit 973014c

Please sign in to comment.