Alpaca-Turbo is a language model that can be run locally without much setup required. It is a user-friendly web UI for the alpaca.cpp language model based on LLaMA, with unique features that make it stand out from other implementations. The goal is to provide a seamless chat experience that is easy to configure and use, without sacrificing speed or functionality.
Docker must be installed on your system
- Download the alpaca-turbo.zip from the release page. here
- Extract the contents of the zip file into a directory named alpaca-turbo.
- Copy your alpaca models to alpaca-turbo/models/ directory.
- Run the following command to set everything up:
docker-compose up - Visit http://localhost:4200 to use the chat interface of the chatbot.
- Other methods will be added soon
- The previous version of Alpaca-Turbo has been moved to the gradio_impl directory.
If you find this project useful, please consider giving it a star on GitHub. You can also join our Discord server for any queries or feedback.