nashville-llm-fable

Steps for opening project and running the LLM:

1. Install Python and Pip on your machine (test with "python --version" and "pip --version")
2. Download and install CMake from the following URL: https://cmake.org/download/ (use the Windows msi installer)
3. Install Visual Studio Code
4. Install Python and Jupyter extensions in VS Code
5. Clone this repository to your machine
6. Open the files "local-llm-challenge/local-llm.ipynb" and "rag-example/rag-example.ipynb" in VS Code
7. Follow the instructions in the notebooks and execute the cells of code in order

Working Environment

These notebooks have been designed, written and tested to run on machines with a minimum of 16GB of RAM (32GB preferred). However, if you don't have access to one sign up for a free account on Amazon SageMaker Studio Lab. Studio Lab is a free machine learning (ML) development environment that provides compute and storage (up to 15GB) at no cost with NO credit card required.

You can sign up for Amazon SageMaker Studio Lab here: [https://studiolab.sagemaker.aws/]