Skip to content

Commit

Permalink
Update README.md (iusztinpaul#63)
Browse files Browse the repository at this point in the history
  • Loading branch information
iusztinpaul authored Dec 27, 2023
1 parent 1381e9e commit 6f2bff5
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions modules/financial_bot/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -123,6 +123,8 @@ Start the Gradio UI in debug mode while mocking the LLM:
make run_ui_dev
```

You can access the Gradio UI at: `http://localhost:7860/`

![Financial Bot Gradio UI](../../media/financial_bot_gradio_ui.png)

**NOTE:** Running the commands from above will host the UI on your computer. To run them, **you need a CUDA-enabled Nvidia GPU with enough resources** (e.g., to run the inference using Falcon 7B, you need ~8 GB VRAM). If you don't have that available, you can deploy it to `Gradio Spaces` on HuggingFace. It is straightforward to do so. [Here are some docs to get you started](https://huggingface.co/docs/hub/spaces-sdks-gradio).
Expand Down

0 comments on commit 6f2bff5

Please sign in to comment.