Skip to content

Commit

Permalink
update faq (ollama#1176)
Browse files Browse the repository at this point in the history
  • Loading branch information
mxyng authored Nov 17, 2023
1 parent 8109214 commit 90860b6
Showing 1 changed file with 6 additions and 0 deletions.
6 changes: 6 additions & 0 deletions docs/faq.md
Original file line number Diff line number Diff line change
Expand Up @@ -148,3 +148,9 @@ Build and run this image:
docker build -t ollama-with-ca .
docker run -d -e HTTPS_PROXY=https://my.proxy.example.com -p 11434:11434 ollama-with-ca
```

### How do I use Ollama with GPU acceleration in Docker?

The Ollama Docker container can be configured with GPU acceleration in Linux or Windows (with WSL2). This requires the [nvidia-container-toolkit](https://github.com/NVIDIA/nvidia-container-toolkit).

GPU acceleration is not available for Docker Desktop in macOS due to the lack of GPU passthrough and emulation.

0 comments on commit 90860b6

Please sign in to comment.