Skip to content

Commit

Permalink
docs: gpu not detected
Browse files Browse the repository at this point in the history
  • Loading branch information
0xSage committed Jan 6, 2024
1 parent 949a577 commit 91ebb6e
Show file tree
Hide file tree
Showing 2 changed files with 45 additions and 10 deletions.
22 changes: 12 additions & 10 deletions docs/docs/guides/07-troubleshooting/02-failed-to-fetch.mdx
Original file line number Diff line number Diff line change
@@ -1,9 +1,8 @@
---
title: Failed To Fetch
title: Failed to Fetch
slug: /troubleshooting/failed-to-fetch
description: Troubleshooting "Failed to Fetch"
keywords:
[
keywords: [
Jan AI,
Jan,
ChatGPT alternative,
Expand All @@ -17,19 +16,22 @@ keywords:
]
---

You may receive a "Error Occured: Failed to Fetch" response when you first start chatting with a selected model.
You may receive a "Error Occured: Failed to Fetch" response when you first start chatting with a selected model.

This may occur due to several reasons. Please follow these steps to resolve it:

1. Ensure you are on the latest version of Mac, Windows or Ubuntu OS version
- Upgrading to the latest version has resolved this issue for most people

2. Select a model that is smaller than 80% of your hardware V/RAM.
- For example, if you have a 8GB machine, you should select models smaller than 6GB.
- Upgrading to the latest version has resolved this issue for most people

2. Select a model that is smaller than 80% of your hardware V/RAM.

- For example, if you have a 8GB machine, you should select models smaller than 6GB.

3. Install the latest [Nightly release](https://jan.ai/install/nightly/)
- If you are re-installing Jan, it can help to [clear the application cache](https://jan.ai/troubleshooting/stuck-on-broken-build/)

4. Ensure your V/RAM is accessible by the application (some people have virtual RAM)
- If you are re-installing Jan, it can help to [clear the application cache](https://jan.ai/troubleshooting/stuck-on-broken-build/)

4. Ensure your V/RAM is accessible by the application (some people have virtual RAM)

5. If you are on Nvidia GPUs, please download [Cuda](https://developer.nvidia.com/cuda-downloads)
5. If you are on Nvidia GPUs, please download [Cuda](https://developer.nvidia.com/cuda-downloads)
33 changes: 33 additions & 0 deletions docs/docs/guides/07-troubleshooting/03-gpu-not-used.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
---
title: Jan is Not Using GPU
keywords: [
Jan AI,
Jan,
ChatGPT alternative,
local AI,
private AI,
convZ
ersational AI,
no-subscription fee,
large language model,
troubleshooting,
]
---

By default, Jan uses GPU acceleration.

If you are experiencing this issue, you may need to download the latest Nvidia CUDA toolkit.

> We weren't propagating CUDA issues in the old build.
Steps:

1. Download Cuda toolkit (versions 11.4+) from [Nvidia](https://developer.nvidia.com/cuda-downloads?target_os=Windows)

1. Go to Settings > Advanced > Turn on GPU acceleration

1. You may need to restart Jan

1. Check in `System Monitor` that there is more (V)RAM now

1. If the issue is not fixed, please install the [Nightly version](/install/nightly) instead.

0 comments on commit 91ebb6e

Please sign in to comment.