-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request janhq#1184 from janhq/docs/add-guides
docs: add Chatting Guide
- Loading branch information
Showing
18 changed files
with
122 additions
and
129 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,55 @@ | ||
--- | ||
title: Hardware Requirements | ||
description: Jan is a ChatGPT-alternative that runs on your own computer, with a local API server. | ||
keywords: | ||
[ | ||
Jan AI, | ||
Jan, | ||
ChatGPT alternative, | ||
local AI, | ||
private AI, | ||
conversational AI, | ||
no-subscription fee, | ||
large language model, | ||
] | ||
--- | ||
|
||
Jan is designed to be lightweight and able to run Large Language Models (LLMs) out-of-the-box. | ||
|
||
The current download size is less than 150 MB and has a disk space of ~300 MB. | ||
|
||
To ensure optimal performance, please see the following system requirements: | ||
|
||
## Disk Space | ||
|
||
- Minimum requirement | ||
- At least 5 GB of free disk space is required to accommodate the download, storage, and management of open-source LLM models. | ||
- Recommended | ||
- For an optimal experience and to run most available open-source LLM models on Jan, it is recommended to have 10 GB of free disk space. | ||
|
||
## RAM and GPU VRAM | ||
|
||
The amount of RAM on your system plays a crucial role in determining the size and complexity of LLM models you can effectively run. Jan can be utilized on traditional computers where RAM is a key resource. For enhanced performance, Jan also supports GPU acceleration, utilizing the VRAM of your graphics card. | ||
|
||
## Best Models for your V/RAM | ||
|
||
The RAM and GPU VRAM requirements are dependent on the size and complexity of the LLM models you intend to run. The following are some general guidelines to help you determine the amount of RAM or VRAM you need to run LLM models on Jan | ||
|
||
- `8 GB of RAM`: Suitable for running smaller models like 3B models or quantized 7B models | ||
- `16 GB of RAM (recommended)`: This is considered the "minimum usable models" threshold, particularly for 7B models (e.g Mistral 7B, etc) | ||
- `Beyond 16GB of RAM`: Required for handling larger and more sophisticated model, such as 70B models. | ||
|
||
## Architecture | ||
|
||
Jan is designed to run on muptiple architectures, versatility and widespread usability. The supported architectures include: | ||
|
||
### CPU Support | ||
|
||
- `x86`: Jan is well-suited for systems with x86 architecture, which is commonly found in traditional desktops and laptops. It ensures smooth performance on a variety of devices using x86 processors. | ||
- `ARM`: Jan is optimized to run efficiently on ARM-based systems, extending compatibility to a broad range of devices using ARM processors. | ||
|
||
### GPU Support | ||
|
||
- `NVIDIA` | ||
- `AMD` | ||
- `ARM64 Mac` |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file was deleted.
Oops, something went wrong.
This file was deleted.
Oops, something went wrong.
This file was deleted.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,3 +1,56 @@ | ||
--- | ||
title: Manage Chat History | ||
slug: /guides/chatting/manage-history/ | ||
description: Jan is a ChatGPT-alternative that runs on your own computer, with a local API server. | ||
keywords: | ||
[ | ||
Jan AI, | ||
Jan, | ||
ChatGPT alternative, | ||
local AI, | ||
private AI, | ||
conversational AI, | ||
no-subscription fee, | ||
large language model, | ||
manage-chat-history, | ||
] | ||
--- | ||
|
||
Jan offers a convenient and private way to interact with a conversational AI locally on your computer. This guide will walk you through how to manage your chat history with Jan, ensuring your interactions remain private and organized. | ||
|
||
## Viewing Chat History | ||
|
||
1. Navigate to the main dashboard. | ||
2. Locate the list of threads on the left side of the screen. This list shows all your conversations. | ||
3. Select a thread to view the conversation in the main chat window. | ||
4. Scroll up and down to view the entire chat history in the selected thread. | ||
|
||
<br></br> | ||
![viewing-chat-history](./assets/viewing-chat-history.gif) | ||
|
||
## Managing Threads via Folders | ||
|
||
This feature allows you to directly manage your thread history and configurations. | ||
|
||
1. Navigate to the Thread that you want to manage via the list of threads on the left side of the dashboard. | ||
2. Click on the three dots (⋮) on the `Thread` section on the right side of the dashboard. There are two options: | ||
|
||
- `Reveal in Finder` will open the folder containing the thread history and configurations. | ||
- `View as JSON` will open the thread.json file in your default browser. | ||
|
||
<br></br> | ||
![managing-threads-via-folders](./assets/managing-threads-via-folders.gif) | ||
|
||
## Clean Thread | ||
|
||
To streamline your conservation view, click on the three dots (⋮) on the thread you want to clean, then select `Clean Thread`. It will remove all messages from the thread. It is useful if you want to keep the thread settings, but want to remove the messages from the chat window. | ||
|
||
<br></br> | ||
![clean-thread](./assets/clean-thread.gif) | ||
|
||
## Delete Thread | ||
|
||
To delete a thread, click on the three dots (⋮) on the thread you want to delete, then select `Delete Thread`. It will remove the thread from the list of threads. | ||
|
||
<br></br> | ||
![delete-thread](./assets/delete-thread.gif) |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added
BIN
+333 KB
docs/docs/guides/03-chatting/assets/setting-assistant-instructions.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file was deleted.
Oops, something went wrong.
This file was deleted.
Oops, something went wrong.