Skip to content

Commit

Permalink
docs: update slugs again
Browse files Browse the repository at this point in the history
  • Loading branch information
freelerobot committed Mar 14, 2024
1 parent b4eff9a commit 1fe3dff
Show file tree
Hide file tree
Showing 6 changed files with 18 additions and 20 deletions.
12 changes: 0 additions & 12 deletions docs/docs/guides/engines/llama-cpp.md

This file was deleted.

Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: Extensions
slug: /guides/engines
title: Inference Providers
slug: /guides/providers
---

import DocCardList from "@theme/DocCardList";
Expand Down
File renamed without changes
10 changes: 10 additions & 0 deletions docs/docs/guides/providers/llama-cpp.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
---
title: llama.cpp
slug: /guides/providers/llama-cpp
---

## Overview

[Nitro](https://github.com/janhq/nitro) is an inference server on top of [llama.cpp](https://github.com/ggerganov/llama.cpp). OpenAI-compatible API, queue, & scaling.

Nitro is the default AI engine downloaded with Jan. There is no additional setup needed.
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
title: TensorRT-LLM Extension
slug: /guides/engines/tensorrt-llm
title: TensorRT-LLM
slug: /guides/providers/tensorrt-llm
---

Users with Nvidia GPUs can get 20-40% faster* token speeds on their laptop or desktops by using [TensorRT-LLM](https://github.com/NVIDIA/TensorRT-LLM).
Expand Down
8 changes: 4 additions & 4 deletions docs/sidebars.js
Original file line number Diff line number Diff line change
Expand Up @@ -201,15 +201,15 @@ const sidebars = {
},
{
type: "category",
label: "AI Engines",
label: "Inference Providers",
className: "head_SubMenu",
link: {
type: 'doc',
id: "guides/engines/README",
id: "guides/providers/README",
},
items: [
"guides/engines/llama-cpp",
"guides/engines/tensorrt-llm",
"guides/providers/llama-cpp",
"guides/providers/tensorrt-llm",
]
},
{
Expand Down

0 comments on commit 1fe3dff

Please sign in to comment.