From d1850ccb0c026d19f88c0509696fbecd170fdcc6 Mon Sep 17 00:00:00 2001 From: Saif Date: Wed, 8 May 2024 10:14:45 +0530 Subject: [PATCH] AI Gateway to the Tools Gateway streamlines requests to 100+ open & closed source models with a unified API. It is also production-ready with support for caching, fallbacks, retries, timeouts, loadbalancing, and can be edge-deployed for minimum latency. --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 8b6bf54..ca1384f 100644 --- a/README.md +++ b/README.md @@ -388,6 +388,7 @@ The above tables coule be better summarized by this wonderful visualization from - [LMDeploy](https://github.com/InternLM/lmdeploy) - A high-throughput and low-latency inference and serving framework for LLMs and VLs - [Tune Studio](https://studio.tune.app/) - Playground for devs to finetune & deploy LLMs - [LLocalSearch](https://github.com/nilsherzig/LLocalSearch) - Locally running websearch using LLM chains +- [AI Gateway](https://github.com/Portkey-AI/gateway) — Gateway streamlines requests to 100+ open & closed source models with a unified API. It is also production-ready with support for caching, fallbacks, retries, timeouts, loadbalancing, and can be edge-deployed for minimum latency. ## Prompting libraries & tools