Skip to content

Commit

Permalink
Merge pull request Hannibal046#130 from Saif-Shines/patch-1
Browse files Browse the repository at this point in the history
AI Gateway to the Tools
  • Loading branch information
Hannibal046 authored May 8, 2024
2 parents afe5d3c + d1850cc commit 5318eed
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -389,6 +389,7 @@ The above tables coule be better summarized by this wonderful visualization from
- [LMDeploy](https://github.com/InternLM/lmdeploy) - A high-throughput and low-latency inference and serving framework for LLMs and VLs
- [Tune Studio](https://studio.tune.app/) - Playground for devs to finetune & deploy LLMs
- [LLocalSearch](https://github.com/nilsherzig/LLocalSearch) - Locally running websearch using LLM chains
- [AI Gateway](https://github.com/Portkey-AI/gateway) — Gateway streamlines requests to 100+ open & closed source models with a unified API. It is also production-ready with support for caching, fallbacks, retries, timeouts, loadbalancing, and can be edge-deployed for minimum latency.

## Prompting libraries & tools

Expand Down

0 comments on commit 5318eed

Please sign in to comment.