Visual inference exploration & experimentation playground

LM inference server implementation based on llama.cpp.

ThunderAI is a Thunderbird Addon that uses the capabilities of ChatGPT or Ollama to enhance email management.

A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.

An OpenAI Compatible API which integrates LLM, Embedding and Reranker. 一个集成 LLM、Embedding 和 Reranker 的 OpenAI 兼容 API

A FastAPI-powered REST API offering a comprehensive suite of natural language processing services using machine learning models with PyTorch and Transformers, packaged in a Docker container to run efficiently.

Achieve search sovereignty with Toledo1, a compound LLM browser

LLM based assistant running as a Telegram Bot.

A Discordjs bot that uses OpenAI compatible endpoints for chatting.