A local and uncensored AI entity.

基于SparkTTS模型，提供高质量中文语音合成与声音克隆服务。

Simple LLM interface based on terminal + GUI option

SmolLM2 🤗: Family of lightweight language models, performs diverse tasks on-device

FastAPI semantic search + custom entity detection platform.

This is a Discord Bot designed to help noobs in my Discord server chat about Dying Light modding.

TinySwallow: TAID distillation boosts instruction following

Dolphin 3.0 🐬: Versatile AI for coding, math, and more

A simple repository demonstrating LlamaCPP yielding structured output

Qwen2.5-Coder: Family of LLMs excels in code, debugging, etc

Setting up a local inference environment with llama.cpp and pytorch, with CUDA support .

This repository demonstrates how to use outlines and llama-cpp-python for structured JSON generation with streaming output, integrating llama.cpp for local model inference and outlines for schema-based text generation.