Editor with LLM generation tree exploration

VS Code extension for LLM-assisted code/text completion

A C++ header-only HTTP/HTTPS server and client library

A tiny Neovim plugin that adds subtle animations to various operations.

A minimalistic C++ Jinja templating engine for LLM chat templates

SOTA discrete acoustic codec models with 40 tokens per second for audio language modeling

A blender addon for generating meshes with AI

ShellSage saves sysadmins’ sanity by solving shell script snafus super swiftly

Interface for OuteTTS models.

Go library for embedded vector search and semantic embeddings using llama.cpp

Vim plugin for LLM-assisted code/text completion

An app that brings language models directly to your phone.

AI-powered assistant to help you with your daily tasks, powered by Llama 3.2. It can recognize your voice, process natural language, and perform various actions based on your commands: summarizing …

Manage GPU clusters for running AI models

A Kotlin Multiplatform Project utilizing ggwave, a data-over-sound library.

Helping groups securely exchange contact information.

A live multiplayer trivia game where users can bid for the subject of the next question

Testing LLM reasoning abilities with family relationship quizzes.

An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.

LLM-powered lossless compression tool

Stateful load balancer custom-tailored for llama.cpp 🏓🦙

asynchronous/distributed speculative evaluation for llama3

Utilities to use the Hugging Face Hub API

Raspberry Pi Voice Assistant

Send Morse code via ⏮️ ⏸️ ⏯️

Extracts structured data from unstructured input. Programming language agnostic. Uses llama.cpp

Pybind11 bindings for Whisper.cpp

LLM training in simple, raw C/CUDA