LLM inference in C/C++

Cross-platform, customizable ML solutions for live and streaming media.

Productive, portable, and performant GPU programming in Python.

Distribute and run LLMs with a single file.

Official inference framework for 1-bit LLMs

Tensor library for machine learning

Cataclysm - Dark Days Ahead. A turn-based survival game set in a post-apocalyptic world.

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

Redot Engine – Multi-platform 2D and 3D game engine

Stable Diffusion and Flux in pure C/C++

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

chDB is an in-process OLAP SQL Engine 🚀 powered by ClickHouse

A SQLite extension for efficient vector search, based on Faiss!

vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

A scalable inference server for models optimized with OpenVINO™

C++ builds C++