GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

LLM inference in C/C++

Tesseract Open Source OCR Engine (main repository)

Port of OpenAI's Whisper model in C/C++

Distribute and run LLMs with a single file.

A fast, local neural text to speech system

Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RI…

[CVPR 2024] GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splatting

From the Transistor to the Web Browser, a rough outline for a 12 week course

Exercises for Programming Massively Parrallel Processors