GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

LLM inference in C/C++

MLX: An array framework for Apple silicon

Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk

Open-source simulator for autonomous driving research.

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

The Fast Cross-Platform Package Manager

C++ DataFrame for statistical, Financial, and ML analysis -- in modern C++ using native types and contiguous memory storage

CuLE: A CUDA port of the Atari Learning Environment (ALE)

micrograd, but in C++ and better