GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

LLM inference in C/C++

Distribute and run LLMs with a single file.

Tensor library for machine learning

WasmEdge is a lightweight, high-performance, and extensible WebAssembly runtime for cloud native, edge, and decentralized applications. It powers serverless apps, embedded functions, microservices,…

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

Open-source graph database, tuned for dynamic analytics environments. Easy to adopt, scale and own.

Efficient, Flexible and Portable Structured Generation

WebAssembly binding for llama.cpp - Enabling on-browser LLM inference