An Open Source Machine Learning Framework for Everyone

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

LLM inference in C/C++

Unsupervised text tokenizer for Neural Network-based text generation.

Transformer related optimization, including BERT, GPT

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.