Finetune Llama 3.3, Mistral, Phi, Qwen 2.5 & Gemma LLMs 2-5x faster with 70% less memory

LLM inference in C/C++

A holistic way of understanding how Llama and its components run in practice, with code and detailed documentation.

A JIT assembler for x86/x64 architectures supporting MMX, SSE (1-4), AVX (1-2, 512), FPU, APX, and AVX10.2

ChatGPT web interface using the OpenAI API

Simple Cloudflare bypass for ChatGPT