React UI + elegant infrastructure for AI Copilots, in-app AI agents, AI chatbots, and AI-powered Textareas 🪁

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting yo…

Data processing with ML, LLM and Vision LLM

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Minimalist ML framework for Rust

Blazingly fast LLM inference.

Manage GPU clusters for running AI models

Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!

Rust library for generating vector embeddings, reranking locally

Late Interaction Models Training & Retrieval

C grammar for tree-sitter

CSS grammar for Tree-sitter

HTML grammar for Tree-sitter

Java grammar for tree-sitter

Markdown grammar for tree-sitter

SQL grammar for tree-sitter

LLM101n: Let's build a Storyteller

Agentic components of the Llama Stack APIs

Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.

Distribute and run LLMs with a single file.

Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"

⏩ Continue is the leading open-source AI code assistant. You can connect any models and any context to build custom autocomplete and chat experiences inside VS Code and JetBrains

Unified framework for building enterprise RAG pipelines with small, specialized models

Implementation for MatMul-free LM.

😎 Awesome list of tools and projects with the awesome LangChain framework

Easily train a good VC model with voice data <= 10 mins!

An AI agent that writes (actually useful) code for you

Port of OpenAI's Whisper model in C/C++

Build AI assistants that interact with your systems

DSPy: The framework for programming—not prompting—language models