A high-throughput and memory-efficient inference and serving engine for LLMs

Fully local web research and report writing assistant

An example repository for getting started with the Agent Inbox and LangGraph

New user experiences for interacting with agents

Universal LLM Deployment Engine with ML Compilation

High-performance In-browser LLM Inference Engine

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

Tenacious tool calling built on LangGraph

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

Building AI agents, atomically

AdalFlow: The library to build & auto-optimize LLM applications.

🦾 Take control of your AI agents

DSPy: The framework for programming—not prompting—language models

Educational framework exploring ergonomic, lightweight multi-agent orchestration. Managed by OpenAI Solution team.

Build LangChain Applications on AWS

This is a Phi Family of SLMs book for getting started with Phi Models. Phi a family of open sourced AI models developed by Microsoft. Phi models are the most capable and cost-effective small langua…

Official inference framework for 1-bit LLMs

Any model. Any hardware. Zero compromise. Built with @ziglang / @openxla / MLIR / @bazelbuild

Desktop app for prototyping and debugging LangGraph applications locally.

Streamlit and LangGraph Intersection Starters, LangGraph with Streamlit, Streamlit with LangGraph

Full toolkit for running an AI agent service built with LangGraph, FastAPI and Streamlit

The Python Risk Identification Tool for generative AI (PyRIT) is an open source framework built to empower security professionals and engineers to proactively identify risks in generative AI systems.

The giskard_hub library allows you to interact with the Giskard Hub, a platform that centralizes the validation process of LLM applications, empowering product teams to ensure all functional, busin…

🐢 Open-Source Evaluation & Testing for AI & LLM systems

One-click deploy of a Knowledge Graph powered RAG (GraphRAG) in Azure

The repository for all Azure OpenAI Samples complementing the OpenAI cookbook.