A guidance language for controlling large language models.

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Langchain, Autogen, AG2, and CamelAI

🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text quality, relevance m…

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

🤖 The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transf…

A high-throughput and memory-efficient inference and serving engine for LLMs

The Selenium for Chatbots - Bots Testing Bots

Get your documents ready for gen AI

an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM

AutoEvals is a tool for quickly and easily evaluating AI model outputs using best practices.

Make websites accessible for AI agents

s1: Simple test-time scaling

Large datasets for conversational AI

A language for constraint-guided and efficient LLM programming.

Minimal keyword extraction with BERT

Repo of the code from the Medium article Metadata Metamorphosis: from plain Data to Enhanced insights with Retrieval Augmented Generation

Curated list of datasets and tools for post-training.

Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your permission every step of the way.

Roo Code (prev. Roo Cline) is an AI-powered autonomous coding agent that lives in your editor.

A large annotated semantic parsing corpus for developing natural language interfaces.

Profile-Based Long-Term Memory for AI Applications

Empowering RAG with a memory-based data interface for all-purpose applications!

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama mode…

Banishing LLM Hallucinations Requires Rethinking Generalization

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

A very simple framework for state-of-the-art Natural Language Processing (NLP)