Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

Evaluation tool for LLM QA chains

Build, evaluate, understand, and fix LLM-based apps

Supercharge Your LLM Application Evaluations 🚀

ACL 2023: Evaluating Open-Domain Question Answering in the Era of Large Language Models