Secure open source cloud runtime for AI apps & AI agents

Build multimodal language agents for fast prototype and production

OO for LLMs

Official repository for "DynaSaur: Large Language Agents Beyond Predefined Actions"

🤗 smolagents: a barebones library for agents. Agents write python code to call tools and orchestrate other agents.

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

Structured Text Generation

RAG that intelligently adapts to your use case, data, and queries

Cross-Platform, GPU Accelerated Whisper 🏎️

Optimizing inference proxy for LLMs

Late Interaction Models Training & Retrieval

A timeline of notable generative AI events

SGLang is a fast serving framework for large language models and vision language models.

This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. RAG systems combine information retrieval with generative models to provide accurate and cont…

Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cross-encoders and more. Created by Prithivi Da, open for PRs & C…

A playbook for systematically maximizing the performance of deep learning models.

Superfast AI decision making and intelligent processing of multi-modal data.

Provides a common interface to many IR ranking datasets.

SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges. [NeurIPS 2…

Machine Learning Engineering Open Book

Toolkit to segment text into sentences or other semantic units in a robust, efficient and adaptable way.

High-speed Large Language Model Serving for Local Deployment

Mamba SSM architecture

A Unified Library for Parameter-Efficient and Modular Transfer Learning

ColBERT: state-of-the-art neural search (SIGIR'20, TACL'21, NeurIPS'21, NAACL'22, CIKM'22, ACL'23, EMNLP'23)

Tensor library for machine learning

LLM inference in C/C++

This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi.

Is ChatGPT Good at Search? LLMs as Re-Ranking Agent [EMNLP 2023 Outstanding Paper Award]

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.