This is the implementation repository of our OSDI'23 paper: SMART: A High-Performance Adaptive Radix Tree for Disaggregated Memory.

Topology-aware placement algorithm

This is a library to use with Robinhood Financial App. It currently supports trading crypto-currencies, options, and stocks. In addition, it can be used to get real time ticker information, assess …

A comprehensive toolkit for setting up a Kind (Kubernetes in Docker) cluster with NVIDIA GPU support, including automated installation, GPU operator deployment, and DCGM-based monitoring capabiliti…

SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges. [NeurIPS 2…

extract slides from videos

A tool to detect infrastructure issues on cloud native AI systems

Making Long-Context LLM Inference 10x Faster and 10x Cheaper

The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery 🧑‍🔬

Finetune a LLM to speak like you based on your WhatsApp Conversations

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality

project public page

Enjoy the magic of Diffusion models!

🙌 OpenHands: Code Less, Make More

Cloud Native Benchmarking of Foundation Models

Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)

HeyGen's open source solution

Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

HeyGen's open source solution

from deekfakes' faceswap: https://www.reddit.com/user/deepfakes/

Deepfakes Software For All

DeepFaceLab is the leading software for creating deepfakes.

DSPy: The framework for programming—not prompting—language models

[MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving

SGLang is a fast serving framework for large language models and vision language models.

Help developers navigating through the codebase smoothly

Kubernetes MutatingAdmissionWebhook that injects environment variables into pod containers

Serverless LLM Serving for Everyone.