A high-throughput and memory-efficient inference and serving engine for LLMs

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Finetune Llama 3.1, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

Build resilient language agents as graphs.

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

🤖 Awesome list of AI Agents

Flower: A Friendly Federated Learning Framework

Perform data science on data that remains in someone else's server

📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥

Build a Jekyll blog in minutes, without touching the command line.

GPT based autonomous agent that does online comprehensive research on any given topic

LLM inference in C/C++

LLM training in simple, raw C/CUDA

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting yo…

A natural language interface for computers

FedScale is a scalable and extensible open-source federated learning (FL) engine and benchmark.

Reference implementation of Mistral AI 7B v0.1 model.

experiments with inference on llama

Machine Learning Engineering Open Book

A hobby programming language 🔥

Training and serving large-scale neural networks with auto parallelization.

A Collection of Variational Autoencoders (VAE) in PyTorch.

Assignments for Berkeley CS 285: Deep Reinforcement Learning (Fall 2022)