Experiments preparing data for fine-tuning and RAG using DepMap data

LLM training in simple, raw C/CUDA

misc LLM code that did not go in the other repos

DSPy: The framework for programming—not prompting—language models

In-Context Learning for eXtreme Multi-Label Classification (XMC) using only a handful of examples.

Code for the paper "LASER: LLM Agent with State-Space Exploration for Web Navigation"

Google Deepmind's PromptBreeder for automated prompt engineering implemented in langchain expression language.

Safety Score for Pre-Trained Language Models

Low-level shared SEED java library

Official inference library for Mistral models

Shared SEED java library

High accuracy RAG for answering questions from scientific documents with citations

A web scraping tool to systematically extract the text of scientific papers and corresponding metadata from university accessible journals.

Inference code for Llama models

Example models using DeepSpeed

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama mode…

Scrape papers from OpenReview using OpenReview API

PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI

Fast and memory-efficient exact attention

ECP-CANDLE Benchmarks

LangChain examples for AuroraGPT

Easily create large video dataset from video urls

Tools for whole slide image (WSI) processing. Especially for (pairwise) patch extraction, annotation parsing and data preparation for deep learning purposes.

Some basic examples to get running on sunspot

Using a semidefinite programming approach complemented with side information to study and model the vector fields of the dynamics of the human microbiome