DataComp for Language Models

Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'

Public repo for the NeurIPS 2023 paper "Unlimiformer: Long-Range Transformers with Unlimited Length Input"

Data and tools for generating and inspecting OLMo pre-training data.

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule

Code for our NeurIPS 2022 paper

Reverse engineered ChatGPT API

A simple tool to update bib entries with their official information (e.g., DBLP or the ACL anthology).

The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".