MTEB: Massive Text Embedding Benchmark

A very simple Salesforce.com REST API client for Python

A tool for generating fake data that has relations between tables.

Experiments on including metadata such as URLs, timestamps, website descriptions and HTML tags during pretraining.

Evals is a framework for evaluating OpenAI models and an open-source registry of benchmarks.

A framework for the evaluation of autoregressive code generation language models.

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Drive a browser with Cohere

🤗 The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models

Expanding natural instructions

A framework for few-shot evaluation of autoregressive language models.

Toolkit for creating, sharing and using natural language prompts.

Code and Data for Evaluation WG

REL: Radboud Entity Linker

Tools for managing datasets for governance and training.

Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)

NL-Augmenter 🦎 → 🐍 A Collaborative Repository of Natural Language Transformations

Shared code for training sentence embeddings with Flax / JAX

A neural word aligner based on multilingual BERT

It is aimed at calculation of affective scores of videos using the audio visual feature and further analyzing the affective pattern generated from the YouTube watching history of an individual to p…

Evaluating Gender Bias in NLI models

Codebase for the project

Entity Linker solution

Repository to track the progress in Natural Language Processing (NLP), including the datasets and the current state-of-the-art for the most common NLP tasks.