Toolkit for linearizing PDFs for LLM datasets/training

Easy-to-use and Fast NLP library with awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications.

An open platform for training, serving, and evaluating large languages. Release repo for Vicuna and FastChat-T5.

FlagAI (Fast LArge-scale General AI models) is a fast, easy-to-use and extensible toolkit for large-scale model.

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Example models using DeepSpeed

decentralising the Ai Industry, just some language model api's...

Automatically split your PyTorch models on multiple GPUs for training & inference

Comprehensive Python Cheatsheet

ChatGLM-6B：开源双语对话语言模型 | An Open Bilingual Dialogue Language Model

GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)

A Fundamental End-to-End Speech Recognition Toolkit

Reverse engineered ChatGPT API

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

🚀 RocketQA, dense retrieval for information retrieval and question answering, including both Chinese and English state-of-the-art models.

Create UIs for your machine learning model in Python in 3 minutes

EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit

Source code for paper "Black-Box Tuning for Language-Model-as-a-Service"

An Open-Source Framework for Prompt-Learning.

Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）

Label Studio is a multi-type data labeling and annotation tool with standardized output format

Open source annotation tool for machine learning practitioners.

pycorrector is a toolkit for text error correction. 文本纠错，Kenlm，Seq2Seq_Attention，BERT，MacBERT，ELECTRA，ERNIE，Transformer等模型实现，开箱即用。

All Algorithms implemented in Python

“悟道”模型

An Industrial Grade Federated Learning Framework