Schlampig
Follow
PTM
An original implementation of "MetaICL Learning to Learn In Context" by Sewon Min, Mike Lewis, Luke Zettlemoyer and Hannaneh Hajishirzi
KdConv: A Chinese Multi-domain Dialogue Dataset Towards Multi-turn Knowledge-driven Conversation
Interactive deep learning book with multi-framework code, math, and discussions. Adopted at 500 universities from 70 countries including Stanford, MIT, Harvard, and Cambridge.
Making large AI models cheaper, faster and more accessible
This repo contains codes and instructions for baselines in the VLUE benchmark.
Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合
Self-hosted, lightweight server and website monitoring and O&M tool
LERT: A Linguistically-motivated Pre-trained Language Model（语言学信息增强的预训练模型LERT）
Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.
Open-source pre-training implementation of Google's LaMDA in PyTorch. Adding RLHF similar to ChatGPT.
Examples and guides for using the OpenAI API
中文版的ai地牢，直接使用的openai的ChatGPT api作为讲故事的模型。
⚡️ Python client for the unofficial ChatGPT API with auto token regeneration, conversation tracking, proxy support and more.
[NeurIPS 2021] COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretraining
bert-base-chinese example
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM
ChatYuan: Large Language Model for Dialogue in Chinese and English
CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation
MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。