democratize-llms
A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)
TextGen: Implementation of Text Generation models, include LLaMA, BLOOM, GPT2, BART, T5, SongNet and so on. 文本生成模型,实现了包括LLaMA,ChatGLM,BLOOM,GPT2,Seq2Seq,BART,T5,UDA等模型的训练和预测,开箱即用。
Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
A 13B large language model developed by Baichuan Intelligent Technology
Firefly: 大模型训练工具,支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型
LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath
The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.