Summarize existing representative LLMs text datasets.

Robust recipes to align language models with human and AI preferences

Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型

中文公开聊天语料库

⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)

Continual Learning of Large Language Models: A Comprehensive Survey

👨‍💻 An awesome and curated list of best code-LLM for research.