Large-scale, Informative, and Diverse Multi-round Chat Data (and Models)

Clean, minimal, accessible reproduction of DeepSeek R1-Zero

Fully open reproduction of DeepSeek-R1

Official implementation for "Automatic Chain of Thought Prompting in Large Language Models" (stay tuned & more will be updated)

DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence

DeepSeek Coder: Let the Code Write Itself

🚀🚀 「大模型」2小时完全从0训练26M的小参数GPT！🌏 Train a 26M-parameter GPT from scratch in just 2h!

SoTA LLM for converting natural language questions to SQL queries

DataComp for Language Models

This is a Phi Family of SLMs book for getting started with Phi Models. Phi a family of open sourced AI models developed by Microsoft. Phi models are the most capable and cost-effective small langua…

Efficient Image Captioning code in Torch, runs on GPU

NeuralTalk is a Python+numpy project for learning Multimodal Recurrent Neural Networks that describe images with sentences.

Multi-layer Recurrent Neural Networks (LSTM, GRU, RNN) for character-level language models in Torch

Reproducing Yann LeCun 1989 paper "Backpropagation Applied to Handwritten Zip Code Recognition", to my knowledge the earliest real-world application of a neural net trained with backpropagation.

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

Neural Networks: Zero to Hero

LLM101n: Let's build a Storyteller

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

Code for the manim-generated scenes used in 3blue1brown videos

Animation engine for explanatory math videos

A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

Video+code lecture on building nanoGPT from scratch

MiniCPM-o 2.6: A GPT-4o Level MLLM for Vision, Speech and Multimodal Live Streaming on Your Phone

Open-Sora: Democratizing Efficient Video Production for All

FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, le…

基于大模型搭建的聊天机器人，同时支持 微信公众号、企业微信应用、飞书、钉钉 等接入，可选择GPT3.5/GPT-4o/GPT-o1/ DeepSeek/Claude/文心一言/讯飞星火/通义千问/ Gemini/GLM-4/Claude/Kimi/LinkAI，能处理文本、语音和图片，访问操作系统和互联网，支持基于自有知识库进行定制企业智能客服。

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

A multi-voice TTS system trained with an emphasis on quality

A Fundamental End-to-End Speech Recognition Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Recognition, Voice Activity Detection, Text Post-processing etc.