Use PEFT or Full-parameter to finetune 450+ LLMs (Qwen2.5, InternLM3, GLM4, Llama3.3, Mistral, Yi1.5, Baichuan2, DeepSeek-R1, ...) and 150+ MLLMs (Qwen2.5-VL, Qwen2-Audio, Llama3.2-Vision, Llava, I…

A bidirectional pipeline parallelism algorithm for computation-communication overlap in V3/R1 training.

Open source alternative to Gemini Deep Research. Generate reports with AI based on search results.

Building DeepSeek R1 from Scratch

Open weights LLM from Google DeepMind.

Official Repo for Open-Reasoner-Zero

This is a replicate of DeepSeek-R1-Zero and DeepSeek-R1 training on small models with limited data

A reading list on LLM based Synthetic Data Generation 🔥

A collection of LLM papers, blogs, and projects, with a focus on OpenAI o1 🍓 and reasoning techniques.

AutoRAG 한국어 튜토리얼을 위한 레포입니다.

Fully open reproduction of DeepSeek-R1

NanoGPT (124M) in 3 minutes

Medical Graph RAG: Graph RAG for the Medical Data

Cosmos is a world model development platform that consists of world foundation models, tokenizers and video processing pipeline to accelerate the development of Physical AI at Robotics & AV labs. C…

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Get your documents ready for gen AI

RAG that intelligently adapts to your use case, data, and queries

Collection of awesome LLM apps with AI Agents and RAG using OpenAI, Anthropic, Gemini and opensource models.

KoAlpaca: 한국어 명령어를 이해하는 오픈소스 언어모델

HF Trainer + DeepSpeed로 다중 GPU 환경에서 LLaMA2-7B 사전학습

Code to reproduce experiments from the paper "Continual Pre-Training Mitigates Forgetting in Language and Vision" https://arxiv.org/abs/2205.09357

Code implementation of synthetic continued pretraining

Example project demonstrating how to implement GraphRAG

An example project demonstrating one approach to GraphRAG

한국어 의료 분야 특화 챗봇 프로젝트

Recipes for shrinking, optimizing, customizing cutting edge vision models. 💜

KAG is a logical form-guided reasoning and retrieval framework based on OpenSPG engine and LLMs. It is used to build logical reasoning and factual Q&A solutions for professional domain knowledge ba…

A curated list of resources about AI agents for Computer Use, including research papers, projects, frameworks, and tools.