Awesome-Consistency-Models

Awesome list of consistency models

Conference

• Consistency Models (ICML 2023)[paper]

• Improved Techniques for Training Consistency Models (ICLR 2024)[paper]

• Consistency Trajectory Models: Learning Probability Flow ODE Trajectory of Diffusion (ICLR 2024)[paper]

• ACT-Diffusion: Efficient Adversarial Consistency Training for One-step Diffusion Models (CVPR 2024)[paper]

• Consistency Large Language Models: A Family of Efficient Parallel Decoders (ICML 2024)[paper]

• Consistency Policy: Accelerated Visuomotor Policies via Consistency Distillation (RSS 2024) [paper]

• CoMoSpeech: One-Step Speech and Singing Voice Synthesis via Consistency Model (ACM MM 2023)[paper]

• Phased Consistency Model (NeurIPS 2024) [paper]

• AnimateLCM: Accelerating the Animation of Personalized Diffusion Models and Adapters with Decoupled Consistency Learning (SIGGRAPH ASIA TCS 2024)[paper]

• Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesis (NeurIPS 2024) [paper]

• Consistency Diffusion Bridge Models. (NeurIPS 2024) [paper]

Preprint

• RL for Consistency Models: Faster Reward Guided Text-to-Image Generation (arXiv 2024) [paper]

• Latent Consistency Models: Synthesizing High-Resolution Images with Few-step Inference (arXiv 2023) [paper]

• Music Consistency Models (arXiv 2024) [paper]

• Multistep Consistency Models (arXiv 2024) [paper]

• Towards a mathematical theory for consistency training in diffusion models (arXiv 2024) [paper]

• Convergence guarantee for consistency models (arXiv 2023) [paper]

• SCott: Accelerating Diffusion Models with Stochastic Consistency Distillation (arXiv 2024) [paper]

• CCM: Adding Conditional Controls to Text-to-Image Consistency Models (arXiv 2023) [paper]

• Bidirectional Consistency Models (arXiv 2024) [paper]

• Generalized Consistency Trajectory Models for Image Manipulation (arXiv 2024) [paper]

• Consistency Models Made Easy (arXiv 2024) [Blog] [paper]

• TRACT

• BOOT

• Motion Consistency Model: Accelerating Video Diffusion with Disentangled Motion-Appearance Distillation. (arXiv 2024) [paper]

• ManiCM: Real-time 3D Diffusion Policy via Consistency Model for Robotic Manipulation (arXiv 2024) [paper]

• Target-Driven Distillation: Consistency Distillation with Target Timestep Selection and Decoupled Guidance (arXiv 2024) [paper]

• Presto! Distilling Steps and Layers for Accelerating Music Generation (arXiv 2024) [paper]

• Simplifying, Stabilizing and Scaling Continuous-Time Consistency Models (arXiv 2024) [paper]

• Trajectory consistency distillation. (arXiv 2024) [paper]

• Stable Consistency Tuning: Understanding and Improving Consistency Models (arXiv 2024) [paper]

• One Step Diffusion via Shortcut Models (arXiv 2024) [paper]

Further Reading

• Score-Based Generative Modeling through Stochastic Differential Equations (ICLR 2021) [paper]

• Flow Matching for Generative Modeling (ICLR 2023) [paper]

• Elucidating the Design Space of Diffusion-Based Generative Models (NeurIPS 2022) [paper]

• Denoising Diffusion Probabilistic Models (NeurIPS 2020) [paper]

• Stable Target Field for Reduced Variance Score Estimation in Diffusion Models (ICLR 2023) [paper]

• Denoising Diffusion Implicit Models (ICLR 2021) [paper]

• DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps (NeurIPS 2022) [paper]

• Progressive Distillation for Fast Sampling of Diffusion Models (ICLR 2022) [paper]

• On Distillation of Guided Diffusion Models (CVPR 2023) [paper]

• SOFT DIFFUSION SCORE MATCHING FOR GENERAL CORRUPTIONS

• Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generation (ICML 2024) [paper]

• Discrete Flow Maching (arXiv 2024) [paper]

• Rectified Diffusion: Straightness Is Not Your Need in Rectified Flow (arXiv 2024) [paper]

• Fast ODE-based Sampling for Diffusion Models in Around 5 Steps (ICML 2024) [paper]

• AN OVERLOOKED INGREDIENT FOR RECTIFIED FLOW: REAL SAMPLES (OpenReview 2024) [paper]

• SwiftBrush: One-Step Text-to-Image Diffusion Model with Variational Score Distillation (CVPR 2024) [paper]

• Inconsistencies In Consistency Models: Better ODE Solving Does Not Imply Better Samples. (NeurIPS 2024 Workshop) [paper]

• Understanding Hallucinations in Diffusion Models through Mode Interpolation [paper]

• Rethinking Score Distillation as a Bridge Between Image Distributions (arXiv 2024) [paper]

• One-Step Diffusion Distillation through Score Implicit Matching. (NeurIPS 2024) [Paper]

• The Fokker Planck Equation and Diffusion Models. [Blog]

• Generative AI and Foundation Models, Spring 2024 by Ernest K. Ryu [Page].

• A Visual Dive into Conditional Flow Matching [Blog]

If you find some work missing, please PR.