Purpose: We aim to provide a summary of diffusion model-based image processing, including restoration, enhancement, coding, and quality assessment. More papers will be summarized.

Xin Li, Yulin Ren, Xin Jin, Cuiling Lan, Xingrui Wang, Wenjun Zeng, Xinchao Wang, Zhibo Chen

University of Science and Technology of China (USTC), National University of Singapore (NUS), Microsoft Research Asia (MSRA), Eastern Institute of Technology (EIT)

Brief intro: The survey for diffusion model-based IR has been released.

🔖 News!!!

• 2023-09-19: Updated new related works before 15/09/2023 in this GitHub.
• 2023-11-24: Updated new related works before 10/11/2023 in this GitHub.
• 2023-12-25: Updated new related works before 25/12/2023 in this GitHub.
• 2024-01-25: Updated new related works before 25/01/2024 in this GitHub.
• 2024-03-25: Updated new related works before 25/03/2024 in this GitHub.
• 2024-04-25: Updated new related works before 25/04/2024 in this GitHub.
• 2024-06-25: Updated new related works before 25/06/2024 in this GitHub.
• 2024-08-25: Updated new related works before 25/08/2024 in this GitHub.
• 2024-10-25: Updated new related works before 25/10/2024 in this GitHub.
• 2024-12-25: Updated new related works before 25/12/2024 in this GitHub.

📌 About new works. If you want to incorporate your studies (e.g., the link of paper or project) on diffusion model-based image processing in this repository. Welcome to raise an issue or email us. We will incorporate it into this repository and our survey report as soon as possible.

🌟 Features

• Survey for diffusion model-based Image Restoration (Arxiv version is released)
• Summary for diffusion model-based Image/Video Compression
• Summary for diffusion model-based Quality Assessment

Diffusion model-based Image Restoration/Enhancement

Table of contents

• Diffusion model for Image Super resolution
• Diffusion model for Image Restoration
• Diffusion model for Image Inpainting
• Diffusion model for Image Shadow Removal
• Diffusion model for Image Denoising
• Diffusion model for Image Dehazing
• Diffusion model for Image Deblurring
• Diffusion model for Medical IR
• Diffusion model for Low-Light Enchancement
• Diffusion model for other tasks
• Benchmark Datasets
• Diffusion model for Image/video compression
• Diffusion model for Image/video quality assessment

Image Super-Resolution

Models	Paper	First Author	Training Way	Venue	Topic	Project
SR3	Image super-resolution via iterative refinement	Chitwan Saharia	Supervised	TPAMI2022	Super-resolution
SRDiff	SRDiff: Single Image Super-Resolution with Diffusion Probabilistic Models	Haoying Li	Supervised	Neurocomputing 2022	Super-resolution
SDE-SR	Face super-resolution using stochastic differential equations	Marcelo dos Santos	Supervised	SIBGRAPI 2022	Super-resolution
IDM	Implicit diffusion models for continuous super-resolution	Sicheng Gao	Supervised	CVPR2023	Super-resolution
PromptSR	Image Super-Resolution with Text Prompt Diffusion	Zheng Chen	Supervised	Preprint'23	Super-resolution
DiffIR	DiffIR: Efficient diffusion model for image restoration	Bin Xia	Supervised	ICCV 2023	Super-resolution
CDM	Cascaded Diffusion Models for High Fidelity Image Generation	Jonathan Ho	Supervised	J.Mach.Learn.Res 2022	Super-resolution
StableSR	Exploiting diffusion prior for real-world image super-resolution	Jianyi Wang	Supervised	Preprint'23	Real-World Super-resolution
ResShift	ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shifting	Zongsheng Yue	Supervised	NeurIPS 2023	Real-World Super-resolution
DFOSD	Distillation-Free One-Step Diffusion for Real-World Image Super-Resolution	Jianze Li	Supervised	Preprint'24	Real-World Super-resolution
ECDP	Efficient Conditional Diffusion Model with Probability Flow Sampling for Image Super-resolution	Yutao Yuan	Supervised	AAAI 2024	Super-resolution
SinSR	SinSR: Diffusion-Based Image Super-Resolution in a Single Step	Yufei Wang	Supervised	CVPR 2024	Real-World Super-resolution
TextDiff	TextDiff: Mask-Guided Residual Diffusion Models for Scene Text Image Super-Resolution	Baolin Liu	Supervised	Preprint'23	Super-resolution
PASD	Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylization	Tao Yang	Supervised	Preprint'23	Super-resolution
CCSR	Improving the Stability of Diffusion Models for Content Consistent Super-Resolution	Lingchen Sun	Supervised	Preprint'23	Super-resolution
EDiffSR	EDiffSR: An Efficient Diffusion Probabilistic Model for Remote Sensing Image Super-Resolution	Yi Xiao	Supervised	IEEE TGRS	Super-resolution
SeeSR	SeeSR: Towards Semantics-Aware Real-World Image Super-Resolution	Rongyuan Wu	Supervised	Preprint'23	Super-resolution
CoSeR	CoSeR: Bridging Image and Language for Cognitive Super-Resolution	Haoze Sun	Supervised	CVPR 2024	Super-resolution
BI-DiffSR	Binarized Diffusion Model for Image Super-Resolution	Zheng Chen	Supervised	NeurIPS 2024	Super-resolution
DoSSR	Taming Diffusion Prior for Image Super-Resolution with Domain Shift SDEs	Qinpeng Cui	Supervised	NeurIPS 2024	Super-resolution
DaLPSR	DaLPSR: Leverage Degradation-Aligned Language Prompt for Real-World Image Super-Resolution	Aiwen Jiang	Supervised	Preprint'24	Super-resolution
FDDiff	Frequency-Domain Refinement with Multiscale Diffusion for Super Resolution	Xingjian Wang	Supervised	Preprint'24	Super-resolution
PartDiff	PartDiff: Image Super-resolution with Partial Diffusion Models	Kai Zhao	Supervised	Preprint'23	Super-resolution
DeeDSR	DeeDSR: Towards Real-World Image Super-Resolution via Degradation-Aware Stable Diffusion	Chunyang Bi	Supervised	Preprint'24	(Real-World) Super-resolution
TDDSR	TDDSR: SINGLE-STEP DIFFUSION WITH TWO DISCRIMINATORS FOR SUPER RESOLUTION	Sohwi Kim	Supervised	Preprint'24	Super-resolution
DiT-SR	Effective Diffusion Transformer Architecture for Image Super-Resolution	Kun Cheng	Supervised	Preprint'24	Super-resolution
SR3+	Denoising diffusion probabilistic models for robust image super-resolution in the wild	Hshmat Sahak	Supervised	Preprint'23	(Real-World) Super-resolution
DKP	A Dynamic Kernel Prior Model for Unsupervised Blind Image Super-Resolution	Zhixiong Yang	Supervised	CVPR 2024	(Real-World) Super-resolution
Diwa	Waving Goodbye to Low-Res: A Diffusion-Wavelet Approach for Image Super-Resolution	Brian Moser	Supervised	Preprint'23	Super-resolution
YODA	YODA: You Only Diffuse Areas. An Area-Masked Diffusion Approach For Image Super-Resolution	Brian B. Moser	Supervised	Preprint'23	Super-resolution
CDPMSR	CDPMSR: Conditional Diffusion Probabilistic Models for Single Image Super-Resolution	Axi Niu	Supervised	Preprint'23	Super-resolution
ACDPMSR	ACDMSR: Accelerated Conditional Diffusion Models for Single Image Super-Resolution	Axi Niu	Supervised	Preprint'23	Super-resolution
ResDiff	ResDiff: Combining cnn and diffusion model for image superresolution	Shuyao Shang	Supervised	Preprint'23	Super-resolution
OSEDiff	One-Step Effective Diffusion Network for Real-World Image Super-Resolution	Rongyuan Wu	Supervised	Preprint'24	Super-resolution
DiffTSR	Diffusion-based Blind Text Image Super-Resolution	Yuzhe Zhang	Supervised	CVPR 2024	Super-resolution
SAM-DiffSR	SAM-DiffSR: Structure-Modulated Diffusion Model for Image Super-Resolution	Chengcheng Wang	Supervised	Preprint'24	Super-resolution
BlindDiff	BlindDiff: Empowering Degradation Modelling in Diffusion Models for Blind Image Super-Resolution	Feng Li	Supervised	Preprint'24	Super-resolution
XPSR	XPSR: Cross-modal Priors for Diffusion-based Image Super-Resolution	Yunpeng Qu	Supervised	Preprint'24	Super-resolution
--	Text-guided Explorable Image Super-resolution	Kanchana Vaishnavi Gandikota	Zero-Shot	Preprint'24	Super-resolution
--	Image Super-resolution Via Latent Diffusion: A Sampling-space Mixture Of Experts And Frequency-augmented Decoder Approach	Feng Luo	Supervised	Preprint'23	Super-resolution
--	Solving Diffusion ODEs with Optimal Boundary Conditions for Better Image Super-Resolution	Yiyang Ma	Supervised	Preprint'23	Super-resolution

Image Restoration

Model	Paper	First Author	Training Way	Venue	Topic	Project
Palette	Palette: Image-toimage diffusion models	Chitwan Saharia	Supervised	SIGGRAPH 2022	Multi-task Restoration
Refusion	Refusion: Enabling large-size realistic image restoration with latent-space diffusion models	Ziwei Luo	Supervised	CVPRW 2023	Multi-task Restoration
SUPIR	Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wild	Fanghua Yu	Supervised	CVPR 2024	Image Restoration
Weather-Diff	Restoring vision in adverse weather conditions with patch-based denoising diffusion models	Ozan Özdenizci	Supervised	TPAMI2022	Multi-task Restoration
IR-SDE	Image Restoration with Mean-Reverting Stochastic Differential Equations	Ziwei Luo	Supervised	ICML 2023	Multi-task Restoration
DAVI	Diffusion Prior-Based Amortized Variational Inference for Noisy Inverse Problems	Sojin Lee	Supervised	ECCV 2024	Multi-task Restoration
SUD^2	SUD ˆ2: Supervision by denoising diffusion models for image reconstruction	Matthew A. Chan	Supervised	Preprint'23	Multi-task Restoration
InDI	Inversion by direct iteration: An alternative to denoising diffusion for image restoration	Mauricio Delbracio	Supervised	Preprint'22	Multi-task Restoration
AdaptBIR	AdaptBIR: Adaptive Blind Image Restoration with latent diffusion prior for higher fidelity	Yingqi Liu	Supervised	Pattern Recognition 24	Image Restoration
ILVR	ILVR: Conditioning method for denoising diffusion probabilistic models	Jooyoung Choi	Zero-Shot	ICCV2021	Image Restoration
CCDF	Come-closer-diffusefaster: Accelerating conditional diffusion models for inverse problems through stochastic contraction	Hyungjin Chung	Zero-Shot	CVPR2022	Multi-task Restoration
SNIPS	SNIPS: Solving noisy inverse problems stochastically	Bahjat Kawa	Zero-Shot	NeurIPS 2021	Multi-task Restoration
DDRM	Denoising diffusion restoration models	Bahjat Kawar	Zero-Shot	ICLR2022	Multi-task Restoration
DDNM	Zero-Shot image restoration using denoising diffusion null-space model	Yinhuai Wang	Zero-Shot	ICLR2023	Multi-task Restoration
DPS	Diffusion Posterior Sampling for General Noisy Inverse Problems	Hyungjin Chung	Zero-Shot	ICLR 2023	Multi-task Restoration
DiffPIR	Denoising diffusion models for plug-and-play image restoration	Yuanzhi Zhu	Zero-Shot	CVPR 2023	Multi-task Restoration
DPPS	Diffusion Posterior Proximal Sampling for Image Restoration	Hongjie Wu	Zero-Shot	ACMM 2024 Oral	Multi-task Restoration
DiracDiffusion	DiracDiffusion: Denoising and incremental reconstruction with assured data-consistency	Zalan Fabian	Zero-Shot	Preprint' 23	Multi-task Restoration
IIGDM	Pseudoinverse-guided diffusion models for inverse problems	Jiaming Song	Zero-Shot	ICLR 2023	Multi-task Restoration
GDP	Generative diffusion prior for unified image restoration and enhancement	Ben Fei	Zero-Shot	CVPR2023	Multi-task Restoration
RED-Diff	A variational perspective on solving inverse problems with diffusion models	Morteza Mardani	Zero-Shot	PrePrint'23	Multi-task Restoration
DeqIR	Deep Equilibrium Diffusion Restoration with Parallel Sampling	Jiezhang Cao	Zero-Shot	CVPR 2024	Multi-task Restoration
SaFaRI	Spatial-and-Frequency-aware Restoration method for Images based on Diffusion Models	Kyungsung Lee	Zero-Shot	PrePrint'24	Multi-task Restoration
OmniSSR	OmniSSR: Zero-Shot Omnidirectional Image Super-Resolution using Stable Diffusion Model	Runyi Li	Zero-Shot	Preprint'24	Blind Restoration
DriftRec	DriftRec: Adapting diffusion models to blind image restoration tasks	Simon Welker	Supervised	Preprint'22	Blind Restoration
DR2	DR2: Diffusion-based robust degradation remover for blind face restoration	Zhixin Wang	Zero-Shot	CVPR2023	Blind Face Restoration
PFStorer	PFStorer: Personalized Face Restoration and Super-Resolution	Tuomas Varanka	Supervised	Preprint'24	Blind Face Restoration
DiffBFR	DiffBFR: Bootstrapping diffusion model towards blind face restoration	Xinmin Qiu	Supervised	Preprint'23	Blind Face Restoration
DifFace	DifFace: Blind face restoration with diffused error contraction	Zongsheng Yu	Zero-Shot	PrePrint'23	Blind Restoration
--	Towards Unsupervised Blind Face Restoration using Diffusion Prior	Tianshu Kuai	Supervised	PrePrint'24	Blind Restoration
GibbsDDRM	GibbsDDRM: A partially collapsed gibbs sampler for solving blind inverse problems with denoising diffusion restoration	Naoki Murata	Zero-Shot	ICML 2023	Blind Restoration
ADIR	ADIR: Adaptive diffusion for image reconstruction	Shady Abu-Hussein	Zero-Shot	PrePrint'22	Blind Restoration
PSLD	Solving Linear Inverse Problems Provably via Posterior Sampling with Latent Diffusion Models	Litu Rout	Zero-Shot	PrePrint'23	Image Restoration
IDM	Towards Authentic Face Restoration with Iterative Diffusion Models and Beyond	Yang Zhao	Supervised	ICCV 2023	Face Restoration
DiffBIR	DiffBIR: Towards Blind Image Restoration with Generative Diffusion Prior	Xinqi Lin	Supervised	Preprint' 2023	Image Restoration
RDDM	Residual Denoising Diffusion Models	Jiawei Liu	Supervised	Preprint' 2023	Image Restoration
C2F-DFT	Learning A Coarse-to-Fine Diffusion Transformer for Image Restoration	Liyan Wang	Supervised	Preprint' 2023	Image Restoration
Diff-Plugin	Diff-Plugin: Revitalizing Details for Diffusion-based Low-level tasks	Yuhao Liu	Supervised	CVPR 2024	All-in-one Restoration
DDPG	Image Restoration by Denoising Diffusion Models with Iteratively Preconditioned Guidance	Tomer Garber	Zero-Shot	CVPR 2024	Image Restoration
DiffUIR	Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Model	Dian Zheng	Supervised	CVPR 2024	Image Restoration
DMPlug	DMPlug: A Plug-in Method for Solving Inverse Problems with Diffusion Models	Hengkang Wang	Supervised	NeurIPS 2024	Image Restoration
MPerceiver	Multimodal Prompt Perceiver: Empower Adaptiveness, Generalizability and Fidelity for All-in-One Image Restoration	Yuang Ai	Supervised	CVPR 2024	All-in-one Restoration
MCGdiff	Monte Carlo guided Diffusion for Bayesian linear inverse problems	Gabriel Cardoso	Zero-Shot	Preprint' 2023	Image Restoration
PromptFix	PromptFix: You Prompt and We Fix the Photo	Yongsheng Yu	Supervised	Preprint' 2024	Image Restoration
AutoDIR	AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusion	Yitong Jiang	Supervised	Preprint' 2023	Image Restoration
DiffLoss	Using diffusion model as constraint: Empower Image Restoration Network Training with Diffusion Model	Jiangtong Tan	Supervised	Preprint' 2024	Image Restoration
ZeroAIR	Exploiting Diffusion Priors for All-in-One Image Restoration	Yuanbiao Gou	Supervised	Preprint' 2023	Image Restoration
FastDiffusionEM	Fast Diffusion EM: a diffusion model for blind inverse problems with application to deconvolution	Charles Laroche	Supervised	WACV 2024	Blind Image Restoration
P2L	PROMPT-TUNING LATENT DIFFUSION MODELS FOR INVERSE PROBLEMS	Hyungjin Chung	Supervised	Preprint' 2023	Image Restoration
JCDM	Joint Conditional Diffusion Model for Image Restoration with Mixed Degradations	Yufeng Yue	Supervised	Preprint' 2024	Image Restoration
DACLIP-IR	Photo-Realistic Image Restoration in the Wild with Controlled Vision-Language Models	Ziwei Luo	Supervised	Preprint' 2024	Image Restoration
MoE-DiffIR	MoE-DiffIR: Task-customized Diffusion Priors for Universal Compressed Image Restoration	Yulin Ren	Supervised	ECCV 2024	Image Restoration
Noise-DA	Denoising as Adaptation: Noise-Space Domain Adaptation for Image Restoration	Kang Liao	Supervised	Preprint' 2024	Image Restoration
T^3^-DiffWeather	Teaching Tailored to Talent: Adverse Weather Restoration via Prompt Pool and Depth-Anything Constraint	Sixiang Chen	Supervised	ECCV 2024	Adverse Weather Restoration
ReviveDiff	ReviveDiff: A Universal Diffusion Model for Restoring Images in Adverse Weather Conditions	Wenfeng Huang	Supervised	Preprint' 24	Adverse Weather Restoration
Diff-Restorer	Diff-Restorer: Unleashing Visual Prompts for Diffusion-based Universal Image Restoration	Yuhong Zhang	Supervised	Preprint' 2024	Image Restoration
--	Diffusion Posterior Proximal Sampling for Image Restoration	Hongjie Wu	Zero-Shot	Preprint'24	Multi-task Restoration
--	Multiscale Structure Guided Diffusion for Image Deblurring	Mengwei Ren	Supervised	Preprint'22	Blind Restoration
--	Synthesizing realistic image restoration training pairs: A diffusion approach	Tao Yang	Supervised	Preprint'22	Blind Restoration

Image Inpainting

Model	Paper	First Author	Training Way	Venue	Topic	Project
RePaint	RePaint: Inpainting using denoising diffusion probabilistic models	Andreas Lugmayr	Zero-Shot	CVPR2022	Image Inpainting
CoPaint	Towards coherent image inpainting using denoising diffusion implicit models	Guanhua Zhang	Zero-Shot	PrePrint'23	Image Inpainting
PVA	Personalized Face Inpainting with Diffusion Models by Parallel Visual Attention	Jianjin Xu	Zero-Shot	PrePrint'23	Image Inpainting

Image Shadow Removal

Model	Paper	First Author	Training Way	Venue	Topic	Project
BCDiff	Boundary-Aware Divide and Conquer: A Diffusion-based Solution for Unsupervised Shadow Removal	Lanqing Guo	Unsupervised	ICCV 2023	Image Shadow Removal
ShadowDiffusion	Shadowdiffusion: When degradation prior meets diffusion model for shadow removal	Lanqing Guo	Supervised	CVPR2023	Image Shadow Removal
DeS3	DeS3: Attention-driven Self and Soft Shadow Removal using ViT Similarity and Color Convergence	Yeying Jin	Supervised	AAAI'24	Image Shadow Removal
Diff-Shadow	Diff-Shadow: Global-guided Diffusion Model for Shadow Removal	Jinting Luo	Supervised	Preprint'24	Image Shadow Removal
LFG-Diffusion	Latent Feature-Guided Diffusion Models for Shadow Removal	Kangfu Mei	Supervised	WACV 2024	Image Shadow Removal
Deshadow-Anything	Deshadow-Anything: When Segment Anything Model Meets Zero-Shot shadow removal	Xiao Feng Zhang	Supervised	Preprint'23	Image Shadow Removal

Image Denoising

Paper	First Author	Training Way	Venue	Topic	Project
Diffusion model for generative image denoising	Yutong Xie	Supervised	Preprint'23	Image Denoising
Score-Based Diffusion Models as Principled Priors for Inverse Imaging	Berthy T. Feng	Zero-Shot	ICCV 2023	Image Denoising, Image Deblurring
Real-World Denoising via Diffusion Model	Cheng Yang	Supervised	PrePrint'23	Image Denoising

Image Dehazing

Model	Paper	First Author	Training Way	Venue	Topic	Project
HazeDDPM	High-quality Image Dehazing with Diffusion Model	Hu Yu	Supervised	Preprint'23	Image Dehazing
--	Frequency Compensated Diffusion Model for Real-scene Dehazing	Jing Wang	Supervised	Preprint'23	Image Dehazing

Image Deblurring

Paper	First Author	Training Way	Venue	Topic	Project
Deblurring via stochastic refinement	Jay Whang	Supervised	CVPR2022	Image Deblurring
Score-Based Diffusion Models as Principled Priors for Inverse Imaging	Berthy T. Feng	Zero-Shot	ICCV 2023	Image Denoising, Image Deblurring
BlindDPS:Parallel diffusion models of operator and image for blind inverse problems	Hyungjin Chung	Zero-Shot	CVPR2023	Blind Deblurring
HI-Diff:Hierarchical Integration Diffusion Model for Realistic Image Deblurring	Zheng Chen	Supervised	Prepreint'23	Image Deblurring
Swintormer:Efficient Image Deblurring Networks based on Diffusion Models	Kang Chen	Supervised	Prepreint'24	Image Deblurring

Medical Restoration (MRI,CT)

Model	Paper	First Author	Training Way	Venue	Topic	Project
MCG	Improving diffusion models for inverse problems using manifold constraints	Hyungjin Chung	Zero-Shot	NeurIPS 2022	CT Reconstruction
--	Solving inverse problems in medical imaging with score-based generative models	Yang Song	Zero-Shot	ICLR 2022	CT Reconstruction
AdaDiff	Adaptive diffusion priors for accelerated mri reconstruction	Alper Güngör	Supervised	Preprint'23	MRI Reconstruction
HFS-SDE	High-Frequency Space Diffusion Models for Accelerated MRI	Chentao Cao	Supervised	Preprint'22	MRI Reconstruction
SWORD	Stage-by-stage Wavelet Optimization Refinement Diffusion Model for Sparse-View CT Reconstruction	Kai Xu	Supervised	Preprint'23	MRI Reconstruction
FDB	Learning Fourier-Constrained Diffusion Bridges for MRI Reconstruction	Muhammad U. Mirza	Supervised	Preprint'23	MRI Reconstruction

Low-Light Enchancement

Model	Paper	First Author	Training Way	Venue	Topic	Project
PyDiff	Pyramid Diffusion Models For Low-light Image Enhancement	Dewei Zhou	Supervised	Preprint'23	Low-light Enhancemnent
LightenDiffusion	LightenDiffusion: Unsupervised Low-Light Image Enhancement with Latent-Retinex Diffusion Models	Hai Jiang	Supervised	ECCV 2024	Low-light Enhancemnent
DiffLL	Lowlight image enhancement with wavelet-based diffusion models	Hai Jiang	Supervised	Preprint'23	Low-light Enhancemnent
ExploreDiffusion	ExposureDiffusion: Learning to Expose for Low-light Image Enhancement	Yufei Wang	Supervised	ICCV 2023	Low-light Enhancemnent
Diff-Retinex	Rethinking Low-light Image Enhancement with A Generative Diffusion Model	Xunpeng Yi	Supervised	ICCV 2023	Low-light Enhancemnent
CLE Diffusion	CLE Diffusion: Controllable Light Enhancement Diffusion Model	Yuyang Yin	Supervised	Preprint'23	Low-light Enhancemnent
DiffLLE	DiffLLE: Diffusion-guided Domain Calibration for Unsupervised Low-light Image Enhancement	Shuzhou Yang	Supervised	Preprint'23	Low-light Enhancemnent
LLDiffusion	LLDiffusion: Learning Degradation Representations in Diffusion Models for Low-Light Image Enhancement	Tao Wang	Supervised	Preprint'23	Low-light Enhancemnent
Entropy-SDE	Equipping Diffusion Models with Differentiable Spatial Entropy for Low-Light Image Enhancement	Wenyi Lian	Supervised	CVPRW 2024	Low-light Enhancemnent

Other tasks

Model	Paper	First Author	Training Way	Venue	Topic	Project
RainDiffusion	RainDiffusion: When Unsupervised Learning Meets Diffusion Models for Real-world Image Deraining	Mingqiang Wei	Supervised	Preprint'23	Image Deraining
GaussianSR	GaussianSR: 3D Gaussian Super-Resolution with 2D Diffusion Priors	Xiqian Yu	Supervised	Preprint'24	3D Gaussian Super-resolution
DIffSteISR	DIffSteISR: Harnessing Diffusion Prior for Superior Real-world Stereo Image Super-Resolution	Yuanbo Zhou	Supervised	Preprint'24	Stereo Image Super-Resolution
DiffGAR	DiffGAR: Model-agnostic restoration from generative artifacts using image-to-image diffusion models	Yueqin Yin	Supervised	Preprint'22	Generative Artifacts Removal
HSR-Diff	HSR-Diff: Hyperspectral Image Super-Resolution via Conditional Diffusion Models	Chanyue Wu	Supervised	Preprint'23	hyperspectral images super-resolution
DMGASR	Enhancing Hyperspectral Images via Diffusion Model and Group-Autoencoder Super-resolution Network	Zhaoyang Wang	Supervised	Preprint'24	hyperspectral images super-resolution
DRUS	Ultrasound Image Reconstruction with Denoising Diffusion Restoration Models	Yuxin Zhang	Zero-Shot	Preprint'23	Ultrasound Image Reconstruction
PromptRR	PromptRR: Diffusion Models as Prompt Generators for Single Image Reflection Removal	Tao Wang	Supervised	Preprint'24	Image Reflection Removal
--	Jpeg artifact correction using denoising diffusion restoration models	Bahjat Kawar	Zero-Shot	NeurIPS 2022	JPEG Artifacts Removal
--	Improved Diffusion-based Image Colorization via Piggybacked Models	Hanyuan Liu	Zero-Shot	PrePrint'23	Image Colorization

Benchmark Datasets

Dataset	Task	Usage	Year
DIV2K	Image Super-resolution	Training,Testing	2017
Flickr2K	Image Super-resolution	Training	2017
Set5	Image Super-resolution	Testing	2012
Set14	Image Super-resolution	Testing	2012
BSD100	Image Super-resolution	Testing	2012
Manga109	Image Super-resolution	Testing	2015
Urban100	Image Super-resolution	Testing	2015
OST300	Image Super-resolution	Testing	2018
DIV8K	Image Super-resolution	Training,Testing	2019
RealSR	Image Super-resolution	Training,Testing	2019
DRealSR	Image Super-resolution	Training,Testing	2020
GoPro	Image Deblurring	Training,Testing	2017
HIDE	Image Deblurring	Training,Testing	2019
RealBlur	Image Deblurring	Training,Testing	2020
Kodak	Image Denoising	Testing	1999
CBSD68	Image Denoising	Testing	2001
McMaster	Image Denoising	Testing	2011
ImageNet	Image Classification	Training,Testing	2010
ImageNet1k	Image Classification	Testing	2020
LSUN	Image Classification	Training,Testing	2015
Places365	Image Classification	Training,Testing	2019
LFW	Face Generation	Training	2008
FFHQ	Face Generation	Training	2019
Celeba-HQ	Face Generation	Training	2018
AFHQ	Face Generation	Training	2020
CelebA	Face Generation	Training	2015
ISTD	Image Shadow Removal	Training,Testing	2018
SRD	Image Shadow Removal	Training,Testing	2017
CSD	Image Desnowing	Training,Testing	2021
Snow100k	Image Desnowing	Training,Testing	2017
SRRS	Image Desnowing	Training,Testing	2020
RainDrop	Image Deraining	Training	2018
RainDropClarity	Image Deraining	Training,Testing	2024
Outdoor-Rain	Image Deraining	Training,Testing	2019
DDN-data	Image Deraining	Training,Testing	2017
SPA-data	Image Deraining	Training,Testing	2019
Rain100H	Image Deraining	Training,Testing	2017
Rain100L	Image Deraining	Training,Testing	2017
Haze-4K	Image Dehazing	Training	2021
Dense-Haze	Image Dehazing	Training	2019
RESIDE	Image Dehazing	Training	2019

Diffusion model-based Image/Video Compression

Model	Paper	First Author	Venue	Topic	Project
DiffC	Lossy Compression with Gaussian Diffusion	Lucas Theisl	Preprint'22	Lossy Image Compression
CDC	Lossy Image Compression with Conditional Diffusion Models	Ruihan Yang	NeurIPS 2023	Lossy Image Compression
CorrDiff	Correcting Diffusion-Based Perceptual Image Compression with Privileged End-to-End Decoder	Yiyang Ma	ICML 2024	Image Compression
I2VC	I2VC: A Unified Framework for Intra- & Inter-frame Video Compression	Meiqin Liu	NeurIPS2024 submission	Video Compression
DiffEIC	Towards Extreme Image Compression with Latent Feature Guidance and Diffusion Prior	Zhiyuan Li	IEEE TCSVT	Lossy Image Compression
PSC	Zero-Shot Image Compression with Diffusion-Based Posterior Sampling	Noam Elata	Preprint'24	Lossy Image Compression
DIRAC	A Residual Diffusion Model for High Perceptual Quality Codec Augmentation	Noor Fathima Ghouse	Preprint'23	Image Compression
HFD	High-Fidelity Image Compression with Score-based Generative Models	Emiel Hoogeboom	Preprint'23	Lossy Image Compression
PerCo	Towards image compression with perfect realism at ultra-low bitrates	Marl` ene Careil	ICLR 2024	Lossy Image Compression
PIC	Text + Sketch: Image Compression at Ultra Low Rates	Eric Lei	ICML 2023 workshop	Lossy Image Compression
	Idempotence and Perceptual Image Compression	Tongda Xu	ICLR2024	Lossy Image Compression
--	Lossy Image Compression with Foundation Diffusion Models	Lucas Relic	Preprint'24	Image Compression
--	Extreme Generative Image Compression by Learning Text Embedding from Diffusion Models	Zhihong Pan	Preprint'22	Image Compression

Diffusion model-based Image/Video quality assessment

Model	Paper	First Author	Venue	Topic	Project
DifFIQA	DifFIQA: Face Image Quality Assessment Using Denoising Diffusion Probabilistic Models	Žiga Babnik	Preprint'23	Image quality assessment
PFD-IQA	Feature Denoising Diffusion Model for Blind Image Quality Assessment	Xudong Li	Preprint'24	Image quality assessment
DP-IQA	DP-IQA: Utilizing Diffusion Prior for Blind Image Quality Assessment in the Wild	Honghao Fu	Preprint'24	Image quality assessment
GenzIQA	GenzIQA: Generalized Image Quality Assessment using Prompt-Guided Latent Diffusion Models	Diptanu De	Preprint'24	Image quality assessment
DiffV2IQA	Diffusion Model Based Visual Compensation Guidance and Visual Difference Analysis for No-Reference Image Quality Assessment	Zhaoyang Wang	Preprint'24	Image quality assessment

Cite US

If this work is helpful to you, we expect you can cite this work and star this repo. Thanks.

@article{li2023diffusion,
  title={Diffusion Models for Image Restoration and Enhancement--A Comprehensive Survey},
  author={Li, Xin and Ren, Yulin and Jin, Xin and Lan, Cuiling and Wang, Xingrui and Zeng, Wenjun and Wang, Xinchao and Chen, Zhibo},
  journal={arXiv preprint arXiv:2308.09388},
  year={2023}
}