Skip to content

A summary of open-source deep learning-based infrared and visible image fusion and some vision algorithms. 红外与可见光图像融合的开源代码

Notifications You must be signed in to change notification settings

liushh39/IVIF-Code-Interpretation

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

25 Commits
 
 

Repository files navigation

🔥IVIF-Code-Interpretation

Static Badge Static Badge

Provide a summary of open-source deep learning-based infrared and visible image fusion (IVIF) and some vision algorithms for those in the field of image fusion and computer vision.
(Survey, Code, Dataset, Evaluation and more).

🏃 keep updating. 🏃
🚩 2024.12.3 Add CEFusion
🚩 2024.8.25 Add DUGAN, MVSFusion
🚩 2024.8.17 Add MMDRFuse (ACM 2024)
🚩 2024.8.4 Add FILM (ICML 2024)
🚩 2024.7.27 Add SimpleFusion, SHIP (CVPR 2024), FISCNet, MambaDFuse
🚩 2024.7.21 Add AGMFusion (A great work!!!!)
🚩 2024.5.19 Add Text-IF, Diff-IF, TC-MoA, and MMIF-EMMA
🚩 2024.4.18 Add a general image fusion framework using multi-task semi-supervised learning
🚩 2024.4.11 Add some clarifications.
🚩 2024.4.2 Add MTDFusion, SFCFusion, MetaFusion.

Reprinted please specify the source~

https://github.com/liushh39

Content:

1. Survey

Year Title
2023 Visible and Infrared Image Fusion Using Deep Learning 🤗🤗
2023 基于深度学习的图像融合方法综述 🤗🤗

2. Latest or novel IVIF method

Year Title
2024 AGMFusion: A Real-Time End-to-End Infrared and Visible Image Fusion Network Based on Adaptive Guidance Module 🤗🤗🤗🤗🤗
2024 MVSFusion: infrared and visible image fusion method for multiple visual scenarios
2024 MMDRFuse: Distilled Mini-Model with Dynamic Refresh for Multi-Modality Image Fusion 🤗🤗🤗🤗
2024 FILM: image Fusion via vIsion-Language Model
2024 Probing Synergistic High-Order Interaction in Infrared and Visible Image Fusion
2024 Frequency Integration and Spatial Compensation Network for Infrared and Visible Image Fusion
2024 A general image fusion framework using multi-task semi-supervised learning 🤗🤗🤗🤗
2024 Text-IF: Leveraging Semantic Text Guidance for Degradation-Aware and Interactive Image Fusion 🤗🤗🤗🤗
2024 Diff-IF: Multi-modality image fusion via diffusion model with fusion knowledge prior 🤗🤗🤗🤗
2024 Task-Customized Mixture of Adapters for General Image Fusion
2024 Equivariant Multi-Modality Image Fusion
2024 SFCFusion: Spatial–Frequency Collaborative Infrared and Visible Image Fusion
2023 DDFM: Denoising Diffusion Model for Multi-Modality Image Fusion 🤗🤗🤗
2023 A Task-guided, Implicitly-searched and Meta- initialized Deep Model for Image Fusion 🤗🤗🤗
2023 Bi-level Dynamic Learning for Jointly Multi-modality Image Fusion and Beyond 🤗🤗🤗
2023 MetaFusion: Infrared and Visible Image Fusion via Meta-Feature Embedding from Object Detection
2022 Fusion from Decomposition: A Self-Supervised Decomposition Approach for Image Fusion

3. AE-based IVIF method

Year Title
2024 TextFusion: Unveiling the Power of Textual Semantics for Controllable Image Fusion 🤗🤗🤗
2023 LRRNet: A Novel Representation Learning Guided Fusion Framework for Infrared and Visible Images 🤗🤗🤗
2023 MURF: Mutually Reinforcing Multi-modal Image Registration and Fusion
2023 CoCoNet: Coupled Contrastive Learning Network with Multi-level Feature Ensemble for Multi-modality Image Fusion
2023 Recurrent Correction Network for Fast and Efficient Multi-modality Image Fusion
2023 CAMF: An Interpretable Infrared and Visible Image Fusion Network Based on Class Activation Mapping
2023 DIVFusion: Darkness-free infrared and visible image fusion
2023 MUFusion: A general unsupervised image fusion network based on memory unit 🤗🤗
2023 SOSMaskFuse: An Infrared and Visible Image Fusion Architecture Based on Salient Object Segmentation Mask 🤗🤗
2023 Semantics lead all: Towards unified image registration and fusion from a semantic perspective 🤗🤗🤗
2022 Res2Fusion: Infrared and visible image fusion based on dense Res2net and double nonlocal attention models
2022 CUFD: An encoder-decoder network for visible and infrared image fusion based on common and unique feature decomposition
2022 Breaking Free from Fusion Rule: A Fully Semantic-driven Infrared and Visible Image Fusion
2021 SEDRFuse: A Symmetric Enocder-Decoder with Residual Network for Infrared and Visible Image Fusion
2021 RFN-Nest: An end-to-end residual fusion network for infrared and visible images
2021 Efficient and Interpretable Infrared and Visible Image Fusion Via Algorithm Unrolling
2020 NestFuse: An Infrared and Visible Image Fusion Architecture based on Nest Connection and Spatial/Channel Attention Models
2020 DIDFuse: Deep Image Decomposition for Infrared and Visible Image Fusion
2020 Classification Saliency-Based Rule for Visible and Infrared Image Fusion
2020 UNIFusion: A Lightweight Unified Image Fusion Network
2020 SMoA: Searching a Modality-Oriented Architecture for Infrared and Visible Image Fusion
2019 Densefuse: A Fusion Approach to Infrared and Visible Images 🤗🤗
2018 Infrared and Visible Image Fusion using a Deep Learning Framework

4. CNN-based IVIF method

Year Title
2024 CEFusion: An Infrared and Visible Image Fusion Network Based on Cross-Modal Multi-Granularity Information Interaction and Edge Guidance
2024 SimpleFusion: A Simple Fusion Framework for Infrared and Visible Images
2023 MTDFusion: A Multilayer Triple Dense Network for Infrared and Visible Image Fusion
2023 LE2Fusion: A novel local edge enhancement module for infrared and visible image fusion
2023 Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentation 🤗🤗🤗
2023 LDRepFM: A Real-Time End-to-End Visible and Infrared Image Fusion Model Based on Layer Decomposition and Re-Parameterization
2023 An interactively reinforced paradigm for joint infrared-visible image fusion and saliency object detection 🤗🤗🤗
2022 Attention-Guided Polarization Image Fusion Using Salient Information Distribution
2022 PIAFusion: A Progressive Infrared and Visible Image Fusion Network Based on Illumination Aware
2022 Image fusion in the loop of high-level vision tasks: A semantic-aware real-time infrared and visible image fusion network 🤗🤗
2022 CLF-Net: "Contrastive Learning for Infrared and Visible Image Fusion Network
2022 Unsupervised Misaligned Infrared and Visible Image Fusion via Cross-Modality Image Generation and Registration
2022 IPLF:A Novel Image Pair Learning Fusion Network for Infrared and Visible Image
2022 Learn to Search a Lightweight Architecture for Target-aware Infrared and Visible Image Fusion
2022 SuperFusion: A Versatile Image Registration and Fusion Network with Semantic Awareness
2022 DetFusion: A Detection-driven Infrared and Visible Image Fusion Network
2022 FLFuse-Net: A Fast and Lightweight Infrared and Visible Image Fusion Network Via Feature Flow and Edge Compensation for Salient Information 🤗🤗
2022 Multiscale Progressive Fusion of Infrared and Visible Images 🤗
2022 Heterogeneous Knowledge Distillation for Simultaneous Infrared-Visible Image Fusion and Super-Resolution 🤗
2021 STDFusionNet: An Infrared and Visible Image Fusion Network Based on Salient Target Detection 🤗🤗
2021 DRF: Disentangled Representation for Visible and Infrared Image Fusion
2021 Different Input Resolutions and Arbitrary Output Resolution: A Meta-Learning Based Deep Framework for Infrared and Visible Image Fusion 🤗🤗
2021 SDNet: A Versatile Squeeze-and-Decomposition Network for Real-Time Image Fusion
2021 MIFFuse: A Multi-level Feature Fusion Network for Infrared and visible Images 🤗
2020 IFCNN: A General Image Fusion Framework Based on Convolutional Neural Network
2020 FusionDN: A Unified Densely Connected Network for Image Fusion
2020 Rethinking the image fusion: A fast unified image fusion network based on proportional maintenance of gradient and intensity
2020 U2Fusion: A Unified Unsupervised Image Fusion Network 🤗🤗

5. GAN-based IVIF method

Year Title
2024 DUGAN: Infrared and Visible Image Fusion Based on Dual Fusion Paths and a U-type Discriminator
2023 A Cross-scale Iterative Attentional Adversarial Fusion Network for Infrared and Visible Images
2023 Infrared and Visible Image Fusion Based on Multiclassification Adversarial Mechanism in Feature Space
2022 Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detection 🤗🤗
2022 Infrared and Visible Image Fusion via Interactive Compensatory Attention Adversarial Learning
2021 Coupled GAN with Relativistic Discriminators for Infrared and Visible Images Fusion
2021 Sematic-Supervised Infrared and Visible Image Fusion via Dual-Discriminator Generative Adversarial Network
2021 MFEIF: Learning a Deep Multi-scale Feature Ensemble and an Edge-attention Guidance for Image Fusion
2021 GANMcC: A Generative Adversarial Network with Multi-classification Constraints for Infrared and Visible Image Fusion
2021 GAN-FM: Infrared and Visible Image Fusion Using GAN With Full-Scale Skip Connection and Dual Markovian Discriminators
2019 FusionGAN: A generative adversarial network for infrared and visible image fusion
2019 DDcGAN:infrared and visible image fusion via dual-discriminator conditional generative adversarial network

6. Transformer-based IVIF method

Year Title
2023 PTET: A Progressive Token Exchanging Transformer for Infrared and Visible Image Fusion
2023 SFPFusion: An Improved Vision Transformer Combining Super Feature Attention and Wavelet-Guided Pooling for Infrared and Visible Images Fusion
2023 Rethinking the necessity of image fusion in high-level vision tasks: A practical infrared and visible image fusion network based on progressive semantic injection and scene fidelity
2023 CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusion 🤗🤗🤗
2023 DATFuse: Infrared and Visible Image Fusion via Dual Attention Transformer
2023 Cross-Modal Transformers for Infrared and Visible Image Fusion 🤗🤗🤗
2022 YDTR: Infrared and Visible Image Fusion via Y-shape Dynamic Transformer 🤗🤗
2022 SwinFuse: A Residual Swin Transformer Fusion Network for Infrared and Visible Images
2022 SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer
2022 Image fusion transformer

7. Mamba-based IVIF method

Year Title
2024 MambaDFuse: A Mamba-based Dual-phase Model for Multi-modality Image Fusion

8. Datasets

TNO, RoadScene, M3FD, MFNet, MSRS, LLVIP, IVS, HDO, AVIID,

9. Evaluation

Excellent code

If you have any other questions about the IVIF, please email [email protected] !!!

Reprinted please specify the source~

https://github.com/liushh39

Thanks to the above authors for their excellent work!🤗🤗

About

A summary of open-source deep learning-based infrared and visible image fusion and some vision algorithms. 红外与可见光图像融合的开源代码

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published