Skip to content
forked from ctom2/colie

Adaptation of CoLIE for radio astromical images

License

Notifications You must be signed in to change notification settings

dr4thmos/astro-colie

This branch is 1 commit ahead of, 1 commit behind ctom2/colie:main.

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Nov 27, 2024
a38ed29 Â· Nov 27, 2024

History

54 Commits
Nov 27, 2024
Mar 12, 2024
Sep 7, 2024
Nov 27, 2024
Aug 22, 2024
Mar 12, 2024
Mar 12, 2024
Mar 12, 2024
Sep 9, 2024
Mar 12, 2024
Mar 12, 2024

Repository files navigation

Astro-CoLIE

[Original work BibTeX]

Fast Context-Based Low-Light Image Enhancement via Neural Implicit Representations

video test

🔥 Frame-by-frame enhancement of a low-light clip from Game of Thrones.

Overview

low light image enhancement

  • Challenges with Current Methods: Existing deep learning methods for low-light image enhancement struggle with high-resolution images, and they often fail to meet practical visual perception needs in diverse, unseen scenarios.
  • Introduction of CoLIE: CoLIE (Context-Based Low-Light Image Enhancement) is a novel approach for enhancing low-light images. It works by mapping 2D coordinates of underexposed images to their illumination components, conditioned on local context.
  • Methodology: The method utilizes HSV color space for image reconstruction. It employs an implicit neural function along with an embedded guided filter to further reduce computational overhead.
  • Innovations in Training: CoLIE introduces a single image-based training loss function. This function aims to improve the model's adaptability across various scenes, enhancing its practical applicability.

Neural Implicit Representation for Low-Light Enhancement

colie architecture

Our proposed framework begins with the extraction of the Value component from the HSV image representation. Subsequently, we employ a neural implicit representation (NIR) model to infer the illumination component which is an essential part for effective enhancement of the input low-light image. This refined Value component is then reintegrated with the original Hue and Saturation components, forming a comprehensive representation of the enhanced image. The architecture of CoLIE involves dividing the inputs into two distinct parts: the elements of the Value component and the coordinates of the image. Each of these components is subject for regularization with unique parameters within their respective branches. By adopting this structured approach, our framework ensures precise control over the enhancement process.

Code

Requirements

  • python3.10
  • pytorch==2.3.1

Running the code

python colie.py

The code execution is controlled with the following parameters:

  • --input_folder defines the name of the folder with input images
  • --output_folder defines the name of the folder where the output images will be saved
  • --down_size is the size to which the input image will be downsampled before processing
  • --epochs defines the number of optimisation steps
  • --window defines the size of the context window
  • --L is the "optimally-intense threshold", lower values produce brighter images

The strength of the regularisation terms in the loss functon is defined by the following parameters:

  • --alpha: fidelity control (default setting: 1)
  • --beta: illumination smoothness (default setting: 20)
  • --gamma: exposure control (default setting: 8)
  • --delta: sparsity level (default setting: 5)

Please refer to the example in notebook.ipynb (or in Colab here) for example code execution and visualisation.

Results

sota comparison

Comparison with the state-of-the-art methods for unsupervised low-light image enhancement (RUAS, SCI).

results microscopy

Fluorescence microscopy intensity correction.

darkface grid

Results on the DarkFace dataset.

Citing CoLIE

Please consider citing our paper if our code are useful:

@inproceedings{chobola2024fast,
      title={Fast Context-Based Low-Light Image Enhancement via Neural Implicit Representations}, 
      author={Tomáš Chobola and Yu Liu and Hanyi Zhang and Julia A. Schnabel and Tingying Peng},
      booktitle={Proceedings of the European Conference on Computer Vision (ECCV)},
      year={2024}
}

About

Adaptation of CoLIE for radio astromical images

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 98.7%
  • Python 1.3%