Readme updates

README.md

@@ -1,21 +1,18 @@
-# CycleISP
+# CycleISP: Real Image Restoration via Improved Data Synthesis (CVPR 2020 -- Oral)
 
-This repository is for CycleISP introduced in the following paper
-
-[Syed Waqas Zamir](https://scholar.google.es/citations?user=WNGPkVQAAAAJ&hl=en), [Aditya Arora](https://adityac8.github.io/), [Salman Khan](https://salman-h-khan.github.io/), [Munawar Hayat](https://scholar.google.com/citations?user=Mx8MbWYAAAAJ&hl=en), [Fahad Shahbaz Khan](https://scholar.google.es/citations?user=zvaeYnUAAAAJ&hl=en), [Ming-Hsuan Yang](https://scholar.google.com/citations?user=p9-ohHsAAAAJ&hl=en), and [Ling Shao](https://scholar.google.com/citations?user=z84rLjoAAAAJ&hl=en) "CycleISP: Real Image Restoration via Improved Data Synthesis" CVPR (Oral) 2020
+[Syed Waqas Zamir](https://scholar.google.es/citations?user=WNGPkVQAAAAJ&hl=en), [Aditya Arora](https://adityac8.github.io/), [Salman Khan](https://salman-h-khan.github.io/), [Munawar Hayat](https://scholar.google.com/citations?user=Mx8MbWYAAAAJ&hl=en), [Fahad Shahbaz Khan](https://scholar.google.es/citations?user=zvaeYnUAAAAJ&hl=en), [Ming-Hsuan Yang](https://scholar.google.com/citations?user=p9-ohHsAAAAJ&hl=en), and [Ling Shao](https://scholar.google.com/citations?user=z84rLjoAAAAJ&hl=en)
 
 **Paper**: 
 
 **Supplementary**: 
 
 ## Codes and Pre-trained Models Releasing Soon! 
 
-## Abstract
+> **Abstract:** *The availability of large-scale datasets has helped unleash the true potential of deep convolutional neural networks (CNNs). However, for the single-image denoising problem, capturing a real dataset is an unacceptably expensive and cumbersome procedure. Consequently, image denoising algorithms are mostly developed and evaluated on synthetic data that is usually generated with a widespread assumption of additive white Gaussian noise (AWGN). While the CNNs achieve impressive results on these synthetic datasets, they do not perform well when applied on real camera images, as reported in recent benchmark datasets. This is mainly because the AWGN is not adequate for modeling the real camera noise which is signal-dependent and heavily transformed by the camera imaging pipeline. In this paper, we present a framework that models camera imaging pipeline in forward and reverse directions. It allows us to produce any number of realistic image pairs for denoising both in RAW and sRGB spaces. By training a new image denoising network on realistic synthetic data, we achieve the state-of-the-art performance on real camera benchmark datasets. The parameters in our model are ~5 times lesser than the previous best method for RAW denoising. Furthermore, we demonstrate that the proposed framework generalizes beyond image denoising problem e.g., for color matching in stereoscopic cinema.* 
 
-The availability of large-scale datasets has helped unleash the true potential of deep convolutional neural networks (CNNs).
-However, for the single-image denoising problem, capturing a real dataset is an unacceptably expensive and cumbersome procedure. Consequently, image denoising algorithms are mostly developed and evaluated on synthetic data that is usually generated with a widespread assumption of additive white Gaussian noise (AWGN). While the CNNs achieve impressive results on these synthetic datasets, they do not perform well when applied on real camera images, as reported in recent benchmark datasets. This is mainly because the AWGN is not adequate for modeling the real camera noise which is signal-dependent and heavily transformed by the camera imaging pipeline. In this paper, we present a framework that models camera imaging pipeline in forward and reverse directions. It allows us to produce any number of realistic image pairs for denoising both in RAW and sRGB spaces. By training a new image denoising network on realistic synthetic data, we achieve the state-of-the-art performance on real camera benchmark datasets. The parameters in our models are ~5 times lesser than the previous best method for RAW denoising. Furthermore, we demonstrate that the proposed framework generalizes beyond image denoising problem e.g., for color matching in stereoscopic cinema.
+## CycleISP for Synthesizing Data for Image Denoising
+The proposed CycleISP framework allows converting sRGB images to RAW data, and then back to sRGB images. It has (a) RGB2RAW network branch, and (b) RAW2RGB network branch.  
 
-## Network Architecture
 <p align="center">
   <img src = "https://i.imgur.com/owqujSm.png" width="800">
   <br/>
@@ -25,17 +22,30 @@ However, for the single-image denoising problem, capturing a real dataset is an
 <p align="center">
   <img src = "https://i.imgur.com/gQ4JLyO.png" width="500">
   <br/>
-  <b> Recursive Residual Group </b>
+  <b> Recursive Residual Group (RRG) </b>
 </p>
 
+
+
+
+### Generating Data for Raw Denoising
+The RGB2RAW network branch takes as input a clean sRGB image and converts it to a clean RAW image. The noise injection module adds shot and read noise of different levels to the (RAW) output  RGB2RAW network branch.  Thereby, we can generate clean and its corresponding noisy image pairs {RAW_clean, RAW_noisy} from any sRGB image.
+
+
+### Generating Data for sRGB Denoising
+Given a synthetic RAW noisy image as input, the RAW2RGB network branch maps it to a noisy sRGB image; hence we are able to generate an image pair {sRGB_clean, sRGB_noisy} for the sRGB  denoising  problem.  
+
+
+### Proposed Denoising Network
 <p align="center">
   <img src = "https://i.imgur.com/DFLTDZI.png" width="620">
   <br/>
-  <b> Proposed denoising network </b>
 </p>
 
-## Results
-Experiments are performed on two image datasets for image denoising in RAW and sRGB space.
+## Results on Real Image Datasets
+Experiments are performed for denoising images in RAW and sRGB spaces.
+
+### Results for RAW Denoising
 
 <table>
   <tr>
@@ -44,7 +54,20 @@ Experiments are performed on two image datasets for image denoising in RAW and s
   </tr>
 </table>
 
+### Results for sRGB Denoising
+
 <img src = "https://i.imgur.com/h57wFn9.png" >
 
+## Citation
+If you use CycleISP, please consider citing:
+
+    @inproceedings{Zamir2020CycleISP,
+        title={CycleISP: Real Image Restoration via Improved Data Synthesis},
+        author={Syed Waqas Zamir and Aditya Arora and Salman Khan and Munawar Hayat
+                and Fahad Shahbaz Khan and Ming-Hsuan Yang and Ling Shao},
+        booktitle={CVPR},
+        year={2020}
+    }
+
 ## Contact
 Should you have any question, please contact [email protected]