English

Learning to restore images degraded by atmospheric turbulence using uncertainty

Image and Video Processing 2022-07-08 v1 Computer Vision and Pattern Recognition

Abstract

Atmospheric turbulence can significantly degrade the quality of images acquired by long-range imaging systems by causing spatially and temporally random fluctuations in the index of refraction of the atmosphere. Variations in the refractive index causes the captured images to be geometrically distorted and blurry. Hence, it is important to compensate for the visual degradation in images caused by atmospheric turbulence. In this paper, we propose a deep learning-based approach for restring a single image degraded by atmospheric turbulence. We make use of the epistemic uncertainty based on Monte Carlo dropouts to capture regions in the image where the network is having hard time restoring. The estimated uncertainty maps are then used to guide the network to obtain the restored image. Extensive experiments are conducted on synthetic and real images to show the significance of the proposed work. Code is available at : https://github.com/rajeevyasarla/AT-Net

Keywords

Cite

@article{arxiv.2207.03447,
  title  = {Learning to restore images degraded by atmospheric turbulence using uncertainty},
  author = {Rajeev Yasarla and Vishal M. Patel},
  journal= {arXiv preprint arXiv:2207.03447},
  year   = {2022}
}

Comments

Recognized as Best Paper at IEEE International Conference on Image Processing, 2021. arXiv admin note: substantial text overlap with arXiv:2007.08404