English

SUREMap: Predicting Uncertainty in CNN-based Image Reconstruction Using Stein's Unbiased Risk Estimate

Image and Video Processing 2021-04-21 v2 Computer Vision and Pattern Recognition

Abstract

Convolutional neural networks (CNN) have emerged as a powerful tool for solving computational imaging reconstruction problems. However, CNNs are generally difficult-to-understand black-boxes. Accordingly, it is challenging to know when they will work and, more importantly, when they will fail. This limitation is a major barrier to their use in safety-critical applications like medical imaging: Is that blob in the reconstruction an artifact or a tumor? In this work we use Stein's unbiased risk estimate (SURE) to develop per-pixel confidence intervals, in the form of heatmaps, for compressive sensing reconstruction using the approximate message passing (AMP) framework with CNN-based denoisers. These heatmaps tell end-users how much to trust an image formed by a CNN, which could greatly improve the utility of CNNs in various computational imaging applications.

Keywords

Cite

@article{arxiv.2010.13214,
  title  = {SUREMap: Predicting Uncertainty in CNN-based Image Reconstruction Using Stein's Unbiased Risk Estimate},
  author = {Ruangrawee Kitichotkul and Christopher A. Metzler and Frank Ong and Gordon Wetzstein},
  journal= {arXiv preprint arXiv:2010.13214},
  year   = {2021}
}
R2 v1 2026-06-23T19:38:10.207Z