English

SUD$^2$: Supervision by Denoising Diffusion Models for Image Reconstruction

Computer Vision and Pattern Recognition 2023-04-04 v2 Machine Learning Image and Video Processing

Abstract

Many imaging inverse problems\unicodex2014\unicode{x2014}such as image-dependent in-painting and dehazing\unicodex2014\unicode{x2014}are challenging because their forward models are unknown or depend on unknown latent parameters. While one can solve such problems by training a neural network with vast quantities of paired training data, such paired training data is often unavailable. In this paper, we propose a generalized framework for training image reconstruction networks when paired training data is scarce. In particular, we demonstrate the ability of image denoising algorithms and, by extension, denoising diffusion models to supervise network training in the absence of paired training data.

Keywords

Cite

@article{arxiv.2303.09642,
  title  = {SUD$^2$: Supervision by Denoising Diffusion Models for Image Reconstruction},
  author = {Matthew A. Chan and Sean I. Young and Christopher A. Metzler},
  journal= {arXiv preprint arXiv:2303.09642},
  year   = {2023}
}

Comments

18 pages, 15 figures

R2 v1 2026-06-28T09:20:45.505Z