SUD$^2$: Supervision by Denoising Diffusion Models for Image Reconstruction
Computer Vision and Pattern Recognition
2023-04-04 v2 Machine Learning
Image and Video Processing
Abstract
Many imaging inverse problemssuch as image-dependent in-painting and dehazingare challenging because their forward models are unknown or depend on unknown latent parameters. While one can solve such problems by training a neural network with vast quantities of paired training data, such paired training data is often unavailable. In this paper, we propose a generalized framework for training image reconstruction networks when paired training data is scarce. In particular, we demonstrate the ability of image denoising algorithms and, by extension, denoising diffusion models to supervise network training in the absence of paired training data.
Cite
@article{arxiv.2303.09642,
title = {SUD$^2$: Supervision by Denoising Diffusion Models for Image Reconstruction},
author = {Matthew A. Chan and Sean I. Young and Christopher A. Metzler},
journal= {arXiv preprint arXiv:2303.09642},
year = {2023}
}
Comments
18 pages, 15 figures