English

Diffusion Model Based Posterior Sampling for Noisy Linear Inverse Problems

Machine Learning 2024-10-22 v4 Computer Vision and Pattern Recognition Information Theory math.IT Machine Learning

Abstract

With the rapid development of diffusion models and flow-based generative models, there has been a surge of interests in solving noisy linear inverse problems, e.g., super-resolution, deblurring, denoising, colorization, etc, with generative models. However, while remarkable reconstruction performances have been achieved, their inference time is typically too slow since most of them rely on the seminal diffusion posterior sampling (DPS) framework and thus to approximate the intractable likelihood score, time-consuming gradient calculation through back-propagation is needed. To address this issue, this paper provides a fast and effective solution by proposing a simple closed-form approximation to the likelihood score. For both diffusion and flow-based models, extensive experiments are conducted on various noisy linear inverse problems such as noisy super-resolution, denoising, deblurring, and colorization. In all these tasks, our method (namely DMPS) demonstrates highly competitive or even better reconstruction performances while being significantly faster than all the baseline methods.

Keywords

Cite

@article{arxiv.2211.12343,
  title  = {Diffusion Model Based Posterior Sampling for Noisy Linear Inverse Problems},
  author = {Xiangming Meng and Yoshiyuki Kabashima},
  journal= {arXiv preprint arXiv:2211.12343},
  year   = {2024}
}

Comments

Accepted to ACML2024. Code available at https://github.com/mengxiangming/dmps