English
Related papers

Related papers: When, why, and how do diffusion posterior samplers…

200 papers

Inverse problems arise in a multitude of applications, where the goal is to recover a clean signal from noisy and possibly (non)linear observations. The difficulty of a reconstruction problem depends on multiple factors, such as the ground…

Image and Video Processing · Electrical Eng. & Systems 2024-08-21 Zalan Fabian , Berk Tinaz , Mahdi Soltanolkotabi

Recent advancements in diffusion models have been leveraged to address inverse problems without additional training, and Diffusion Posterior Sampling (DPS) (Chung et al., 2022a) is among the most popular approaches. Previous analyses…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Tongda Xu , Xiyan Cai , Xinjie Zhang , Xingtong Ge , Dailan He , Ming Sun , Jingjing Liu , Ya-Qin Zhang , Jian Li , Yan Wang

Inverse problems exist in many disciplines of science and engineering. In computer vision, for example, tasks such as inpainting, deblurring, and super resolution can be effectively modeled as inverse problems. Recently, denoising diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Shayan Mohajer Hamidi , En-Hui Yang

Diffusion models have emerged as powerful tools for solving inverse problems, yet prior work has primarily focused on observations with Gaussian measurement noise, restricting their use in real-world scenarios. This limitation persists due…

Machine Learning · Statistics 2025-02-11 Alessandro Micheli , Mélodie Monod , Samir Bhatt

The inverse design of metasurfaces faces inherent challenges due to the nonlinear and highly complex relationship between geometric configurations and their electromagnetic behavior. Traditional optimization approaches often suffer from…

Bayesian model selection provides a powerful framework for objectively comparing models directly from observed data, without reference to ground truth data. However, Bayesian model selection requires the computation of the marginal…

Methodology · Statistics 2024-01-17 Xiaohao Cai , Jason D. McEwen , Marcelo Pereyra

Diffusion models without guidance generate very unrealistic samples. Guidance is used ubiquitously, and previous research has attributed its effect to low-temperature sampling that improves quality by trading off diversity. However, this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Shanchuan Lin , Xiao Yang

Diffusion models perform remarkably well on high-dimensional data such as images, often using only a modest number of reverse-time steps. Despite this practical success, existing convergence theory does not fully explain why such samplers…

Machine Learning · Computer Science 2026-05-11 Ahmad Aghapour , Erhan Bayraktar

Some machine learning applications require continual learning - where data comes in a sequence of datasets, each is used for training and then permanently discarded. From a Bayesian perspective, continual learning seems straightforward:…

Machine Learning · Statistics 2019-02-19 Sebastian Farquhar , Yarin Gal

We study posterior sampling for inverse problems in discrete state spaces using discrete diffusion models as generative priors. While continuous diffusion models have become widely used for inverse problems, their discrete counterparts…

Machine Learning · Computer Science 2026-05-12 Chaitanya Amballa , Sattwik Basu , Jorge Vančo Sampedro , Romit Roy Choudhury

Recent decades have seen an interest in prediction problems for which Bayesian methodology has been used ubiquitously. Sampling from or approximating the posterior predictive distribution in a Bayesian model allows one to make inferential…

Machine Learning · Statistics 2017-09-12 Giri Gopalan

Diffusion models have recently attained significant interest within the community owing to their strong performance as generative models. Furthermore, its application to inverse problems have demonstrated state-of-the-art performance.…

Image and Video Processing · Electrical Eng. & Systems 2022-03-22 Hyungjin Chung , Byeongsu Sim , Jong Chul Ye

We outline how modern likelihood theory, which provides essentially exact inferences in a variety of parametric statistical problems, may routinely be applied in practice. Although the likelihood procedures are based on analytical…

Methodology · Statistics 2009-06-23 Alessandra R. Brazzale , Anthony C. Davison

Bayesian inference for inverse problems hinges critically on the choice of priors. In the absence of specific prior information, population-level distributions can serve as effective priors for parameters of interest. With the advent of…

Instrumentation and Methods for Astrophysics · Physics 2025-02-11 Gabriel Missael Barco , Alexandre Adam , Connor Stone , Yashar Hezaveh , Laurence Perreault-Levasseur

Diffusion models have become increasingly popular for generative modeling due to their ability to generate high-quality samples. This has unlocked exciting new possibilities for solving inverse problems, especially in image restoration and…

We present an error-diagnostic validation method for posterior distributions in Bayesian signal inference, an advancement of a previous work. It transfers deviations from the correct posterior into characteristic deviations from a uniform…

Instrumentation and Methods for Astrophysics · Physics 2013-11-05 Sebastian Dorn , Niels Oppermann , Torsten A. Enßlin

Diffusion models have marked a significant breakthrough in the synthesis of semantically coherent images. However, their extensive noise estimation networks and the iterative generation process limit their wider application, particularly on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yuzhe Yao , Feng Tian , Jun Chen , Haonan Lin , Guang Dai , Yong Liu , Jingdong Wang

Diffusion models have emerged as a powerful foundation model for visual generations. With an appropriate sampling process, it can effectively serve as a generative prior for solving general inverse problems. Current posterior sampling-based…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Shijie Zhou , Huaisheng Zhu , Rohan Sharma , Jiayi Chen , Ruiyi Zhang , Kaiyi Ji , Changyou Chen

Diffusion models have shown remarkable empirical success in sampling from rich multi-modal distributions. Their inference relies on numerically solving a certain differential equation. This differential equation cannot be solved in closed…

Machine Learning · Computer Science 2026-01-16 Khashayar Gatmiry , Sitan Chen , Adil Salim

We propose a Bayesian approach using improper priors for hierarchical linear mixed models with flexible random effects and residual error distributions. The error distribution is modelled using scale mixtures of normals, which can capture…

Methodology · Statistics 2018-02-06 F. J. Rubio , M. F. J. Steel