English
Related papers

Related papers: Solving Inverse Problems via Diffusion-Based Prior…

200 papers

Drawing from the theory of stochastic differential equations, we introduce a novel sampling method for known distributions and a new algorithm for diffusion generative models with unknown distributions. Our approach is inspired by the…

Statistics Theory · Mathematics 2024-07-12 Xicheng Zhang

Diffusion probabilistic models (DPMs) have been shown to generate high-quality images without the need for delicate adversarial training. However, the current sampling process in DPMs is prone to violent shaking. In this paper, we present a…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Xiyu Wang , Anh-Dung Dinh , Daochang Liu , Chang Xu

We study posterior sampling for inverse problems in discrete state spaces using discrete diffusion models as generative priors. While continuous diffusion models have become widely used for inverse problems, their discrete counterparts…

Machine Learning · Computer Science 2026-05-12 Chaitanya Amballa , Sattwik Basu , Jorge Vančo Sampedro , Romit Roy Choudhury

Diffusion models, which convert noise into new data instances by learning to reverse a diffusion process, have become a cornerstone in contemporary generative modeling. In this work, we develop non-asymptotic convergence theory for a…

Machine Learning · Computer Science 2024-08-06 Gen Li , Yuting Wei , Yuejie Chi , Yuxin Chen

Diffusion models recently proved to be remarkable priors for Bayesian inverse problems. However, training these models typically requires access to large amounts of clean data, which could prove difficult in some settings. In this work, we…

Machine Learning · Computer Science 2025-11-04 François Rozet , Gérôme Andry , François Lanusse , Gilles Louppe

Most modern imaging systems incorporate a computational pipeline to infer the image of interest from acquired measurements. The Bayesian approach to solve such ill-posed inverse problems involves the characterization of the posterior…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Pakshal Bohra , Thanh-an Pham , Jonathan Dong , Michael Unser

Diffusion models have recently achieved success in solving Bayesian inverse problems with learned data priors. Current methods build on top of the diffusion sampling process, where each denoising step makes small modifications to samples…

Machine Learning · Computer Science 2025-08-19 Bingliang Zhang , Wenda Chu , Julius Berner , Chenlin Meng , Anima Anandkumar , Yang Song

Geophysical inverse problems are often ill-posed and admit multiple solutions. Conventional discriminative methods typically yield a single deterministic solution, which fails to model the posterior distribution, cannot generate diverse…

Diffusion models have recently shown considerable potential in solving Bayesian inverse problems when used as priors. However, sampling from the resulting denoising posterior distributions remains a challenge as it involves intractable…

Machine Learning · Statistics 2024-12-25 Badr Moufad , Yazid Janati , Lisa Bedin , Alain Durmus , Randal Douc , Eric Moulines , Jimmy Olsson

Many inverse problems are ill-posed and need to be complemented by prior information that restricts the class of admissible models. Bayesian approaches encode this information as prior distributions that impose generic properties on the…

Machine Learning · Computer Science 2024-12-20 Julian L. Möbius , Michael Habeck

The use of non-differentiable priors in Bayesian statistics has become increasingly popular, in particular in Bayesian imaging analysis. Current state of the art methods are approximate in the sense that they replace the posterior with a…

Methodology · Statistics 2021-03-17 Jacob Vorstrup Goldman , Torben Sell , Sumeetpal Sidhu Singh

Inverse problems are prevalent across various disciplines in science and engineering. In the field of computer vision, tasks such as inpainting, deblurring, and super-resolution are commonly formulated as inverse problems. Recently,…

Machine Learning · Computer Science 2025-01-07 Shayan Mohajer Hamidi , En-Hui Yang

We present Bayesian Diffusion Models (BDM), a prediction algorithm that performs effective Bayesian inference by tightly coupling the top-down (prior) information with the bottom-up (data-driven) procedure via joint diffusion processes. We…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Haiyang Xu , Yu Lei , Zeyuan Chen , Xiang Zhang , Yue Zhao , Yilin Wang , Zhuowen Tu

Diffusion Inverse Solvers (DIS) are designed to sample from the conditional distribution $p_{\theta}(X_0|y)$, with a predefined diffusion model $p_{\theta}(X_0)$, an operator $f(\cdot)$, and a measurement $y=f(x'_0)$ derived from an unknown…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Tongda Xu , Ziran Zhu , Jian Li , Dailan He , Yuanyuan Wang , Ming Sun , Ling Li , Hongwei Qin , Yan Wang , Jingjing Liu , Ya-Qin Zhang

Inverse problems are ubiquitous because they formalize the integration of data with mathematical models. In many scientific applications the forward model is expensive to evaluate, and adjoint computations are difficult to employ; in this…

Dynamical Systems · Mathematics 2021-11-05 G. A. Pavliotis , A. M. Stuart , U. Vaes

Score-based diffusion models are a recently developed framework for posterior sampling in Bayesian inverse problems with a state-of-the-art performance for severely ill-posed problems by leveraging a powerful prior distribution learned from…

Bayesian models based on Gaussian processes (GPs) offer a flexible framework to predict spatially distributed variables with uncertainty. But the use of nonstationary priors, often necessary for capturing complex spatial patterns, makes…

Machine Learning · Statistics 2025-06-02 Gabriel V Cardoso , Mike Pereira

While diffusion priors generate high-quality posterior samples across many inverse problems, they are often trained on limited training sets or purely simulated data, thus inheriting the errors and biases of these underlying sources.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Frederic Wang , Katherine L. Bouman

Identifying a low-dimensional informed parameter subspace offers a viable path to alleviating the dimensionality challenge in the sampled-based solution to large-scale Bayesian inverse problems. This paper introduces a novel gradient-based…

Computation · Statistics 2023-03-07 Tiangang Cui , Olivier Zahm

Image restoration aims to recover high-quality images from degraded observations. When the degradation process is known, the recovery problem can be formulated as an inverse problem, and in a Bayesian context, the goal is to sample a clean…

Image and Video Processing · Electrical Eng. & Systems 2025-10-13 Darshan Thaker , Abhishek Goyal , René Vidal