English
Related papers

Related papers: Blade: A Derivative-free Bayesian Inversion Method…

200 papers

Diffusion models have emerged as powerful learned priors for Bayesian inverse problems (BIPs). Diffusion-based solvers rely on a presumed likelihood for the observations in BIPs to guide the generation process. Likelihood misspecification…

Machine Learning · Computer Science 2026-05-12 Yiming Yang , Xiaoyuan Cheng , Yi He , Kaiyu Li , Wenxuan Yuan , Zhuo Sun

We introduce a general framework for solving partial differential equations (PDEs) using generative diffusion models. In particular, we focus on the scenarios where we do not have the full knowledge of the scene necessary to apply classical…

Machine Learning · Computer Science 2024-11-04 Jiahe Huang , Guandao Yang , Zichen Wang , Jeong Joon Park

Optimizing high-dimensional and complex black-box functions is crucial in numerous scientific applications. While Bayesian optimization (BO) is a powerful method for sample-efficient optimization, it struggles with the curse of…

Machine Learning · Computer Science 2025-07-08 Taeyoung Yun , Kiyoung Om , Jaewoo Lee , Sujin Yun , Jinkyoo Park

This paper is concerned with the numerical solution of model-based, Bayesian inverse problems. We are particularly interested in cases where the cost of each likelihood evaluation (forward-model call) is expensive and the number of un-…

Computation · Statistics 2016-07-25 Isabell M. Franck , P. S. Koutsourelakis

Deep learning is increasingly moving towards a transfer learning paradigm whereby large foundation models are fine-tuned on downstream tasks, starting from an initialization learned on the source task. But an initialization contains…

Machine Learning · Computer Science 2022-05-23 Ravid Shwartz-Ziv , Micah Goldblum , Hossein Souri , Sanyam Kapoor , Chen Zhu , Yann LeCun , Andrew Gordon Wilson

Recent studies on inverse problems have proposed posterior samplers that leverage the pre-trained diffusion models as powerful priors. These attempts have paved the way for using diffusion models in a wide range of inverse problems.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Sojin Lee , Dogyun Park , Inho Kong , Hyunwoo J. Kim

This paper proposes a novel diffusion-based posterior sampling method within a plug-and-play (PnP) framework. Our approach constructs a probability transport from an easy-to-sample terminal distribution to the target posterior, using a…

Machine Learning · Statistics 2025-12-10 Jinyuan Chang , Chenguang Duan , Yuling Jiao , Ruoxuan Li , Jerry Zhijian Yang , Cheng Yuan

One of the major challenges in the Bayesian solution of inverse problems governed by partial differential equations (PDEs) is the computational cost of repeatedly evaluating numerical PDE models, as required by Markov chain Monte Carlo…

Computation · Statistics 2016-05-03 Tiangang Cui , Youssef M. Marzouk , Karen E. Willcox

Bayesian inversion is central to the quantification of uncertainty within problems arising from numerous applications in science and engineering. To formulate the approach, four ingredients are required: a forward model mapping the unknown…

Machine Learning · Statistics 2025-05-15 O. Deniz Akyildiz , Mark Girolami , Andrew M. Stuart , Arnaud Vadeboncoeur

In this paper, we present a theoretical and computational workflow for the non-parametric Bayesian inference of drift and diffusion functions of autonomous diffusion processes. We base the inference on the partial differential equations…

Computational Engineering, Finance, and Science · Computer Science 2024-11-05 Maximilian Kruse , Sebastian Krumscheid

Most modern imaging systems incorporate a computational pipeline to infer the image of interest from acquired measurements. The Bayesian approach to solve such ill-posed inverse problems involves the characterization of the posterior…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Pakshal Bohra , Thanh-an Pham , Jonathan Dong , Michael Unser

The use of non-differentiable priors in Bayesian statistics has become increasingly popular, in particular in Bayesian imaging analysis. Current state of the art methods are approximate in the sense that they replace the posterior with a…

Methodology · Statistics 2021-03-17 Jacob Vorstrup Goldman , Torben Sell , Sumeetpal Sidhu Singh

Current deep learning-based solutions for image analysis tasks are commonly incapable of handling problems to which multiple different plausible solutions exist. In response, posterior-based methods such as conditional Diffusion Models and…

We propose self-diffusion, a novel framework for solving inverse problems without relying on pretrained generative models. Traditional diffusion-based approaches require training a model on a clean dataset to learn to reverse the forward…

Machine Learning · Computer Science 2025-12-09 Guanxiong Luo , Shoujin Huang , Yanlong Yang

Recent advances in diffusion models have demonstrated their strong capabilities in generating high-fidelity samples from complex distributions through an iterative refinement process. Despite the empirical success of diffusion models in…

Robotics · Computer Science 2024-07-03 Chaoyi Pan , Zeji Yi , Guanya Shi , Guannan Qu

This work introduces a sampling method capable of solving Bayesian inverse problems in function space. It does not assume the log-concavity of the likelihood, meaning that it is compatible with nonlinear inverse problems. The method…

Machine Learning · Statistics 2024-05-27 Lorenzo Baldassari , Ali Siahkoohi , Josselin Garnier , Knut Solna , Maarten V. de Hoop

We present Bayesian Diffusion Models (BDM), a prediction algorithm that performs effective Bayesian inference by tightly coupling the top-down (prior) information with the bottom-up (data-driven) procedure via joint diffusion processes. We…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Haiyang Xu , Yu Lei , Zeyuan Chen , Xiang Zhang , Yue Zhao , Yilin Wang , Zhuowen Tu

Inverse problems are ubiquitous in nature, arising in almost all areas of science and engineering ranging from geophysics and climate science to astrophysics and biomechanics. One of the central challenges in solving inverse problems is…

Machine Learning · Statistics 2022-09-21 Dhruv V Patel , Deep Ray , Assad A Oberai

While diffusion priors generate high-quality posterior samples across many inverse problems, they are often trained on limited training sets or purely simulated data, thus inheriting the errors and biases of these underlying sources.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Frederic Wang , Katherine L. Bouman

Amortized simulator-based inference offers a powerful framework for tackling Bayesian inference in computational fields such as engineering or neuroscience, increasingly leveraging modern generative methods like diffusion models to map…