English
Related papers

Related papers: Noise-Adaptive Diffusion Sampling for Inverse Prob…

200 papers

Diffusion models have recently emerged as powerful generative priors for solving inverse problems. However, training diffusion models in the pixel space are both data-intensive and computationally demanding, which restricts their…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Bowen Song , Soo Min Kwon , Zecheng Zhang , Xinyu Hu , Qing Qu , Liyue Shen

We introduce a Hamiltonian Monte Carlo (HMC) methodology based on a randomized selection of integration times, referred to as eHMC, where "e" stands for empirical. The approach relies on an offline calibration phase that leverages…

Computation · Statistics 2026-05-25 Changye Wu , Pierre Pudlo , Christian P. Robert , Julien Stoehr

Hamiltonian Monte Carlo (HMC) is a premier Markov Chain Monte Carlo (MCMC) algorithm for continuous target distributions. Its full potential can only be unleashed when its problem-dependent hyperparameters are tuned well. The adaptation of…

Computation · Statistics 2022-05-10 Pavel Sountsov , Matt D. Hoffman

Hamiltonian Monte Carlo (HMC) samples efficiently from high-dimensional posterior distributions with proposed parameter draws obtained by iterating on a discretized version of the Hamiltonian dynamics. The iterations make HMC…

Computation · Statistics 2019-05-03 Khue-Dung Dang , Matias Quiroz , Robert Kohn , Minh-Ngoc Tran , Mattias Villani

We propose a deterministic-statistical method for an inverse source problem using multiple frequency limited aperture far field data. The direct sampling method is used to obtain a disc such that it contains the compact support of the…

Numerical Analysis · Mathematics 2022-09-20 Yanfang Liu , Zhizhang Wu , Jiguang Sun , Zhiwen Zhang

Pretrained diffusion models have demonstrated strong capabilities in zero-shot inverse problem solving by incorporating observation information into the generation process of the diffusion models. However, this presents an inherent dilemma:…

Machine Learning · Computer Science 2026-05-05 Xun Su , Hiroyuki Kasai

We describe a new MCMC method optimized for the sampling of probability measures on Hilbert space which have a density with respect to a Gaussian; such measures arise in the Bayesian approach to inverse problems, and in conditioned…

Probability · Mathematics 2014-04-04 Michela Ottobre , Natesh S. Pillai , Frank J. Pinski , Andrew M. Stuart

Denoising diffusion models have recently emerged as the predominant paradigm for generative modelling on image domains. In addition, their extension to Riemannian manifolds has facilitated a range of applications across the natural…

Machine Learning · Computer Science 2023-11-10 Nic Fishman , Leo Klarner , Emile Mathieu , Michael Hutchinson , Valentin de Bortoli

Bayesian formulation of modern day signal processing problems has called for improved Markov chain Monte Carlo (MCMC) sampling algorithms for inference. The need for efficient sampling techniques has become indispensable for high…

Computation · Statistics 2025-10-28 Apratim Shukla , Dootika Vats , Eric C. Chi

High-throughput characterization often requires estimating parameters and model dimension from experimental data of limited quantity and quality. Such data may result in an ill-posed inverse problem, where multiple sets of parameters and…

Quantum Physics · Physics 2026-04-08 Abigail N. Poteshman , Jiwon Yun , Tim H. Taminiau , Giulia Galli

Hamiltonian Monte Carlo (HMC) is an efficient method of simulating smooth distributions and has motivated the widely used No-U-turn Sampler (NUTS) and software Stan. We build on NUTS and the technique of "unbiased sampling" to design HMC…

Computation · Statistics 2022-12-26 George M. Leigh , Amanda R. Northrop

Many inference problems involve inferring the number $N$ of components in some region, along with their properties $\{\mathbf{x}_i\}_{i=1}^N$, from a dataset $\mathcal{D}$. A common statistical example is finite mixture modelling. In the…

Computation · Statistics 2015-01-15 Brendon J. Brewer

With the great success of diffusion models in image generation, diffusion-based image compression is attracting increasing interests. However, due to the random noise introduced in the diffusion learning, they usually produce…

Image and Video Processing · Electrical Eng. & Systems 2026-04-09 Zhenyu Du , Yanbo Gao , Shuai Li , Yiyang Li , Hui Yuan , Mao Ye

The identification of parameters in mathematical models using noisy observations is a common task in uncertainty quantification. We employ the framework of Bayesian inversion: we combine monitoring and observational data with prior…

Computation · Statistics 2018-05-11 Jonas Latz , Iason Papaioannou , Elisabeth Ullmann

This work introduces a sampling method capable of solving Bayesian inverse problems in function space. It does not assume the log-concavity of the likelihood, meaning that it is compatible with nonlinear inverse problems. The method…

Machine Learning · Statistics 2024-05-27 Lorenzo Baldassari , Ali Siahkoohi , Josselin Garnier , Knut Solna , Maarten V. de Hoop

Hamiltonian Monte Carlo is a powerful algorithm for sampling from difficult-to-normalize posterior distributions. However, when the geometry of the posterior is unfavorable, it may take many expensive evaluations of the target distribution…

Diffusion models have emerged as a powerful foundation model for visual generations. With an appropriate sampling process, it can effectively serve as a generative prior for solving general inverse problems. Current posterior sampling-based…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Shijie Zhou , Huaisheng Zhu , Rohan Sharma , Jiayi Chen , Ruiyi Zhang , Kaiyi Ji , Changyou Chen

Hamiltonian Monte Carlo (HMC) is a powerful and accurate method to sample from the posterior distribution in Bayesian inference. However, HMC techniques are computationally demanding for Bayesian neural networks due to the high…

Machine Learning · Statistics 2025-09-11 Ponkrshnan Thiagarajan , Tamer A. Zaki , Michael D. Shields

The pretrained diffusion model as a strong prior has been leveraged to address inverse problems in a zero-shot manner without task-specific retraining. Different from the unconditional generation, the measurement-guided generation requires…

Optimization and Control · Mathematics 2025-03-14 Ji Li , Chao Wang

In this work we present a new and efficient Bayesian method for nonlinear three dimensional large scale structure inference. We employ a Hamiltonian Monte Carlo (HMC) sampler to obtain samples from a multivariate highly non-Gaussian…

Cosmology and Nongalactic Astrophysics · Physics 2015-05-14 J. Jasche , F. S. Kitaura