English
Related papers

Related papers: Sampling Methods for Bayesian Inference Involving …

200 papers

The standard Kernel Quadrature method for numerical integration with random point sets (also called Bayesian Monte Carlo) is known to converge in root mean square error at a rate determined by the ratio $s/d$, where $s$ and $d$ encode the…

Machine Learning · Statistics 2017-08-01 Francois-Xavier Briol , Chris J. Oates , Jon Cockayne , Wilson Ye Chen , Mark Girolami

We consider the problem of estimating rare event probabilities, focusing on systems whose evolution is governed by differential equations with uncertain input parameters. If the system dynamics is expensive to compute, standard sampling…

Computation · Statistics 2019-11-05 Siddhant Wahal , George Biros

In computational inverse problems, it is common that a detailed and accurate forward model is approximated by a computationally less challenging substitute. The model reduction may be necessary to meet constraints in computing time when…

Methodology · Statistics 2018-02-14 Daniela Calvetti , Matthew M. Dunlop , Erkki Somersalo , Andrew M. Stuart

This work introduces a sampling method capable of solving Bayesian inverse problems in function space. It does not assume the log-concavity of the likelihood, meaning that it is compatible with nonlinear inverse problems. The method…

Machine Learning · Statistics 2024-05-27 Lorenzo Baldassari , Ali Siahkoohi , Josselin Garnier , Knut Solna , Maarten V. de Hoop

Bayesian methods are commonly applied to solve image analysis problems such as noise-reduction, feature enhancement and object detection. A primary limitation of these approaches is the computational complexity due to the interdependence of…

Methodology · Statistics 2023-06-01 Konstantinos Bakas , John Kornak , Hernando Ombao

Diffusion models enable the synthesis of highly accurate samples from complex distributions and have become foundational in generative modeling. Recently, they have demonstrated significant potential for solving Bayesian inverse problems by…

Machine Learning · Computer Science 2025-10-17 Yazid Janati , Alain Durmus , Jimmy Olsson , Eric Moulines

Models with intractable normalizing functions arise frequently in statistics. Common examples of such models include exponential random graph models for social networks and Markov point processes for ecology and disease modeling. Inference…

Computation · Statistics 2018-08-03 Jaewoo Park , Murali Haran

Bayesian inference in deep neural networks is challenging due to the high-dimensional, strongly multi-modal parameter posterior density landscape. Markov chain Monte Carlo approaches asymptotically recover the true posterior but are…

Bayesian inference for models that have an intractable partition function is known as a doubly intractable problem, where standard Monte Carlo methods are not applicable. The past decade has seen the development of auxiliary variable Monte…

Computation · Statistics 2017-10-13 Richard G. Everitt , Dennis Prangle , Philip Maybank , Mark Bell

Deep neural networks have proven extremely efficient at solving a wide rangeof inverse problems, but most often the uncertainty on the solution they provideis hard to quantify. In this work, we propose a generic Bayesian framework…

Machine Learning · Statistics 2020-11-18 Zaccharie Ramzi , Benjamin Remy , Francois Lanusse , Jean-Luc Starck , Philippe Ciuciu

In this paper we consider Bayesian estimation for the parameters of inverse Gaussian distribution. Our emphasis is on Markov Chain Monte Carlo methods. We provide complete implementation of the Gibbs sampler algorithm. Assuming an…

Methodology · Statistics 2012-10-17 B. N. Pandey , Pulastya Bandyopadhyay

This paper addresses the challenging computational problem of estimating intractable expectations over discrete domains. Existing approaches, including Monte Carlo and Russian Roulette estimators, are consistent but often require a large…

Machine Learning · Statistics 2025-12-19 Sophia Seulkee Kang , François-Xavier Briol , Toni Karvonen , Zonghao Chen

Sparse representations have proven their efficiency in solving a wide class of inverse problems encountered in signal and image processing. Conversely, enforcing the information to be spread uniformly over representation coefficients…

Machine Learning · Statistics 2017-12-29 Clément Elvira , Pierre Chainais , Nicolas Dobigeon

In many problems, complex non-Gaussian and/or nonlinear models are required to accurately describe a physical system of interest. In such cases, Monte Carlo algorithms are remarkably flexible and extremely powerful approaches to solve such…

Computation · Statistics 2015-04-23 Thi Le Thu Nguyen , Francois Septier , Gareth W. Peters , Yves Delignon

In Bayesian inverse problems, it is common to consider several hyperparameters that define the prior and the noise model that must be estimated from the data. In particular, we are interested in linear inverse problems with additive…

Numerical Analysis · Mathematics 2024-12-05 Julianne Chung , Scot M. Miller , Malena Sabate Landman , Arvind K. Saibaba

Astronomers are often confronted with funky populations and distributions of objects: brighter objects are more likely to be detected; targets are selected based on colour cuts; imperfect classification yields impure samples. Failing to…

Cosmology and Nongalactic Astrophysics · Physics 2017-06-21 Samuel R. Hinton , Alex Kim , Tamara M. Davis

Monte Carlo (MC) integration is the de facto method for approximating the predictive distribution of Bayesian neural networks (BNNs). But, even with many MC samples, Gaussian-based BNNs could still yield bad predictive performance due to…

Machine Learning · Computer Science 2022-10-18 Agustinus Kristiadi , Runa Eschenhagen , Philipp Hennig

The Bayesian approach to Inverse Problems relies predominantly on Markov Chain Monte Carlo methods for posterior inference. The typical nonlinear concentration of posterior measure observed in many such Inverse Problems presents severe…

Computation · Statistics 2016-02-17 Shiwei Lan , Tan Bui-Thanh , Mike Christie , Mark Girolami

Using Markov chain Monte Carlo to sample from posterior distributions was the key innovation which made Bayesian data analysis practical. Notoriously, however, MCMC is hard to tune, hard to diagnose, and hard to parallelize. This…

Computation · Statistics 2022-03-18 Cosma Rohilla Shalizi

We present a new approach to Bayesian inference that entirely avoids Markov chain simulation, by constructing a map that pushes forward the prior measure to the posterior measure. Existence and uniqueness of a suitable measure-preserving…

Computation · Statistics 2012-08-31 Tarek A. El Moselhy , Youssef M. Marzouk