English
Related papers

Related papers: Laplace's method in Bayesian inverse problems

200 papers

Finding the optimal design of experiments in the Bayesian setting typically requires estimation and optimization of the expected information gain functional. This functional consists of one outer and one inner integral, separated by the…

Numerical Analysis · Mathematics 2024-11-26 Arved Bartuska , Luis Espath , Raúl Tempone

Constraints are a natural choice for prior information in Bayesian inference. In various applications, the parameters of interest lie on the boundary of the constraint set. In this paper, we use a method that implicitly defines a…

Statistics Theory · Mathematics 2022-09-27 Jasper Marijn Everink , Yiqiu Dong , Martin Skovgaard Andersen

We propose a Bayesian inference framework to estimate uncertainties in inverse scattering problems. Given the observed data, the forward model and their uncertainties, we find the posterior distribution over a finite parameter field…

Numerical Analysis · Mathematics 2020-11-17 Ana Carpio , Sergei Iakunin , Georg Stadler

The subject of this article is the introduction of a new concept of well-posedness of Bayesian inverse problems. The conventional concept of (Lipschitz, Hellinger) well-posedness in [Stuart 2010, Acta Numerica 19, pp. 451-559] is difficult…

Statistics Theory · Mathematics 2020-03-16 Jonas Latz

Posterior inference for Dirichlet process mixture models is analytically intractable and typically relies on Markov chain Monte Carlo methods, which can become computationally prohibitive at moderate to large sample sizes. In this work, we…

Computation · Statistics 2026-04-29 Beatrice Franzolini , Francesco Pozza

Bayesian inference typically requires the computation of an approximation to the posterior distribution. An important requirement for an approximate Bayesian inference algorithm is to output high-accuracy posterior mean and uncertainty…

Statistics Theory · Mathematics 2018-10-03 Jonathan H. Huggins , Trevor Campbell , Mikołaj Kasprzak , Tamara Broderick

Although Bayesian methods are robust and principled, their application in practice could be limited since they typically rely on computationally intensive Markov Chain Monte Carlo algorithms for their implementation. One possible solution…

Computation · Statistics 2015-10-06 Tian Chen , Jeffrey Streets , Babak Shahbaba

We formulate, and present a numerical method for solving, an inverse problem for inferring parameters of a deterministic model from stochastic observational data (quantities of interest). The solution, given as a probability measure, is…

Numerical Analysis · Mathematics 2021-05-04 T. Butler , J. D. Jakeman , T. Wildey

Bayesian inference on non-Gaussian data is often non-analytic and requires computationally expensive approximations such as sampling or variational inference. We propose an approximate inference framework primarily designed to be…

Machine Learning · Computer Science 2022-10-12 Marius Hobbhahn , Philipp Hennig

We study the well-posedness of the Bayesian inverse problem for scalar hyperbolic conservation laws where the statistical information about inputs such as the initial datum and (possibly discontinuous) flux function are inferred from noisy…

Numerical Analysis · Mathematics 2021-07-23 Siddhartha Mishra , David Ochsner , Adrian M. Ruf , Franziska Weber

The intrinsic dimensionality of an inverse problem is affected by prior information, the accuracy and number of observations, and the smoothing properties of the forward operator. From a Bayesian perspective, changes from the prior to the…

Computation · Statistics 2016-05-03 Tiangang Cui , James Martin , Youssef M. Marzouk , Antti Solonen , Alessio Spantini

Modern applications routinely collect high-dimensional data, leading to statistical models having more parameters than there are samples available. A common solution is to impose sparsity in parameter estimation, often using penalized…

Methodology · Statistics 2025-07-08 Paolo Onorati , David B. Dunson , Antonio Canale

We consider the Bayesian approach to linear inverse problems when the underlying operator depends on an unknown parameter. Allowing for finite dimensional as well as infinite dimensional parameters, the theory covers several models with…

Statistics Theory · Mathematics 2018-09-05 Mathias Trabs

There are several challenges associated with inverse problems in which we seek to reconstruct a piecewise constant field, and which we model using multiple level sets. Adopting a Bayesian viewpoint, we impose prior distributions on both the…

Numerical Analysis · Mathematics 2021-12-01 William Reese , Arvind K. Saibaba , Jonghyun Lee

In calculating expected information gain in optimal Bayesian experimental design, the computation of the inner loop in the classical double-loop Monte Carlo requires a large number of samples and suffers from underflow if the number of…

Numerical Analysis · Mathematics 2018-04-04 Joakim Beck , Ben Mansour Dia , Luis FR Espath , Quan Long , Raul Tempone

In solving Bayesian inverse problems, it is often desirable to use a common density parameterization to denote the prior and posterior. Typically we seek a density from the same family as the prior which closely approximates the true…

Numerical Analysis · Mathematics 2022-03-29 Xiao-Mei Yang , Zhi-Liang Deng

It is well known that the Lasso can be interpreted as a Bayesian posterior mode estimate with a Laplacian prior. Obtaining samples from the full posterior distribution, the Bayesian Lasso, confers major advantages in performance as compared…

Computation · Statistics 2018-01-09 Marcela Mendoza , Alexis Allegra , Todd P. Coleman

We consider the statistical linear inverse problem of making inference on an unknown source function in an elliptic partial differential equation from noisy observations of its solution. We employ nonparametric Bayesian procedures based on…

Statistics Theory · Mathematics 2024-07-26 Matteo Giordano

We study Bayesian inference methods for solving linear inverse problems, focusing on hierarchical formulations where the prior or the likelihood function depend on unspecified hyperparameters. In practice, these hyperparameters are often…

Numerical Analysis · Mathematics 2018-08-01 Qingping Zhou , Wenqing Liu , Jinglai Li , Youssef M. Marzouk

Latent Gaussian models (LGMs) are a popular class of Bayesian hierarchical models that include Gaussian processes, as well as certain spatial models and mixed-effect models. Efficient Bayesian inference of LGMs often requires marginalizing…

Machine Learning · Statistics 2026-05-21 Jinlin Lai , Charles C. Margossian , Daniel R. Sheldon