English
Related papers

Related papers: Posterior Contraction Rates for the Bayesian Appro…

200 papers

In Bayesian inverse problems, the posterior distribution is used to quantify uncertainty about the reconstructed solution. In practice, Markov chain Monte Carlo algorithms often are used to draw samples from the posterior distribution.…

Numerical Analysis · Mathematics 2018-03-13 D. Andrew Brown , Arvind Saibaba , Sarah Vallélian

We study full Bayesian procedures for high-dimensional linear regression. We adopt data-dependent empirical priors introduced in [1]. In their paper, these priors have nice posterior contraction properties and are easy to compute. Our paper…

Statistics Theory · Mathematics 2022-02-14 Xiao Fang , Malay Ghosh

We consider amortized Bayesian inference for nonlinear inverse problems in settings where only samples from the joint distribution of parameters and observations are available. Classical methods such as Markov chain Monte Carlo require…

Numerical Analysis · Mathematics 2026-05-19 Hojjat Kaveh , Ricardo Baptista , Andrew M. Stuart

We present a new technique, based on semivariogram methodology, for obtaining point estimates for use in prior modeling for solving Bayesian inverse problems. This method requires a connection between Gaussian processes with covariance…

Numerical Analysis · Mathematics 2020-05-12 Richard D. Brown , Johnathan M. Bardsley , Tiangang Cui

Inverse problems are often ill-posed, with solutions that depend sensitively on data. In any numerical approach to the solution of such problems, regularization of some form is needed to counteract the resulting instability. This paper is…

Numerical Analysis · Mathematics 2009-09-14 S. L. Cotter , M. Dashti , A. M. Stuart

Solving inverse problems using Bayesian methods can become prohibitively expensive when likelihood evaluations involve complex and large scale numerical models. A common approach to circumvent this issue is to approximate the forward model…

Computational Engineering, Finance, and Science · Computer Science 2023-12-14 Maximilian Dinkel , Carolin M. Geitner , Gil Robalo Rei , Jonas Nitzler , Wolfgang A. Wall

We study the use of Gaussian process emulators to approximate the parameter-to-observation map or the negative log-likelihood in Bayesian inverse problems. We prove error bounds on the Hellinger distance between the true posterior…

Numerical Analysis · Mathematics 2024-10-01 Andrew M. Stuart , Aretha L. Teckentrup

In inverse problems, it is widely recognized that the incorporation of a sparsity prior yields a regularization effect on the solution. This approach is grounded on the a priori assumption that the unknown can be appropriately represented…

Machine Learning · Statistics 2025-06-13 Giovanni S. Alberti , Luca Ratti , Matteo Santacesaria , Silvia Sciutto

We propose a general algorithm for approximating nonstandard Bayesian posterior distributions. The algorithm minimizes the Kullback-Leibler divergence of an approximating distribution to the intractable posterior distribution. Our method…

Computation · Statistics 2014-07-29 Tim Salimans , David A. Knowles

For linear inverse problems with Gaussian priors and Gaussian observation noise, the posterior is Gaussian, with mean and covariance determined by the conditioning formula. Using the Feldman-Hajek theorem, we analyse the prior-to-posterior…

Statistics Theory · Mathematics 2025-04-07 Giuseppe Carere , Han Cheng Lie

This paper develops a probabilistic numerical method for solution of partial differential equations (PDEs) and studies application of that method to PDE-constrained inverse problems. This approach enables the solution of challenging inverse…

Methodology · Statistics 2017-07-12 Jon Cockayne , Chris Oates , Tim Sullivan , Mark Girolami

We introduce a novel adaptive Gaussian Process Regression (GPR) methodology for efficient construction of surrogate models for Bayesian inverse problems with expensive forward model evaluations. An adaptive design strategy focuses on…

Numerical Analysis · Mathematics 2024-05-01 Paolo Villani , Jörg Unger , Martin Weiser

The Bayesian approach to inverse problems provides a rigorous framework for the incorporation and quantification of uncertainties in measurements, parameters and models. We are interested in designing numerical methods which are robust…

Numerical Analysis · Mathematics 2020-06-29 Claudia Schillings , Björn Sprungk , Philipp Wacker

In this paper, we propose a new Bayesian inference method for a high-dimensional sparse factor model that allows both the factor dimensionality and the sparse structure of the loading matrix to be inferred. The novelty is to introduce a…

Machine Learning · Statistics 2023-05-31 Ilsang Ohn , Lizhen Lin , Yongdai Kim

There are two major routes to address the ubiquitous family of inverse problems appearing in signal and image processing, such as denoising or deblurring. A first route relies on Bayesian modeling, where prior probabilities are used to…

Statistics Theory · Mathematics 2026-03-24 Rémi Gribonval , Mila Nikolova

We investigate the posterior rate of convergence for wavelet shrinkage using a Bayesian approach in general Besov spaces. Instead of studying the Bayesian estimator related to a particular loss function, we focus on the posterior…

Statistics Theory · Mathematics 2007-09-24 Heng Lian

Doubly intractable problems occur when both the likelihood and the posterior are available only in unnormalised form, with computationally intractable normalisation constants. Bayesian inference then typically requires direct approximation…

Despite their widespread use in practice, the asymptotic properties of Bayesian penalized splines have not been investigated so far. We close this gap and study posterior concentration rates for Bayesian penalized splines in a Gaussian…

Statistics Theory · Mathematics 2022-03-24 Paul Bach , Nadja Klein

Approximate Bayesian Computation (ABC) is typically used when the likelihood is either unavailable or intractable but where data can be simulated under different parameter settings using a forward model. Despite the recent interest in ABC,…

Methodology · Statistics 2019-12-24 Rafael Izbicki , Ann B. Lee , Taylor Pospisil

For ill-posed inverse problems, a regularised solution can be interpreted as a mode of the posterior distribution in a Bayesian framework. This framework enriches the set the solutions, as other posterior estimates can be used as a solution…

Statistics Theory · Mathematics 2013-04-22 Natalia Bochkina