English
Related papers

Related papers: Dimension-Robust MCMC in Bayesian Inverse Problems

200 papers

A common task in experimental sciences is to fit mathematical models to real-world measurements to improve understanding of natural phenomenon (reverse-engineering or inverse modeling). When complex dynamical systems are considered, such as…

Numerical Analysis · Mathematics 2018-06-18 Jean-Charles Croix , Nicolas Durrande , Mauricio Alvarez

Uncertainty quantification for full-waveform inversion provides a probabilistic characterization of the ill-conditioning of the problem, comprising the sensitivity of the solution with respect to the starting model and data noise. This…

Geophysics · Physics 2020-04-20 Gabrio Rizzuti , Ali Siahkoohi , Philipp A. Witte , Felix J. Herrmann

We propose a methodology for modeling and comparing probability distributions within a Bayesian nonparametric framework. Building on dependent normalized random measures, we consider a prior distribution for a collection of discrete random…

Methodology · Statistics 2022-06-01 Mario Beraha , Jim E. Griffin

Bayesian hierarchical models have been demonstrated to provide efficient algorithms for finding sparse solutions to ill-posed inverse problems. The models comprise typically a conditionally Gaussian prior model for the unknown, augmented by…

Numerical Analysis · Mathematics 2023-03-31 Daniela Calvetti , Erkki Somersalo

Formulating a statistical inverse problem as one of inference in a Bayesian model has great appeal, notably for what this brings in terms of coherence, the interpretability of regularisation penalties, the integration of all uncertainties,…

Statistics Theory · Mathematics 2012-12-19 Natalia A. Bochkina , Peter J. Green

The Bayesian approach to machine learning amounts to computing posterior distributions of random variables from a probabilistic model of how the variables are related (that is, a prior distribution) and a set of observations of variables.…

Logic in Computer Science · Computer Science 2015-07-01 Johannes Borgström , Andrew D Gordon , Michael Greenberg , James Margetson , Jurgen Van Gael

One of the major challenges in the Bayesian solution of inverse problems governed by partial differential equations (PDEs) is the computational cost of repeatedly evaluating numerical PDE models, as required by Markov chain Monte Carlo…

Computation · Statistics 2016-05-03 Tiangang Cui , Youssef M. Marzouk , Karen E. Willcox

Many inverse problems arising in applications come from continuum models where the unknown parameter is a field. In practice the unknown field is discretized resulting in a problem in $\mathbb{R}^N$, with an understanding that refining the…

Statistics Theory · Mathematics 2014-07-16 Sergios Agapiou , Johnathan M. Bardsley , Omiros Papaspiliopoulos , Andrew M. Stuart

This paper is devoted to the problem of sampling Gaussian fields in high dimension. Solutions exist for two specific structures of inverse covariance : sparse and circulant. The proposed approach is valid in a more general case and…

Computation · Statistics 2011-05-31 F. Orieux , O. Féron , J. -F. Giovannelli

Inverse problems, i.e., estimating parameters of physical models from experimental data, are ubiquitous in science and engineering. The Bayesian formulation is the gold standard because it alleviates ill-posedness issues and quantifies…

Machine Learning · Statistics 2024-05-28 Sharmila Karumuri , Ilias Bilionis

Bayesian methods have been very successful in quantifying uncertainty in physics-based problems in parameter estimation and prediction. In these cases, physical measurements y are modeled as the best fit of a physics-based model…

Data Analysis, Statistics and Probability · Physics 2015-02-06 Dave Higdon , Jordan D. McDonnell , Nicolas Schunck , Jason Sarich , Stefan M. Wild

We address the challenge of quantifying Bayesian uncertainty and incorporating it in offline use cases of finite-state Markov Decision Processes (MDPs) with unknown dynamics. Our approach provides a principled method to disentangle…

Machine Learning · Computer Science 2024-06-05 Filippo Valdettaro , A. Aldo Faisal

While deep neural networks have become the go-to approach in computer vision, the vast majority of these models fail to properly capture the uncertainty inherent in their predictions. Estimating this predictive uncertainty can be crucial,…

Machine Learning · Computer Science 2020-04-08 Fredrik K. Gustafsson , Martin Danelljan , Thomas B. Schön

Bayesian analysis often concerns an evaluation of models with different dimensionality as is necessary in, for example, model selection or mixture models. To facilitate this evaluation, transdimensional Markov chain Monte Carlo (MCMC)…

Methodology · Statistics 2018-08-13 Daniel W. Heck , Antony M. Overstall , Quentin F. Gronau , Eric-Jan Wagenmakers

In many inverse problems, model parameters cannot be precisely determined from observational data. Bayesian inference provides a mechanism for capturing the resulting parameter uncertainty, but typically at a high computational cost. This…

Computation · Statistics 2019-03-28 Matthew Parno , Tarek Moselhy , Youssef Marzouk

The present paper proposes a Bayesian framework for inverse problems that seamlessly integrates optimization and inversion to enable rapid surrogate modeling, accurate parameter inference, and rigorous uncertainty quantification. Bayesian…

Computational Engineering, Finance, and Science · Computer Science 2026-02-05 Mihaela Chiappetta , Massimo Carraturo , Alexander Raßloff , Markus Kästner , Ferdinando Auricchio

Multidimensional scaling (MDS) is widely used to reconstruct a low-dimensional representation of high-dimensional data while preserving pairwise distances. However, Bayesian MDS approaches based on Markov chain Monte Carlo (MCMC) face…

Methodology · Statistics 2026-02-26 Jiarui Zhang , Jiguo Cao , Liangliang Wang

The Bayesian formulation of inverse problems is attractive for three primary reasons: it provides a clear modelling framework; means for uncertainty quantification; and it allows for principled learning of hyperparameters. The posterior…

Statistics Theory · Mathematics 2019-05-14 Matthew M. Dunlop , Tapio Helin , Andrew M. Stuart

The intrinsic dimensionality of an inverse problem is affected by prior information, the accuracy and number of observations, and the smoothing properties of the forward operator. From a Bayesian perspective, changes from the prior to the…

Computation · Statistics 2016-05-03 Tiangang Cui , James Martin , Youssef M. Marzouk , Antti Solonen , Alessio Spantini

Recent advancements in solving Bayesian inverse problems have spotlighted denoising diffusion models (DDMs) as effective priors. Although these have great potential, DDM priors yield complex posterior distributions that are challenging to…

Machine Learning · Statistics 2024-11-14 Yazid Janati , Badr Moufad , Alain Durmus , Eric Moulines , Jimmy Olsson