English
Related papers

Related papers: On submodularity of the expected information gain

200 papers

We study the inverse problem of recovering the order and the diffusion coefficient of an elliptic fractional partial differential equation from a finite number of noisy observations of the solution. We work in a Bayesian framework and show…

Analysis of PDEs · Mathematics 2017-06-28 Nicolas Garcia Trillos , Daniel Sanz-Alonso

Inverse analysis, such as model calibration, often suffers from a lack of informative data in complex real-world scenarios. The standard remedy, designing new experimental setups, is often costly and time-consuming, while readily available…

Computational Engineering, Finance, and Science · Computer Science 2026-01-16 Lea J. Haeusel , Jonas Nitzler , Lea J. Köglmeier , Wolfgang A. Wall

We demonstrate a measure for the effective number of parameters constrained by a posterior distribution in the context of cosmology. In the same way that the mean of the Shannon information (i.e. the Kullback-Leibler divergence) provides a…

Cosmology and Nongalactic Astrophysics · Physics 2019-11-26 Will Handley , Pablo Lemos

We construct optimal low-rank approximations for the Gaussian posterior distribution in linear Gaussian inverse problems with possibly infinite-dimensional separable Hilbert parameter spaces and finite-dimensional data spaces. We first…

Statistics Theory · Mathematics 2026-04-09 Giuseppe Carere , Han Cheng Lie

We propose a new model selection method, the posterior averaging information criterion, for Bayesian model assessment from a predictive perspective. The theoretical foundation is built on the Kullback-Leibler divergence to quantify the…

Methodology · Statistics 2020-09-22 Shouhao Zhou

The statistical inverse problem of estimating the probability distribution of an infinite-dimensional unknown given its noisy indirect observation is studied in the Bayesian framework. In practice, one often considers only…

Statistics Theory · Mathematics 2017-11-21 Sari Lasanen

In a first part, we present a mathematical analysis of a general methodology of a probabilistic learning inference that allows for estimating a posterior probability model for a stochastic boundary value problem from a prior probability…

Machine Learning · Statistics 2022-06-08 Christian Soize

Classic Bayesian methods with complex models are frequently infeasible due to an intractable likelihood. Simulation-based inference methods, such as Approximate Bayesian Computing (ABC), calculate posteriors without accessing a likelihood…

Computation · Statistics 2026-01-09 Elliot Maceda , Emily C. Hector , Amanda Lenzi , Brian J. Reich

In this work, we adopt a general framework based on the Gibbs posterior to update belief distributions for inverse problems governed by partial differential equations (PDEs). The Gibbs posterior formulation is a generalization of standard…

Computation · Statistics 2019-07-04 Zilong Zou , Sayan Mukherjee , Harbir Antil , Wilkins Aquino

In inverse problems, the parameters of a model are estimated based on observations of the model response. The Bayesian approach is powerful for solving such problems; one formulates a prior distribution for the parameter state that is…

Computation · Statistics 2022-06-08 Max Ehre , Rafael Flock , Martin Fußeder , Iason Papaioannou , Daniel Straub

We consider predictive density estimation under logarithmic score for $d$-dimensional infinitely divisible location models. Taking the formal Bayes predictive density under the Lebesgue prior as a benchmark, we study the Kullback-Leibler…

Statistics Theory · Mathematics 2026-05-27 Kōsaku Takanashi , Kenichiro McAlinn

Bayesian inverse problems use data to update a prior probability distribution on uncertain parameter values to a posterior distribution. Such problems arise in many structural engineering applications, but computational solution of Bayesian…

Numerical Analysis · Mathematics 2026-05-26 Jakob Scheffels , Elizabeth Qian , Iason Papaioannou , Elisabeth Ullmann

Current approaches in approximate inference for Bayesian neural networks minimise the Kullback-Leibler divergence to approximate the true posterior over the weights. However, this approximation is without knowledge of the final application,…

Machine Learning · Statistics 2018-05-11 Adam D. Cobb , Stephen J. Roberts , Yarin Gal

This paper is concerned with the numerical solution of model-based, Bayesian inverse problems. We are particularly interested in cases where the cost of each likelihood evaluation (forward-model call) is expensive and the number of un-…

Computation · Statistics 2016-07-25 Isabell M. Franck , P. S. Koutsourelakis

In a Bayesian setting, inverse problems and uncertainty quantification (UQ) - the propagation of uncertainty through a computational (forward) model - are strongly connected. In the form of conditional expectation the Bayesian update…

Numerical Analysis · Mathematics 2014-04-09 Alexander Litvinenko , Hermann G. Matthies

In the Bayesian approach to inverse problems, data are often informative, relative to the prior, only on a low-dimensional subspace of the parameter space. Significant computational savings can be achieved by using this subspace to…

Numerical Analysis · Mathematics 2015-07-07 Alessio Spantini , Antti Solonen , Tiangang Cui , James Martin , Luis Tenorio , Youssef Marzouk

We consider a Bayesian nonparametric approach to a family of linear inverse problems in a separable Hilbert space setting with Gaussian noise. We assume Gaussian priors, which are conjugate to the model, and present a method of identifying…

Statistics Theory · Mathematics 2013-08-05 Sergios Agapiou , Stig Larsson , Andrew M. Stuart

We consider the statistical linear inverse problem of making inference on an unknown source function in an elliptic partial differential equation from noisy observations of its solution. We employ nonparametric Bayesian procedures based on…

Statistics Theory · Mathematics 2024-07-26 Matteo Giordano

We present a method for computing A-optimal sensor placements for infinite-dimensional Bayesian linear inverse problems governed by PDEs with irreducible model uncertainties. Here, irreducible uncertainties refers to uncertainties in the…

Optimization and Control · Mathematics 2020-08-26 Karina Koval , Alen Alexanderian , Georg Stadler

We propose a structured prior for high-dimensional Bayesian inverse problems based on a disentangled deep generative model whose latent space is partitioned into auxiliary variables aligned with known and interpretable physical parameters…

Computation · Statistics 2026-04-03 Arkaprabha Ganguli , Emil Constantinescu