English
Related papers

Related papers: On submodularity of the expected information gain

200 papers

This paper deals with the problem of estimating predictive densities of a matrix-variate normal distribution with known covariance matrix. Our main aim is to establish some Bayesian predictive densities related to matricial shrinkage…

Statistics Theory · Mathematics 2017-04-03 Hisayuki Tsukuma , Tatsuya Kubokawa

We derive a novel version of information-disturbance theorems for mutually unbiased observables. We show that the information gain by Eve inevitably makes the outcomes by Bob in the conjugate basis not only erroneous but random.

Quantum Physics · Physics 2007-05-23 Takayuki Miyadera , Hideki Imai

We consider inverse problems in Hilbert spaces under correlated Gaussian noise and use a Bayesian approach to find their regularised solution. We focus on mildly ill-posed inverse problems with the noise being generalised derivative of…

Statistics Theory · Mathematics 2023-11-21 Natalia Bochkina , Jenovah Rodrigues

Bayesian optimal experimental design provides a principled framework for selecting experimental settings that maximize obtained information. In this work, we focus on estimating the expected information gain in the setting where the…

Machine Learning · Statistics 2025-10-02 Chuntao Chen , Tapio Helin , Nuutti Hyvönen , Yuya Suzuki

For linear inverse problems with Gaussian priors and Gaussian observation noise, the posterior is Gaussian, with mean and covariance determined by the conditioning formula. Using the Feldman-Hajek theorem, we analyse the prior-to-posterior…

Statistics Theory · Mathematics 2025-04-07 Giuseppe Carere , Han Cheng Lie

Doubly intractable problems occur when both the likelihood and the posterior are available only in unnormalised form, with computationally intractable normalisation constants. Bayesian inference then typically requires direct approximation…

In many tasks, in particular in natural science, the goal is to determine hidden system parameters from a set of measurements. Often, the forward process from parameter- to measurement-space is a well-defined function, whereas the inverse…

Bayesian optimal experimental design is a principled framework for conducting experiments that leverages Bayesian inference to quantify how much information one can expect to gain from selecting a certain design. However, accurate Bayesian…

Machine Learning · Statistics 2025-11-12 Yasir Zubayr Barlas , Sabina J. Sloman , Samuel Kaski

This article considers output-feedback control of systems where the function mapping states to measurements has a set-valued inverse. We show that if the set has a bounded number of elements, then minimax dual control of such systems admits…

Optimization and Control · Mathematics 2024-05-17 Olle Kjellqvist

Recent advances in reconstruction methods for inverse problems leverage powerful data-driven models, e.g., deep neural networks. These techniques have demonstrated state-of-the-art performances for several imaging tasks, but they often do…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Riccardo Barbano , Chen Zhang , Simon Arridge , Bangti Jin

Posterior distributions arising in ill-posed Bayesian inverse problems are often both analytically intractable and highly sensitive to parameters of the chosen prior family. We aim to understand the sensitivity of intractable posterior…

Methodology · Statistics 2026-04-20 Yucong Liu , Zilai Si , Alexander Strang

Bayesian doubly robust (DR) causal inference faces a fundamental dilemma: joint modeling of outcome and propensity score suffers from the feedback problem where outcome information contaminates propensity score estimation, while two-step…

Methodology · Statistics 2026-01-05 Shunichiro Orihara , Tomotaka Momozaki , Shonosuke Sugasawa

While standard generative adversarial networks (GANs) rely solely on training data to learn unknown probability distributions, physics-informed GANs (PI-GANs) encode physical laws in the form of stochastic partial differential equations…

Image and Video Processing · Electrical Eng. & Systems 2020-06-11 James E. Warner , Julian Cuevas , Geoffrey F. Bomarito , Patrick E. Leser , William P. Leser

Recent advances in deep learning have brought to the fore models that can make multiple computational steps in the service of completing a task; these are capable of describ- ing long-term dependencies in sequential data. Novel recurrent…

Machine Learning · Computer Science 2018-09-06 Kyriakos Tolias , Sotirios Chatzis

Variational Bayesian inference is an important machine-learning tool that finds application from statistics to robotics. The goal is to find an approximate probability density function (PDF) from a chosen family that is in some sense…

Machine Learning · Computer Science 2022-09-27 Timothy D. Barfoot , Gabriele M. T. D'Eleuterio

Gaussian process regression is widely applied in computational science and engineering for surrogate modeling owning to its kernel-based and probabilistic nature. In this work, we propose a Bayesian approach that integrates the variability…

Machine Learning · Computer Science 2025-01-03 Dongwei Ye , Weihao Yan , Christoph Brune , Mengwu Guo

This paper focuses on inverse problems to identify parameters by incorporating information from measurements. These generally ill-posed problems are formulated here in a probabilistic setting based on Bayes's theorem because it leads to a…

Numerical Analysis · Mathematics 2019-12-20 Jaroslav Vondřejc , Hermann G. Matthies

We introduce a methodology for nonlinear inverse problems using a variational Bayesian approach where the unknown quantity is a spatial field. A structured Bayesian Gaussian process latent variable model is used both to construct a…

Machine Learning · Statistics 2019-02-20 Steven Atkinson , Nicholas Zabaras

In this paper, we compare the performance of two methods for estimating Bayesian networks from data containing exogenous variables and random effects. The first method is fully Bayesian in which a prior distribution is placed on the…

Methodology · Statistics 2011-12-02 Jessica Kasza , Patty Solomon

Bayesian approach, as a useful tool for quantifying uncertainties, has been widely used for solving inverse problems of partial differential equations (PDEs). One of the key difficulties for employing Bayesian approach for the issue is how…

Numerical Analysis · Mathematics 2026-02-09 Junxiong Jia , Qian Zhao , Zongben Xu , Deyu Meng , Yee Leung