English
Related papers

Related papers: Variational Gaussian Processes For Linear Inverse …

200 papers

A framework is presented for fitting inverse problem models via variational Bayes approximations. This methodology guarantees flexibility to statistical model specification for a broad range of applications, good accuracy and reduced model…

Methodology · Statistics 2024-09-05 Luca Maestrini , Robert G. Aykroyd , Matt P. Wand

In this paper, we address the fundamental problem of line spectral estimation in a Bayesian framework. We target model order and parameter estimation via variational inference in a probabilistic model in which the frequencies are…

Information Theory · Computer Science 2017-04-05 Mihai-Alin Badiu , Thomas Lundgaard Hansen , Bernard Henri Fleury

Formulating a statistical inverse problem as one of inference in a Bayesian model has great appeal, notably for what this brings in terms of coherence, the interpretability of regularisation penalties, the integration of all uncertainties,…

Statistics Theory · Mathematics 2012-12-19 Natalia A. Bochkina , Peter J. Green

The classical approach to inverse problems is based on the optimization of a misfit function. Despite its computational appeal, such an approach suffers from many shortcomings, e.g., non-uniqueness of solutions, modeling prior knowledge,…

Machine Learning · Statistics 2014-10-22 Panagiotis Tsilifis , Ilias Bilionis , Ioannis Katsounaros , Nicholas Zabaras

In this work, a method for obtaining pixel-wise error bounds in Bayesian regularization of inverse imaging problems is introduced. The proposed method employs estimates of the posterior variance together with techniques from conformal…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Dominik Narnhofer , Andreas Habring , Martin Holler , Thomas Pock

The posterior distribution in a nonparametric inverse problem is shown to contract to the true parameter at a rate that depends on the smoothness of the parameter, and the smoothness and scale of the prior. Correct combinations of these…

Statistics Theory · Mathematics 2012-02-24 B. T. Knapik , A. W. van der Vaart , J. H. van Zanten

When constructing a Bayesian Machine Learning model, we might be faced with multiple different prior distributions and thus are required to properly consider them in a sensible manner in our model. While this situation is reasonably well…

Machine Learning · Computer Science 2021-04-20 Sarem Seitz

The formulation of Bayesian inverse problems involves choosing prior distributions; choices that seem equally reasonable may lead to significantly different conclusions. We develop a computational approach to better understand the impact of…

Computation · Statistics 2026-01-08 John E. Darges , Alen Alexanderian , Pierre A. Gremaud

Latent Gaussian models (LGMs) are widely used in statistics and machine learning. Bayesian inference in non-conjugate LGMs is difficult due to intractable integrals involving the Gaussian prior and non-conjugate likelihoods. Algorithms…

Machine Learning · Statistics 2013-06-06 Mohammad Emtiyaz Khan , Aleksandr Y. Aravkin , Michael P. Friedlander , Matthias Seeger

We consider the problem of sampling from a product-of-experts-type model that encompasses many standard prior and posterior distributions commonly found in Bayesian imaging. We show that this model can be easily lifted into a novel latent…

Image and Video Processing · Electrical Eng. & Systems 2026-04-16 Muhamed Kuric , Martin Zach , Andreas Habring , Michael Unser , Thomas Pock

Regularization is a common tool in variational inverse problems to impose assumptions on the parameters of the problem. One such assumption is sparsity, which is commonly promoted using lasso and total variation-like regularization.…

Statistics Theory · Mathematics 2023-02-15 Jasper Marijn Everink , Yiqiu Dong , Martin Skovgaard Andersen

We study linear models under heavy-tailed priors from a probabilistic viewpoint. Instead of computing a single sparse most probable (MAP) solution as in standard deterministic approaches, the focus in the Bayesian compressed sensing…

Computer Vision and Pattern Recognition · Computer Science 2014-03-05 George Papandreou , Alan Yuille

We study variational regularisation methods for inverse problems with imperfect forward operators whose errors can be modelled by order intervals in a partial order of a Banach lattice. We carry out analysis with respect to existence and…

Numerical Analysis · Mathematics 2020-12-25 Leon Bungert , Martin Burger , Yury Korolev , Carola-Bibiane Schoenlieb

These lecture notes highlight the mathematical and computational structure relating to the formulation of, and development of algorithms for, the Bayesian approach to inverse problems in differential equations. This approach is fundamental…

Probability · Mathematics 2015-07-03 Masoumeh Dashti , Andrew M. Stuart

Nonparametric Bayesian approaches based on Gaussian processes have recently become popular in the empirical learning community. They encompass many classical methods of statistics, like Radial Basis Functions or various splines, and are…

Data Analysis, Statistics and Probability · Physics 2007-05-23 J. C. Lemm

Models with dimension more than the available sample size are now commonly used in various applications. A sensible inference is possible using a lower-dimensional structure. In regression problems with a large number of predictors, the…

Statistics Theory · Mathematics 2025-11-25 Sayantan Banerjee , Ismaël Castillo , Subhashis Ghosal

In this paper, we study porous media flows in heterogeneous stochastic media. We propose an efficient forward simulation technique that is tailored for variational Bayesian inversion. As a starting point, the proposed forward simulation…

Applications · Statistics 2018-02-12 Keren Yang , Nilabja Guha , Yalchin Efendiev , Bani K. Mallick

Inverse problems are prevalent in both scientific research and engineering applications. In the context of Bayesian inverse problems, sampling from the posterior distribution can be particularly challenging when the forward models are…

Computation · Statistics 2026-02-17 Zhihang Xu , Xiaoyu Zhu , Daoji Li , Qifeng Liao

Large-scale Gaussian process inference has long faced practical challenges due to time and space complexity that is superlinear in dataset size. While sparse variational Gaussian process models are capable of learning from large-scale data,…

Machine Learning · Statistics 2018-01-23 Ching-An Cheng , Byron Boots

In this paper we consider the estimation of unknown parameters in Bayesian inverse problems. In most cases of practical interest, there are several barriers to performing such estimation, This includes a numerical approximation of a…

Methodology · Statistics 2025-02-07 Neil K. Chada , Ajay Jasra , Mohamed Maama , Raul Tempone