English
Related papers

Related papers: Uncertainty estimation in equality-constrained MAP…

200 papers

One of the tasks of the Bayesian inverse problem is to find a good estimate based on the posterior probability density. The most common point estimators are the conditional mean (CM) and maximum a posteriori (MAP) estimates, which…

Numerical Analysis · Mathematics 2016-08-29 Martin Burger , Yiqiu Dong , Federica Sciacchitano

Inverse problems constrained by partial differential equations (PDEs) play a critical role in model development and calibration. In many applications, there are multiple uncertain parameters in a model which must be estimated. Although the…

We study Bayesian inference methods for solving linear inverse problems, focusing on hierarchical formulations where the prior or the likelihood function depend on unspecified hyperparameters. In practice, these hyperparameters are often…

Numerical Analysis · Mathematics 2018-08-01 Qingping Zhou , Wenqing Liu , Jinglai Li , Youssef M. Marzouk

There are two major routes to address the ubiquitous family of inverse problems appearing in signal and image processing, such as denoising or deblurring. A first route relies on Bayesian modeling, where prior probabilities are used to…

Statistics Theory · Mathematics 2026-03-24 Rémi Gribonval , Mila Nikolova

The maximum a-posteriori (MAP) perturbation framework has emerged as a useful approach for inference and learning in high dimensional complex models. By maximizing a randomly perturbed potential function, MAP perturbations generate unbiased…

Machine Learning · Computer Science 2013-10-17 Francesco Orabona , Tamir Hazan , Anand D. Sarwate , Tommi Jaakkola

We consider the inverse problem of recovering an unknown functional parameter $u$ in a separable Banach space, from a noisy observation $y$ of its image through a known possibly non-linear ill-posed map ${\mathcal G}$. The data $y$ is…

Statistics Theory · Mathematics 2018-03-14 Sergios Agapiou , Martin Burger , Masoumeh Dashti , Tapio Helin

This paper presents a hierarchical Bayesian modeling framework for the uncertainty quantification in modal identification of linear dynamical systems using multiple vibration data sets. This novel framework integrates the state-of-the-art…

Methodology · Statistics 2020-05-19 Omid Sedehi , Lambros S. Katafygiotis , Costas Papadimitriou

We consider a Bayesian framework for estimating a high-dimensional sparse precision matrix, in which adaptive shrinkage and sparsity are induced by a mixture of Laplace priors. Besides discussing our formulation from the Bayesian…

Machine Learning · Statistics 2018-05-22 Lingrui Gan , Naveen N. Narisetty , Feng Liang

In this paper, Bayesian parameter estimation through the consideration of the Maximum A Posteriori (MAP) criterion is revisited under the prism of the Expectation-Maximization (EM) algorithm. By incorporating a sparsity-promoting penalty…

Systems and Control · Computer Science 2015-08-06 Rodrigo Carvajal , Juan C. Agüero , Boris I. Godoy , Dimitrios Katselis

Maximum a Posteriori assignment (MAP) is the problem of finding the most probable instantiation of a set of variables given the partial evidence on the other variables in a Bayesian network. MAP has been shown to be a NP-hard problem [22],…

Artificial Intelligence · Computer Science 2012-07-19 Changhe Yuan , Tsai-Ching Lu , Marek J. Druzdzel

Maximum likelihood estimation is a popular method in statistical inference. As a way of assessing the accuracy of the maximum likelihood estimate (MLE), the calculation of the covariance matrix of the MLE is of great interest in practice.…

Statistics Theory · Mathematics 2014-05-08 Xumeng Cao

Through the Bayesian lens of data assimilation, uncertainty on model parameters is traditionally quantified through the posterior covariance matrix. However, in modern settings involving high-dimensional and computationally expensive…

Computation · Statistics 2023-11-16 Michael Stanley , Mikael Kuusela , Brendan Byrne , Junjie Liu

We introduce a distributionally robust maximum likelihood estimation model with a Wasserstein ambiguity set to infer the inverse covariance matrix of a $p$-dimensional Gaussian random vector from $n$ independent samples. The proposed model…

Optimization and Control · Mathematics 2018-05-21 Viet Anh Nguyen , Daniel Kuhn , Peyman Mohajerin Esfahani

Maximum-a-posteriori (MAP) estimation is the main Bayesian estimation methodology in imaging sciences, where high dimensionality is often addressed by using Bayesian models that are log-concave and whose posterior mode can be computed…

Statistics Theory · Mathematics 2019-01-21 Marcelo Pereyra

We propose a Bayesian uncertainty quantification method for large-scale imaging inverse problems. Our method applies to all Bayesian models that are log-concave, where maximum-a-posteriori (MAP) estimation is a convex optimization problem.…

Methodology · Statistics 2018-11-07 Audrey Repetti , Marcelo Pereyra , Yves Wiaux

In computational inverse problems, it is common that a detailed and accurate forward model is approximated by a computationally less challenging substitute. The model reduction may be necessary to meet constraints in computing time when…

Methodology · Statistics 2018-02-14 Daniela Calvetti , Matthew M. Dunlop , Erkki Somersalo , Andrew M. Stuart

The asymptotic variance of the maximum likelihood estimate is proved to decrease when the maximization is restricted to a subspace that contains the true parameter value. Maximum likelihood estimation allows a systematic fitting of…

Statistics Theory · Mathematics 2018-01-31 Marie Turčičová , Jan Mandel , Kryštof Eben

For linear inverse problems with Gaussian priors and Gaussian observation noise, the posterior is Gaussian, with mean and covariance determined by the conditioning formula. The covariance is the central object for uncertainty…

Statistics Theory · Mathematics 2025-08-13 Giuseppe Carere , Han Cheng Lie

The Bayesian approach is effective for inverse problems. The posterior density distribution provides useful information of the unknowns. However, for problems with non-unique solutions, the classical estimators such as the maximum a…

Statistics Theory · Mathematics 2021-08-31 Jiguang Sun

We define a new class of Bayesian point estimators, which we refer to as risk averse. Using this definition, we formulate axioms that provide natural requirements for inference, e.g. in a scientific setting, and show that for well-behaved…

Machine Learning · Statistics 2019-03-08 Michael Brand