English
Related papers

Related papers: Revisiting maximum-a-posteriori estimation in log-…

200 papers

Bayesian optimization is a principled optimization strategy for a black-box objective function. It shows its effectiveness in a wide variety of real-world applications such as scientific discovery and experimental design. In general, the…

Machine Learning · Computer Science 2024-11-11 Jungtaek Kim

Characterizing the properties of groundwater aquifers is essential for predicting aquifer response and managing groundwater resources. In this work, we develop a high-dimensional scalable Bayesian inversion framework governed by a…

Geophysics · Physics 2020-12-02 Amal Alghamdi , Marc A. Hesse , Jingyi Chen , Omar Ghattas

In this paper, we extend the correspondence between Bayesian estimation and optimal smoothing in a Reproducing Kernel Hilbert Space (RKHS) adding a convexe constraints on the solution. Through a sequence of approximating Hilbertian spaces…

Numerical Analysis · Mathematics 2021-07-13 X Bay , Laurence Grammont

We consider the inverse problem of estimating an unknown function $u$ from noisy measurements $y$ of a known, possibly nonlinear, map $\mathcal{G}$ applied to $u$. We adopt a Bayesian approach to the problem and work in a setting where the…

Probability · Mathematics 2013-09-20 Masoumeh Dashti , Kody J. H. Law , Andrew M. Stuart , Jochen Voss

Among the many ways to model signals, a recent approach that draws considerable attention is sparse representation modeling. In this model, the signal is assumed to be generated as a random linear combination of a few atoms from a…

Computer Vision and Pattern Recognition · Computer Science 2015-05-18 Javier Turek , Irad Yavneh , Matan Protter , Michael Elad

We consider the problem of upper bounding the expected log-likelihood sub-optimality of the maximum likelihood estimate (MLE), or a conjugate maximum a posteriori (MAP) for an exponential family, in a non-asymptotic way. Surprisingly, we…

Machine Learning · Statistics 2021-11-15 Rémi Le Priol , Frederik Kunstner , Damien Scieur , Simon Lacoste-Julien

The pretrained diffusion model as a strong prior has been leveraged to address inverse problems in a zero-shot manner without task-specific retraining. Different from the unconditional generation, the measurement-guided generation requires…

Optimization and Control · Mathematics 2025-03-14 Ji Li , Chao Wang

Modern imaging methods rely strongly on Bayesian inference techniques to solve challenging imaging problems. Currently, the predominant Bayesian computation approach is convex optimisation, which scales very efficiently to high dimensional…

Computation · Statistics 2016-12-23 Alain Durmus , Eric Moulines , Marcelo Pereyra

MAP is the problem of finding a most probable instantiation of a set of variables in a Bayesian network, given evidence. Unlike computing marginals, posteriors, and MPE (a special case of MAP), the time and space complexity of MAP is not…

Artificial Intelligence · Computer Science 2013-01-14 James D. Park , Adnan Darwiche

This paper presents a new accelerated proximal Markov chain Monte Carlo methodology to perform Bayesian inference in imaging inverse problems with an underlying convex geometry. The proposed strategy takes the form of a stochastic relaxed…

In this paper we address the problem of solving ill-posed inverse problems in imaging where the prior is a neural generative model. Specifically we consider the decoupled case where the prior is trained once and can be reused for many…

Machine Learning · Statistics 2019-11-18 Mario González , Andrés Almansa , Mauricio Delbracio , Pablo Musé , Pauline Tan

The estimation of the covariance matrix is an initial step in many multivariate statistical methods such as principal components analysis and factor analysis, but in many practical applications the dimensionality of the sample space is…

Methodology · Statistics 2012-06-12 Søren Feodor Nielsen , Jon Sporring

In many applications, such as economics, operations research and reinforcement learning, one often needs to estimate a multivariate regression function f subject to a convexity constraint. For example, in sequential decision processes the…

Methodology · Statistics 2011-09-05 Lauren A. Hannah , David B. Dunson

Bayesian statistics has two common measures of central tendency of a posterior distribution: posterior means and Maximum A Posteriori (MAP) estimates. In this paper, we discuss a connection between MAP estimates and posterior means. We…

Statistics Theory · Mathematics 2024-10-02 Michiko Okudo , Keisuke Yano

Purpose: Undersampling is used to reduce the scan time for high-resolution 3D magnetic resonance imaging. In order to achieve better image quality and avoid manual parameter tuning, we propose a probabilistic Bayesian approach to recover…

Image and Video Processing · Electrical Eng. & Systems 2022-10-20 Shuai Huang , James J. Lah , Jason W. Allen , Deqiang Qiu

We revise the Bayesian inference steps required to analyse the cosmological large-scale structure. Here we make special emphasis in the complications which arise due to the non-Gaussian character of the galaxy and matter distribution. In…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-03 Francisco-Shu Kitaura

This paper addresses the adaptive radar target detection problem in the presence of Gaussian interference with unknown statistical properties. To this end, the problem is first formulated as a binary hypothesis test, and then we derive a…

Signal Processing · Electrical Eng. & Systems 2025-03-05 Chaoran Yin , Tianqi Wang , Linjie Yan , Chengpeng Hao , Alfonso Farina , Danilo Orlando

We present a theoretical analysis of Maximum a Posteriori (MAP) sequence estimation for binary symmetric hidden Markov processes. We reduce the MAP estimation to the energy minimization of an appropriately defined Ising spin model, and…

Artificial Intelligence · Computer Science 2009-06-11 Armen Allahverdyan , Aram Galstyan

A pre-trained unconditional diffusion model, combined with posterior sampling or maximum a posteriori (MAP) estimation techniques, can solve arbitrary inverse problems without task-specific training or fine-tuning. However, existing…

Machine Learning · Computer Science 2026-02-09 Sai Bharath Chandra Gutha , Ricardo Vinuesa , Hossein Azizpour

This paper studies a Bayesian estimation procedure for single-hidden-layer neural networks using $\ell_{1}$ controlled weights. We study the structure of the posterior density and provide a representation that makes it amenable to rapid…

Statistics Theory · Mathematics 2025-03-20 Curtis McDonald , Andrew R. Barron