English
Related papers

Related papers: A Geometric View of Posterior Approximation

200 papers

We propose a new sampling-based approach for approximate inference in filtering problems. Instead of approximating conditional distributions with a finite set of states, as done in particle filters, our approach approximates the…

Machine Learning · Computer Science 2020-03-03 Xuan Su , Wee Sun Lee , Zhen Zhang

In high-dimensions, the prior tails can have a significant effect on both posterior computation and asymptotic concentration rates. To achieve optimal rates while keeping the posterior computations relatively simple, an empirical Bayes…

Methodology · Statistics 2020-08-03 Yue Yang , Ryan Martin

We consider a prior for nonparametric Bayesian estimation which uses finite random series with a random number of terms. The prior is constructed through distributions on the number of basis functions and the associated coefficients. We…

Statistics Theory · Mathematics 2015-02-10 Weining Shen , Subhashis Ghosal

This paper deals with the Bayesian estimation of high dimensional Gaussian graphical models. We develop a quasi-Bayesian implementation of the neighborhood selection method of Meinshausen and Buhlmann (2006) for the estimation of Gaussian…

Statistics Theory · Mathematics 2015-12-29 Yves Atchade

Envelope models provide a sufficient dimension reduction framework for multivariate regression analysis. Bayesian inference for these models has been developed primarily using Markov chain Monte Carlo (MCMC) methods. Specifically, Gibbs…

Methodology · Statistics 2026-03-03 Seunghyeon Kim , Kwangmin Lee , Yeonhee Park

We propose a geometric framework to assess sensitivity of Bayesian procedures to modeling assumptions based on the nonparametric Fisher-Rao metric. While the framework is general in spirit, the focus of this article is restricted to…

Methodology · Statistics 2014-04-28 Sebastian Kurtek , Karthik Bharath

Bayesian models quantify uncertainty and facilitate optimal decision-making in downstream applications. For most models, however, practitioners are forced to use approximate inference techniques that lead to sub-optimal decisions due to…

Machine Learning · Statistics 2019-09-12 Tomasz Kuśmierczyk , Joseph Sakaya , Arto Klami

Bayesian hypothesis tests leverage posterior probabilities, Bayes factors, or credible intervals to inform data-driven decision making. We propose a framework for power curve approximation with such hypothesis tests. We present a fast…

Methodology · Statistics 2024-10-08 Luke Hagar , Nathaniel T. Stevens

In recent years, inconsistency in Bayesian deep learning has attracted significant attention. Tempered or generalized posterior distributions are frequently employed as direct and effective solutions. Nonetheless, the underlying mechanisms…

Machine Learning · Computer Science 2025-09-23 Yinsong Chen , Samson S. Yu , Zhong Li , Chee Peng Lim

Parameter inference is a fundamental problem in data-driven modeling. Given observed data that is believed to be a realization of some parameterized model, the aim is to find parameter values that are able to explain the observed data. In…

Data Structures and Algorithms · Computer Science 2016-04-20 Carlo Albert , Simone Ulzega , Ruedi Stoop

Gaussian graphical model is one of the powerful tools to analyze conditional independence between two variables for multivariate Gaussian-distributed observations. When the dimension of data is moderate or high, penalized likelihood methods…

Methodology · Statistics 2025-01-24 Takahiro Onizuka , Shintaro Hashimoto

While learning the maximum likelihood value of parameters of an undirected graphical model is hard, modelling the posterior distribution over parameters given data is harder. Yet, undirected models are ubiquitous in computer vision and text…

Machine Learning · Computer Science 2012-07-02 Max Welling , Sridevi Parise

Ising models originated in statistical physics and are widely used in modeling spatial data and computer vision problems. However, statistical inference of this model remains challenging due to intractable nature of the normalizing constant…

Methodology · Statistics 2021-09-06 Minwoo Kim , Shrijita Bhattacharya , Tapabrata Maiti

In this paper we propose a new deterministic approximation method, called discretization approximation, for Bayesian computation. Discretization approximation is very simple to understand and to implement, It only requires calculating…

Computation · Statistics 2026-01-13 Shifeng Xiong

We propose a Bayesian inference framework to estimate uncertainties in inverse scattering problems. Given the observed data, the forward model and their uncertainties, we find the posterior distribution over a finite parameter field…

Numerical Analysis · Mathematics 2020-11-17 Ana Carpio , Sergei Iakunin , Georg Stadler

One of the well-known challenges in optimal experimental design is how to efficiently estimate the nested integrations of the expected information gain. The Gaussian approximation and associated importance sampling have been shown to be…

Computation · Statistics 2021-08-17 Quan Long

Many modern experiments, such as microarray gene expression and genome-wide association studies, present the problem of estimating a large number of parallel effects. Bayesian inference is a popular approach for analyzing such data by…

Methodology · Statistics 2018-10-26 J G Liao , Arthur Berg , Timothy L McMurry

The Bayesian approach to inverse problems typically relies on posterior sampling approaches, such as Markov chain Monte Carlo, for which the generation of each sample requires one or more evaluations of the parameter-to-observable map or…

Computation · Statistics 2014-12-23 Jinglai Li , Youssef M. Marzouk

The prominent Bernstein -- von Mises (BvM) result claims that the posterior distribution after centering by the efficient estimator and standardizing by the square root of the total Fisher information is nearly standard normal. In…

Statistics Theory · Mathematics 2020-06-02 Vladimir Spokoiny , Maxim Panov

Variational methods are employed in situations where exact Bayesian inference becomes intractable due to the difficulty in performing certain integrals. Typically, variational methods postulate a tractable posterior and formulate a lower…

Machine Learning · Statistics 2019-06-12 Nikolaos Gianniotis , Christoph Schnörr , Christian Molkenthin , Sanjay Singh Bora