English
Related papers

Related papers: Asymptotic Consistency of Loss-Calibrated Variatio…

200 papers

A key challenge for modern Bayesian statistics is how to perform scalable inference of posterior distributions. To address this challenge, variational Bayes (VB) methods have emerged as a popular alternative to the classical Markov chain…

Machine Learning · Statistics 2021-07-09 Yixin Wang , David M. Blei

We study data-driven decision-making problems in the Bayesian framework, where the expectation in the Bayes risk is replaced by a risk-sensitive entropic risk measure. We focus on problems where calculating the posterior distribution is…

Optimization and Control · Mathematics 2021-09-13 Prateek Jaiswal , Harsha Honnappa , Vinayak A. Rao

Mean field variational Bayes (MFVB) is a popular posterior approximation method due to its fast runtime on large-scale data sets. However, it is well known that a major failing of MFVB is that it underestimates the uncertainty of model…

Machine Learning · Statistics 2015-12-24 Ryan Giordano , Tamara Broderick , Michael Jordan

In data science and machine learning, hierarchical parametric models, such as mixture models, are often used. They contain two kinds of variables: observable variables, which represent the parts of the data that can be directly measured,…

Machine Learning · Statistics 2015-04-20 Keisuke Yamazaki

Variational Bayes (VB) has shown itself to be a powerful approximation method in many application areas. This paper describes some diagnostics methods which can assess how well the VB approximates the true posterior, particularly with…

Computation · Statistics 2013-09-23 Hui Zhao , Paul Marriott

Mean Field Variational Bayes (MFVB) is a popular posterior approximation method due to its fast runtime on large-scale data sets. However, it is well known that a major failing of MFVB is its (sometimes severe) underestimates of the…

Machine Learning · Statistics 2014-12-10 Ryan Giordano , Tamara Broderick

Mean field variational Bayes (MFVB) is a popular posterior approximation method due to its fast runtime on large-scale data sets. However, it is well known that a major failing of MFVB is that it underestimates the uncertainty of model…

Machine Learning · Statistics 2015-02-27 Ryan Giordano , Tamara Broderick

Variational Bayes (VB) is a recent approximate method for Bayesian inference. It has the merit of being a fast and scalable alternative to Markov Chain Monte Carlo (MCMC) but its approximation error is often unknown. In this paper, we…

Machine Learning · Statistics 2019-03-05 Reza Hajargasht

Mean-field Variational Bayes (MFVB) is an approximate Bayesian posterior inference technique that is increasingly popular due to its fast runtimes on large-scale datasets. However, even when MFVB provides accurate posterior means for…

Methodology · Statistics 2018-10-18 Ryan Giordano , Tamara Broderick , Michael I. Jordan

Variational Bayes (VB) is a popular and computationally efficient method to approximate the posterior distribution in Bayesian inference, especially when the exact posterior is analytically intractable and sampling-based approaches are…

Methodology · Statistics 2025-12-30 Jiaming Liu , Meng Li

We study the asymptotic consistency properties of $\alpha$-R\'enyi approximate posteriors, a class of variational Bayesian methods that approximate an intractable Bayesian posterior with a member of a tractable family of distributions, the…

Statistics Theory · Mathematics 2020-08-17 Prateek Jaiswal , Vinayak A. Rao , Harsha Honnappa

Bayesian methods have proved powerful in many applications for the inference of model parameters from data. These methods are based on Bayes' theorem, which itself is deceptively simple. However, in practice the computations required are…

Methodology · Statistics 2020-07-10 Michael A. Chappell , Mark W. Woolrich

We propose a new approach to Bayesian prediction that caters for models with a large number of parameters and is robust to model misspecification. Given a class of high-dimensional (but parametric) predictive models, this new approach…

Methodology · Statistics 2022-05-13 David T. Frazier , Ruben Loaiza-Maya , Gael M. Martin , Bonsoo Koo

Variational Bayesian (VB) methods produce posterior inference in a time frame considerably smaller than traditional Markov Chain Monte Carlo approaches. Although the VB posterior is an approximation, it has been shown to produce good…

Computation · Statistics 2019-08-02 Nathaniel Tomasetti , Catherine S. Forbes , Anastasios Panagiotelis

We study system design problems stated as parameterized stochastic programs with a chance-constraint set. We adopt a Bayesian approach that requires the computation of a posterior predictive integral which is usually intractable. In…

Machine Learning · Statistics 2020-01-07 Prateek Jaiswal , Harsha Honnappa , Vinayak A. Rao

Variational Bayes (VB), a method originating from machine learning, enables fast and scalable estimation of complex probabilistic models. Thus far, applications of VB in discrete choice analysis have been limited to mixed logit models with…

Methodology · Statistics 2020-01-17 Rico Krueger , Prateek Bansal , Michel Bierlaire , Ricardo A. Daziano , Taha H. Rashidi

Approximate Bayesian computation allows for statistical analysis in models with intractable likelihoods. In this paper we consider the asymptotic behaviour of the posterior distribution obtained by this method. We give general results on…

Methodology · Statistics 2018-05-09 David T. Frazier , Gael M. Martin , Christian P. Robert , Judith Rousseau

Bayesian calibration of black-box computer models offers an established framework to obtain a posterior distribution over model parameters. Traditional Bayesian calibration involves the emulation of the computer model and an additive model…

Machine Learning · Statistics 2018-10-30 Sébastien Marmin , Maurizio Filippone

In Bayesian analysis, the posterior follows from the data and a choice of a prior and a likelihood. One hopes that the posterior is robust to reasonable variation in the choice of prior and likelihood, since this choice is made by the…

Methodology · Statistics 2015-12-09 Ryan Giordano , Tamara Broderick , Michael Jordan

Loss-based updating, including generalized Bayes, Gibbs, and quasi-posteriors, replaces likelihoods by a user-chosen loss and produces a posterior-like distribution via exponential tilt. We give a decision-theoretic characterization that…

Methodology · Statistics 2026-02-03 Kenichiro McAlinn , Kōsaku Takanashi
‹ Prev 1 2 3 10 Next ›