English
Related papers

Related papers: Measuring Cluster Stability for Bayesian Nonparame…

200 papers

Probabilistic clustering models (or equivalently, mixture models) are basic building blocks in countless statistical models and involve latent random variables over discrete spaces. For these models, posterior inference methods can be…

Machine Learning · Statistics 2020-06-24 Ari Pakman , Yueqi Wang , Catalin Mitelut , JinHyung Lee , Liam Paninski

Bayesian nonparametrics are a class of probabilistic models in which the model size is inferred from data. A recently developed methodology in this field is small-variance asymptotic analysis, a mathematical technique for deriving learning…

Machine Learning · Statistics 2017-07-27 Trevor Campbell , Brian Kulis , Jonathan How

Understanding the uncertainty of a neural network's (NN) predictions is essential for many purposes. The Bayesian framework provides a principled approach to this, however applying it to NNs is challenging due to large numbers of parameters…

Machine Learning · Statistics 2020-02-27 Tim Pearce , Felix Leibfried , Alexandra Brintrup , Mohamed Zaki , Andy Neely

Bayesian clustering accounts for uncertainty but is computationally demanding at scale. Furthermore, real-world datasets often contain missing values, and simple imputation ignores the associated uncertainty, resulting in suboptimal…

Machine Learning · Computer Science 2026-03-18 Prajit Bhaskaran , Tom Viering

Ensembles of neural networks (NNs) have long been used to estimate predictive uncertainty; a small number of NNs are trained from different initialisations and sometimes on differing versions of the dataset. The variance of the ensemble's…

Machine Learning · Computer Science 2018-11-30 Tim Pearce , Mohamed Zaki , Andy Neely

The posterior over Bayesian neural network (BNN) parameters is extremely high-dimensional and non-convex. For computational reasons, researchers approximate this posterior using inexpensive mini-batch methods such as mean-field variational…

Machine Learning · Computer Science 2021-04-30 Pavel Izmailov , Sharad Vikram , Matthew D. Hoffman , Andrew Gordon Wilson

Estimating the mixing density of a latent mixture model is an important task in signal processing. Nonparametric maximum likelihood estimation is one popular approach to this problem. If the latent variable distribution is assumed to be…

Methodology · Statistics 2024-03-01 Shijie Wang , Minsuk Shin , Ray Bai

Reliable uncertainty quantification remains a central challenge in predictive modeling. While Bayesian methods are theoretically appealing, their predictive intervals can exhibit poor frequentist calibration, particularly with small sample…

Methodology · Statistics 2025-08-05 Graham Gibson

Bayesian Neural Networks (BNNs) offer a principled and natural framework for proper uncertainty quantification in the context of deep learning. They address the typical challenges associated with conventional deep learning methods, such as…

Computation · Statistics 2024-11-13 Zahra Moslemi , Yang Meng , Shiwei Lan , Babak Shahbaba

In spite of the diverse literature on nonstationary spatial modeling and approximate Gaussian process (GP) methods, there are no general approaches for conducting fully Bayesian inference for moderately sized nonstationary spatial data sets…

Computation · Statistics 2020-07-01 Mark D. Risser , Daniel Turek

Standard Bayesian inference is known to be sensitive to model misspecification, leading to unreliable uncertainty quantification and poor predictive performance. However, finding generally applicable and computationally feasible methods for…

Methodology · Statistics 2020-07-31 Jonathan H. Huggins , Jeffrey W. Miller

This paper presents an efficient Bayesian framework for solving nonlinear, high-dimensional model calibration problems. It is based on a Variational Bayesian formulation that aims at approximating the exact posterior by means of solving an…

Applications · Statistics 2015-11-02 Isabell M. Franck , P. S. Koutsourelakis

The present contribution investigates multivariate bootstrap procedures for general stabilizing statistics, with specific application to topological data analysis. Existing limit theorems for topological statistics prove difficult to use in…

Statistics Theory · Mathematics 2023-11-28 Benjamin Roycraft , Johannes Krebs , Wolfgang Polonik

The bootstrap is a popular method of constructing confidence intervals due to its ease of use and broad applicability. Theoretical properties of bootstrap procedures have been established in a variety of settings. However, there is limited…

Statistics Theory · Mathematics 2024-04-19 Zhou Tang , Ted Westling

For dynamic borrowing to leverage external data to augment the control arm of small RCTs, the key step is determining the amount of borrowing based on the similarity of the outcomes in the controls from the trial and the external data…

Methodology · Statistics 2024-08-01 Jixian Wang , Ram Tiwari

A natural way to quantify uncertainties in Gaussian mixture models (GMMs) is through Bayesian methods. That said, sampling from the joint posterior distribution of GMMs via standard Markov chain Monte Carlo (MCMC) imposes several…

Methodology · Statistics 2024-05-20 Santiago Marin , Bronwyn Loong , Anton H. Westveld

The bootstrap provides a simple and powerful means of assessing the quality of estimators. However, in settings involving large datasets---which are increasingly prevalent---the computation of bootstrap-based quantities can be prohibitively…

Methodology · Statistics 2012-06-29 Ariel Kleiner , Ameet Talwalkar , Purnamrita Sarkar , Michael I. Jordan

Bayesian model selection is premised on the assumption that the data are generated from one of the postulated models. However, in many applications, all of these models are incorrect (that is, there is misspecification). When the models are…

Methodology · Statistics 2021-12-10 Jonathan H. Huggins , Jeffrey W. Miller

Increasingly complex datasets pose a number of challenges for Bayesian inference. Conventional posterior sampling based on Markov chain Monte Carlo can be too computationally intensive, is serial in nature and mixes poorly between posterior…

Machine Learning · Statistics 2019-08-27 Edwin Fong , Simon Lyddon , Chris Holmes

Modern neural networks have found to be miscalibrated in terms of confidence calibration, i.e., their predicted confidence scores do not reflect the observed accuracy or precision. Recent work has introduced methods for post-hoc confidence…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Fabian Küppers , Jan Kronenberger , Jonas Schneider , Anselm Haselhoff