English
Related papers

Related papers: Posterior accuracy and calibration under misspecif…

200 papers

In this article, we investigate posterior convergence of nonparametric binary and Poisson regression under possible model misspecification, assuming general stochastic process prior with appropriate properties. Our model setup and objective…

Statistics Theory · Mathematics 2020-05-04 Debashis Chatterjee , Sourabh Bhattacharya

We give two prediction intervals (PI) for Generalized Linear Models that take model selection uncertainty into account. The first is a straightforward extension of asymptotic normality results and the second includes an extra optimization…

Methodology · Statistics 2023-05-26 Dean Dustin , Bertrand Clarke

Optimization is widely used in statistics, and often efficiently delivers point estimates on useful spaces involving structural constraints or combinatorial structure. To quantify uncertainty, Gibbs posterior exponentiates the negative loss…

Methodology · Statistics 2025-07-23 Cheng Zeng , Eleni Dilma , Jason Xu , Leo L Duan

We provide a general solution to a fundamental open problem in Bayesian inference, namely poor uncertainty quantification, from a frequency standpoint, of Bayesian methods in misspecified models. While existing solutions are based on…

Methodology · Statistics 2023-02-14 David T. Frazier , Robert Kohn , Christopher Drovandi , David Gunawan

Estimated uncertainty by approximate posteriors in Bayesian neural networks are prone to miscalibration, which leads to overconfident predictions in critical tasks that have a clear asymmetric cost or significant losses. Here, we extend the…

Machine Learning · Computer Science 2022-06-17 Biraja Ghoshal , Allan Tucker

We prove rates of convergence and robustness to prior misspecification within a Generalised Variational Inference (GVI) framework with bounded divergences. This addresses a significant open challenge for GVI and Federated GVI that employ a…

Statistics Theory · Mathematics 2025-12-04 Terje Mildner , Paris Giampouras , Theodoros Damoulas

Modern machine learning models with high accuracy are often miscalibrated -- the predicted top probability does not reflect the actual accuracy, and tends to be over-confident. It is commonly believed that such over-confidence is mainly due…

Machine Learning · Computer Science 2021-07-21 Yu Bai , Song Mei , Huan Wang , Caiming Xiong

In recent years, inconsistency in Bayesian deep learning has attracted significant attention. Tempered or generalized posterior distributions are frequently employed as direct and effective solutions. Nonetheless, the underlying mechanisms…

Machine Learning · Computer Science 2025-09-23 Yinsong Chen , Samson S. Yu , Zhong Li , Chee Peng Lim

The current standard Bayesian approach to model calibration, which assigns a Gaussian process prior to the discrepancy term, often suffers from issues of unidentifiability and computational complexity and instability. When the goal is to…

Methodology · Statistics 2019-09-13 Spencer Woody , Novin Ghaffari , Lauren Hund

Mathematical models are routinely applied to interpret biological data, with common goals that include both prediction and parameter estimation. A challenge in mathematical biology, in particular, is that models are often complex and…

Methodology · Statistics 2025-11-18 Alexander P Browning , Jennifer A Flegg , Ryan J Murphy

A robust estimation framework for binary regression models is studied, aiming to extend traditional approaches like logistic regression models. While previous studies largely focused on logistic models, we explore a broader class of models…

Methodology · Statistics 2025-02-24 Kenichi Hayashi , Shinto Eguchi

For personalized ranking models, the well-calibrated probability of an item being preferred by a user has great practical value. While existing work shows promising results in image classification, probability calibration has not been much…

Information Retrieval · Computer Science 2022-04-27 Wonbin Kweon , SeongKu Kang , Hwanjo Yu

Bayesian inference is often implemented using approximations, which can yield interval estimates that are too narrow, not fully capturing the uncertainty in the posterior distribution. We address the question of how to adjust these…

Methodology · Statistics 2026-03-23 Tiffany Cai , Philip Greengard , Ben Goodrich , Andrew Gelman

Bayesian decision theory provides an elegant framework for acting optimally under uncertainty when tractable posterior distributions are available. Modern Bayesian models, however, typically involve intractable posteriors that are…

Machine Learning · Computer Science 2021-06-15 Meet P. Vadera , Soumya Ghosh , Kenney Ng , Benjamin M. Marlin

Convolutional neural networks (CNNs) provide flexible function approximations for a wide variety of applications when the input variables are in the form of images or spatial data. Although CNNs often outperform traditional statistical…

Methodology · Statistics 2024-05-24 Yeseul Jeon , Won Chang , Seonghyun Jeong , Sanghoon Han , Jaewoo Park

Bayesian model selection is premised on the assumption that the data are generated from one of the postulated models. However, in many applications, all of these models are incorrect (that is, there is misspecification). When the models are…

Methodology · Statistics 2021-12-10 Jonathan H. Huggins , Jeffrey W. Miller

We propose a general method to carry out a valid Bayesian analysis of a finite-dimensional `targeted' parameter in the presence of a finite-dimensional nuisance parameter. We apply our methods to causal inference based on estimating…

Methodology · Statistics 2026-02-03 Magid Sabbagh , David A. Stephens

Language models (LMs) are statistical models trained to assign probability to human-generated text. As such, it is reasonable to question whether they approximate linguistic variability exhibited by humans well. This form of statistical…

Computation and Language · Computer Science 2024-03-19 Evgenia Ilia , Wilker Aziz

Bayesian inference allows expressing the uncertainty of posterior belief under a probabilistic model given prior information and the likelihood of the evidence. Predominantly, the likelihood function is only implicitly established by a…

In some misspecified settings, the posterior distribution in Bayesian statistics may lead to inconsistent estimates. To fix this issue, it has been suggested to replace the likelihood by a pseudo-likelihood, that is the exponential of a…

Statistics Theory · Mathematics 2019-12-12 Badr-Eddine Chérief-Abdellatif , Pierre Alquier