English
Related papers

Related papers: The Calibration Generalization Gap

200 papers

In the context of computer models, calibration is the process of estimating unknown simulator parameters from observational data. Calibration is variously referred to as model fitting, parameter estimation/inference, an inverse problem, and…

Methodology · Statistics 2023-10-16 Richard D. Wilkinson , Christopher W. Lanyon

In the field of computer vision, fine-tuning pre-trained models has become a prevalent strategy for out-of-distribution (OOD) generalization tasks. Different from most prior work that has focused on advancing learning algorithms, we…

Machine Learning · Computer Science 2025-04-29 Hiroki Naganuma , Ryuichiro Hataya , Kotaro Yoshida , Ioannis Mitliagkas

Dropout, a simple and effective way to train deep neural networks, has led to a number of impressive empirical successes and spawned many recent theoretical investigations. However, the gap between dropout's training and inference phases,…

Machine Learning · Computer Science 2017-02-17 Xuezhe Ma , Yingkai Gao , Zhiting Hu , Yaoliang Yu , Yuntian Deng , Eduard Hovy

Continual learning (CL), which aims to learn a sequence of tasks, has attracted significant recent attention. However, most work has focused on the experimental performance of CL, and theoretical studies of CL are still limited. In…

Machine Learning · Computer Science 2023-02-14 Sen Lin , Peizhong Ju , Yingbin Liang , Ness Shroff

We empirically show that the test error of deep networks can be estimated by simply training the same architecture on the same training set but with a different run of Stochastic Gradient Descent (SGD), and measuring the disagreement rate…

Machine Learning · Computer Science 2022-05-17 Yiding Jiang , Vaishnavh Nagarajan , Christina Baek , J. Zico Kolter

The recent work of Papyan, Han, & Donoho (2020) presented an intriguing "Neural Collapse" phenomenon, showing a structural property of interpolating classifiers in the late stage of training. This opened a rich area of exploration studying…

Machine Learning · Computer Science 2022-02-18 Like Hui , Mikhail Belkin , Preetum Nakkiran

Deep neural networks (DNNs) generalize remarkably well without explicit regularization even in the strongly over-parametrized regime where classical learning theory would instead predict that they would severely overfit. While many…

Machine Learning · Statistics 2019-04-23 Guillermo Valle-Pérez , Chico Q. Camargo , Ard A. Louis

In practice it is often found that large over-parameterized neural networks generalize better than their smaller counterparts, an observation that appears to conflict with classical notions of function complexity, which typically favor…

Machine Learning · Statistics 2018-06-20 Roman Novak , Yasaman Bahri , Daniel A. Abolafia , Jeffrey Pennington , Jascha Sohl-Dickstein

Although deep Neural Networks (DNNs) have achieved tremendous success in audio classification tasks, their uncertainty calibration are still under-explored. A well-calibrated model should be accurate when it is certain about its prediction…

Sound · Computer Science 2022-06-28 Tong Ye , Shijing Si , Jianzong Wang , Ning Cheng , Jing Xiao

Deep neural networks have gained tremendous popularity in last few years. They have been applied for the task of classification in almost every domain. Despite the success, deep networks can be incredibly slow to train for even moderate…

Machine Learning · Computer Science 2018-10-11 Gaurav Singh , John Shawe-Taylor

The adoption of deep learning across various fields has been extensive, yet there is a lack of focus on evaluating the performance of deep learning pipelines. Typically, with the increased use of large datasets and complex models, the…

Machine Learning · Computer Science 2024-05-21 Yewen Fan , Nian Si , Xiangchen Song , Kun Zhang

In modern parametric model training, full-batch gradient descent (and its variants) suffers due to progressively stronger biasing towards the exact realization of training data; this drives the systematic ``generalization gap'', where the…

Statistics Theory · Mathematics 2026-05-01 Max Lovig

Trustworthiness in neural networks is crucial for their deployment in critical applications, where reliability, confidence, and uncertainty play pivotal roles in decision-making. Traditional performance metrics such as accuracy and…

Machine Learning · Computer Science 2025-09-05 Koffi Ismael Ouattara , Ioannis Krontiris , Theo Dimitrakos , Frank Kargl

Predictions are often probabilities; e.g., a prediction could be for precipitation tomorrow, but with only a 30% chance. Given such probabilistic predictions together with the actual outcomes, "reliability diagrams" help detect and diagnose…

Statistics Theory · Mathematics 2022-11-15 Imanol Arrieta-Ibarra , Paman Gujral , Jonathan Tannen , Mark Tygert , Cherie Xu

Bayesian Neural Networks (BNNs) often result uncalibrated after training, usually tending towards overconfidence. Devising effective calibration methods with low impact in terms of computational complexity is thus of central interest. In…

Machine Learning · Computer Science 2020-08-18 Hector J. Hortua , Luigi Malago , Riccardo Volpi

Calibration$\unicode{x2014}$the problem of ensuring that predicted probabilities align with observed class frequencies$\unicode{x2014}$is a basic desideratum for reliable prediction with machine learning systems. Calibration error is…

Machine Learning · Statistics 2026-03-02 Eugène Berta , Sacha Braun , David Holzmüller , Francis Bach , Michael I. Jordan

Reliable uncertainty calibration is essential for safely deploying deep neural networks in high-stakes applications. Deep neural networks are known to exhibit systematic overconfidence, especially under distribution shifts. Although…

Machine Learning · Computer Science 2025-06-12 Achim Hekler , Lukas Kuhn , Florian Buettner

Model diagnostics and forecast evaluation are two sides of the same coin. A common principle is that fitted or predicted distributions ought to be calibrated or reliable, ideally in the sense of auto-calibration, where the outcome is a…

Methodology · Statistics 2024-09-27 Tilmann Gneiting , Johannes Resin

Overparameterized deep networks that generalize well have been key to the dramatic success of deep learning in recent years. The reasons for their remarkable ability to generalize are not well understood yet. When class labels in the…

Machine Learning · Computer Science 2026-02-03 Simran Ketha , Venkatakrishnan Ramaswamy

Selective classification allows models to abstain from making predictions (e.g., say "I don't know") when in doubt in order to obtain better effective accuracy. While typical selective models can be effective at producing more accurate…

Machine Learning · Computer Science 2024-06-24 Adam Fisch , Tommi Jaakkola , Regina Barzilay