English
Related papers

Related papers: Well-calibrated Model Uncertainty with Temperature…

200 papers

Model calibration aims to align confidence with prediction correctness. The Cross-Entropy (CE) loss is widely used for calibrator training, which enforces the model to increase confidence on the ground truth class. However, we find the CE…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Yuchi Liu , Lei Wang , Yuli Zou , James Zou , Liang Zheng

For users to trust model predictions, they need to understand model outputs, particularly their confidence - calibration aims to adjust (calibrate) models' confidence to match expected accuracy. We argue that the traditional calibration…

Computation and Language · Computer Science 2022-10-25 Chenglei Si , Chen Zhao , Sewon Min , Jordan Boyd-Graber

Bayesian Model Calibration is used to revisit the problem of scaling factor calibration for semi-empirical correction of ab initio calculations. A particular attention is devoted to uncertainty evaluation for scaling factors, and to their…

Data Analysis, Statistics and Probability · Physics 2009-01-12 Pascal Pernot

The calibration for deep neural networks is currently receiving widespread attention and research. Miscalibration usually leads to overconfidence of the model. While, under the condition of long-tailed distribution of data, the problem of…

Machine Learning · Computer Science 2023-08-17 Jialin Guo , Zhenyu Wu , Zhiqiang Zhan , Yang Ji

Uncertainty quantification is a central challenge in reliable and trustworthy machine learning. Naive measures such as last-layer scores are well-known to yield overconfident estimates in the context of overparametrized neural networks.…

Machine Learning · Computer Science 2023-05-24 Lucas Clarté , Bruno Loureiro , Florent Krzakala , Lenka Zdeborová

Machine learning models have emerged as a very effective strategy to sidestep time-consuming electronic-structure calculations, enabling accurate simulations of greater size, time scale and complexity. Given the interpolative nature of…

Bayesian inference is a popular approach to calibrating uncertainties, but it can underpredict such uncertainties when model misspecification is present, impacting its reliability to inform decision making. Recently, the statistics and…

Computational Engineering, Finance, and Science · Computer Science 2026-01-09 Rebekah White , Rileigh Bandy , Teresa Portone

Handling missing data is a central challenge in data-driven analysis. Modern imputation methods not only aim for accurate reconstruction but also differ in how they represent and quantify uncertainty. Yet, the reliability and calibration of…

Databases · Computer Science 2025-11-27 Zarin Tahia Hossain , Mostafa Milani

Beyond assigning the correct class, an activity recognition model should also be able to determine, how certain it is in its predictions. We present the first study of how welthe confidence values of modern action recognition architectures…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Alina Roitberg , Monica Haurilet , Manuel Martinez , Rainer Stiefelhagen

Uncertainty quantification in time series prediction is challenging due to the temporal dependence and distribution shift on sequential data. Conformal inference provides a pivotal and flexible instrument for assessing the uncertainty of…

Machine Learning · Statistics 2025-09-09 Junxi Wu , Dongjian Hu , Yajie Bao , Shu-Tao Xia , Changliang Zou

Proper confidence calibration of deep neural networks is essential for reliable predictions in safety-critical tasks. Miscalibration can lead to model over-confidence and/or under-confidence; i.e., the model's confidence in its prediction…

Machine Learning · Computer Science 2023-08-08 Shuang Ao , Stefan Rueger , Advaith Siddharthan

Model calibration usually requires optimizing some parameters (e.g., temperature) w.r.t an objective function (e.g., negative log-likelihood). In this paper, we report a plain, important but often neglected fact that the objective function…

Machine Learning · Computer Science 2023-03-10 Yuli Zou , Weijian Deng , Liang Zheng

Machine unlearning aims to remove the influence of specific training data from a model while preserving reliable behavior on the remaining data, making reliable prediction and uncertainty estimation essential for evaluation. Calibration is…

Computation and Language · Computer Science 2026-05-21 Divyaksh Shukla , Ashutosh Modi

Knowing the uncertainty associated with the output of a deep neural network is of paramount importance in making trustworthy decisions, particularly in high-stakes fields like medical diagnosis and autonomous systems. Monte Carlo Dropout…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Hamzeh Asgharnezhad , Afshar Shamsi , Roohallah Alizadehsani , Arash Mohammadi , Hamid Alinejad-Rokny

Effectively measuring and modeling the reliability of a trained model is essential to the real-world deployment of monocular depth estimation (MDE) models. However, the intrinsic ill-posedness and ordinal-sensitive nature of MDE pose major…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Mochu Xiang , Jing Zhang , Nick Barnes , Yuchao Dai

Seasonal forecasting is a crucial task when it comes to detecting the extreme heat and colds that occur due to climate change. Confidence in the predictions should be reliable since a small increase in the temperatures in a year has a big…

Machine Learning · Computer Science 2024-04-05 Busra Asan , Abdullah Akgül , Alper Unal , Melih Kandemir , Gozde Unal

In the context of computer models, calibration is the process of estimating unknown simulator parameters from observational data. Calibration is variously referred to as model fitting, parameter estimation/inference, an inverse problem, and…

Methodology · Statistics 2023-10-16 Richard D. Wilkinson , Christopher W. Lanyon

Uncertainty analysis in the outcomes of model predictions is a key element in decision-based material design to establish confidence in the models and evaluate the fidelity of models. Uncertainty Propagation (UP) is a technique to determine…

Machine Learning · Computer Science 2023-02-13 Danial Khatamsaz , Vahid Attari , Raymundo Arroyave , Douglas L. Allaire

Supporting model interpretability for complex phenomena where annotators can legitimately disagree, such as emotion recognition, is a challenging machine learning task. In this work, we show that explicitly quantifying the uncertainty in…

Machine Learning · Computer Science 2019-10-08 Asma Ghandeharioun , Brian Eoff , Brendan Jou , Rosalind W. Picard

Methods for reasoning under uncertainty are a key building block of accurate and reliable machine learning systems. Bayesian methods provide a general framework to quantify uncertainty. However, because of model misspecification and the use…

Machine Learning · Computer Science 2018-07-03 Volodymyr Kuleshov , Nathan Fenner , Stefano Ermon