English
Related papers

Related papers: Calibration through the Lens of Interpretability

200 papers

We make two contributions to the problem of estimating the $L_1$ calibration error of a binary classifier from a finite dataset. First, we provide an upper bound for any classifier where the calibration function has bounded variation.…

Standard methods in computer model calibration treat the calibration parameters as constant throughout the domain of control inputs. In many applications, systematic variation may cause the best values for the calibration parameters to…

Methodology · Statistics 2017-02-09 D. Andrew Brown , Sez Atamturktur

Frequently, a set of objects has to be evaluated by a panel of assessors, but not every object is assessed by every assessor. A problem facing such panels is how to take into account different standards amongst panel members and varying…

Methodology · Statistics 2017-02-16 Robert S. MacKay , Ralph Kenna , Robert J. Low , Sarah Parker

Calibration allows predictions to be reliably interpreted as probabilities by decision makers. We propose a decision-theoretic calibration error, the Calibration Decision Loss (CDL), defined as the maximum improvement in decision payoff…

Machine Learning · Computer Science 2024-10-14 Lunjia Hu , Yifan Wu

While in-context learning with large language models (LLMs) has shown impressive performance, we have discovered a unique miscalibration behavior where both correct and incorrect predictions are assigned the same level of confidence. We…

Computation and Language · Computer Science 2024-10-04 Wei Cheng , Tianlu Wang , Yanmin Ji , Fan Yang , Keren Tan , Yiyu Zheng

In the field of medical image analysis, achieving high accuracy is not enough; ensuring well-calibrated predictions is also crucial. Confidence scores of a deep neural network play a pivotal role in explainability by providing insights into…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Abhishek Singh Sambyal , Usma Niyaz , Narayanan C. Krishnan , Deepti R. Bathula

Regression calibration is a popular approach for correcting biases in estimated regression parameters when exposure variables are measured with error. This approach involves building a calibration equation to estimate the value of the…

The aim of this research is to give a simple framework to evaluate/quantize the "transparency" of a firm. We assume that the process of the firm value is only observable once in a while but is strongly correlated with the stock price which…

Risk Management · Quantitative Finance 2009-10-27 Jirô Akahori , Yuuki Kanishi , Yuichi Morimura

As machine learning systems become ubiquitous, there has been a surge of interest in interpretable machine learning: systems that provide explanation for their outputs. These explanations are often used to qualitatively assess other…

Machine Learning · Statistics 2017-03-06 Finale Doshi-Velez , Been Kim

Survival analysis deals with modeling the time until an event occurs, and accurate probability estimates are crucial for decision-making, particularly in the competing-risks setting where multiple events are possible. While recent work has…

Methodology · Statistics 2026-02-03 Julie Alberge , Tristan Haugomat , Gaël Varoquaux , Judith Abécassis

Post-hoc calibration methods are widely used to improve the reliability of probabilistic predictions from machine learning models. Despite their prevalence, a comprehensive theoretical understanding of these methods remains elusive,…

Machine Learning · Computer Science 2025-09-30 Kristina P. Sinaga , Arjun S. Nair

As the frontiers of applied statistics progress through increasingly complex experiments we must exploit increasingly sophisticated inferential models to analyze the observations we make. In order to avoid misleading or outright erroneous…

Methodology · Statistics 2018-03-23 Michael Betancourt

Delivering meaningful uncertainty estimates is essential for a successful deployment of machine learning models in the clinical practice. A central aspect of uncertainty quantification is the ability of a model to return predictions that…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Adrian Galdran , Johan Verjans , Gustavo Carneiro , Miguel A. González Ballester

Accurately predicting the probabilities of user feedback, such as clicks and conversions, is critical for advertisement ranking and bidding. However, there often exist unwanted mismatches between predicted probabilities and true likelihoods…

Machine Learning · Computer Science 2024-05-22 Yuang Zhao , Chuhan Wu , Qinglin Jia , Hong Zhu , Jia Yan , Libin Zong , Linxuan Zhang , Zhenhua Dong , Muyu Zhang

Generating confidence calibrated outputs is of utmost importance for the applications of deep neural networks in safety-critical decision-making systems. The output of a neural network is a probability distribution where the scores are…

Machine Learning · Computer Science 2021-09-17 Chihuang Liu , Joseph JaJa

Calibration measures quantify how much a forecaster's predictions violates calibration, which requires that forecasts are unbiased conditioning on the forecasted probabilities. Two important desiderata for a calibration measure are its…

Machine Learning · Computer Science 2025-03-05 Mingda Qiao , Eric Zhao

Data analysis based on information from several sources is common in economic and biomedical studies. This setting is often referred to as the data fusion problem, which differs from traditional missing data problems since no complete data…

Methodology · Statistics 2022-04-07 Wei Li , Shanshan Luo , Wangli Xu

Machine learning models that first learn a representation of a domain in terms of human-understandable concepts, then use it to make predictions, have been proposed to facilitate interpretation and interaction with models trained on…

Machine Learning · Computer Science 2020-12-08 Isaac Lage , Finale Doshi-Velez

Accurate estimation of predictive uncertainty (model calibration) is essential for the safe application of neural networks. Many instances of miscalibration in modern neural networks have been reported, suggesting a trend that newer, more…

Machine Learning · Computer Science 2021-10-27 Matthias Minderer , Josip Djolonga , Rob Romijnders , Frances Hubis , Xiaohua Zhai , Neil Houlsby , Dustin Tran , Mario Lucic

Uncertainty quantification in automated image analysis is highly desired in many applications. Typically, machine learning models in classification or segmentation are only developed to provide binary answers; however, quantifying the…