English
Related papers

Related papers: A Consistent and Differentiable Lp Canonical Calib…

200 papers

Classification models based on deep neural networks (DNNs) must be calibrated to measure the reliability of predictions. Some recent calibration methods have employed a probabilistic model on the probability simplex. However, these…

Machine Learning · Computer Science 2025-03-19 Yasushi Esaki , Akihiro Nakamura , Keisuke Kawano , Ryoko Tokuhisa , Takuro Kutsuna

We study the problem of actively learning a classifier with a low calibration error. One of the most popular Acquisition Functions (AFs) in pool-based Active Learning (AL) is querying by the model's uncertainty. However, we recognize that…

Machine Learning · Computer Science 2025-10-06 Ha Manh Bui , Iliana Maifeld-Carucci , Anqi Liu

Ensuring that predicted probabilities align with observed frequencies is critical in high-stakes domains such as clinical decision support, autonomous driving and financial risk assessment. Existing calibration methods typically apply a…

Machine Learning · Computer Science 2026-05-26 Tomer Lavi , Bracha Shapira , Nadav Rappoport

Selective classification allows models to abstain from making predictions (e.g., say "I don't know") when in doubt in order to obtain better effective accuracy. While typical selective models can be effective at producing more accurate…

Machine Learning · Computer Science 2024-06-24 Adam Fisch , Tommi Jaakkola , Regina Barzilay

Uncertainty in probabilistic classifiers predictions is a key concern when models are used to support human decision making, in broader probabilistic pipelines or when sensitive automatic decisions have to be taken. Studies have shown that…

Machine Learning · Computer Science 2021-09-09 Nicolas Posocco , Antoine Bonnefoy

Propensity score methods are widely used for estimating treatment effects from observational studies. A popular approach is to estimate propensity scores by maximum likelihood based on logistic regression, and then apply inverse probability…

Methodology · Statistics 2017-10-24 Zhiqiang Tan

The accurate representation of epistemic uncertainty is a challenging yet essential task in machine learning. A widely used representation corresponds to convex sets of probabilistic predictors, also known as credal sets. One popular way of…

Machine Learning · Computer Science 2025-07-30 Mira Jürgens , Thomas Mortier , Eyke Hüllermeier , Viktor Bengs , Willem Waegeman

Probabilities or confidence values produced by artificial intelligence (AI) and machine learning (ML) models often do not reflect their true accuracy, with some models being under or over confident in their predictions. For example, if a…

Machine Learning · Computer Science 2025-04-28 Richard Oliver Lane

Many classification applications require accurate probability estimates in addition to good class separation but often classifiers are designed focusing only on the latter. Calibration is the process of improving probability estimates by…

Machine Learning · Computer Science 2020-01-31 Tuomo Alasalmi , Jaakko Suutala , Heli Koskimäki , Juha Röning

In many classification problems it is desirable to output well-calibrated probabilities on the different classes. We propose a robust, non-parametric method of calibrating probabilities called SplineCalib that utilizes smoothing splines to…

Machine Learning · Statistics 2018-09-21 Brian Lucena

Calibrating a multiclass predictor, that outputs a distribution over labels, is particularly challenging due to the exponential number of possible prediction values. In this work, we propose a new definition of calibration error that…

Machine Learning · Computer Science 2025-09-30 Konstantina Bairaktari , Huy L. Nguyen

Calibration of large-scale differential equation models to observational or experimental data is a widespread challenge throughout applied sciences and engineering. A crucial bottleneck in state-of-the art calibration methods is the…

Optimization and Control · Mathematics 2021-02-23 Jon Cockayne , Andrew B. Duncan

For many applications of probabilistic classifiers it is important that the predicted confidence vectors reflect true probabilities (one says that the classifier is calibrated). It has been shown that common models fail to satisfy this…

Machine Learning · Statistics 2022-10-10 Michael Panchenko , Anes Benmerzoug , Miguel de Benito Delgado

Calibration parameters in deterministic computer experiments are those attributes that cannot be measured or available in physical experiments. Kennedy and O'Hagan \cite{kennedy2001bayesian} suggested an approach to estimate them by using…

Methodology · Statistics 2015-08-31 Rui Tuo , C. F. Jeff Wu

Deep neural network (DNN) regression models are widely used in applications requiring state-of-the-art predictive accuracy. However, until recently there has been little work on accurate uncertainty quantification for predictions from such…

Methodology · Statistics 2020-09-07 Nadja Klein , David J. Nott , Michael Stanley Smith

The partitioning of data for estimation and calibration critically impacts the performance of propensity score based estimators like inverse probability weighting (IPW) and double/debiased machine learning (DML) frameworks. We extend recent…

Machine Learning · Statistics 2025-05-20 Sven Klaassen , Jan Rabenseifner , Jannis Kueck , Philipp Bach

Deep neural networks often produce miscalibrated probability estimates, leading to overconfident predictions. A common approach for calibration is fitting a post-hoc calibration map on unseen validation data that transforms predicted…

Machine Learning · Computer Science 2025-07-10 Yunrui Zhang , Gustavo Batista , Salil S. Kanhere

For classification models based on neural networks, the maximum predicted class probability is often used as a confidence score. This score rarely predicts well the probability of making a correct prediction and requires a post-processing…

Machine Learning · Computer Science 2024-11-07 Adrien LeCoz , Stéphane Herbin , Faouzi Adjed

We make two contributions to the problem of estimating the $L_1$ calibration error of a binary classifier from a finite dataset. First, we provide an upper bound for any classifier where the calibration function has bounded variation.…

Accurate uncertainty quantification is critical for reliable predictive modeling. Existing methods typically address either aleatoric uncertainty due to measurement noise or epistemic uncertainty resulting from limited data, but not both in…

Machine Learning · Statistics 2026-03-04 Ilia Azizi , Juraj Bodik , Jakob Heiss , Bin Yu