English
Related papers

Related papers: Field-aware Calibration: A Simple and Empirically …

200 papers

Nowadays, sensors play a major role in several contexts like science, industry and daily life which benefit of their use. However, the retrieved information must be reliable. Anomalies in the behavior of sensors can give rise to critical…

Machine Learning · Computer Science 2022-01-26 Luis J. Muñoz-Molina , Ignacio Cazorla-Piñar , Juan P. Dominguez-Morales , Fernando Perez-Peña

Reliable probability estimates are critical in many machine learning applications, yet modern classifiers are often poorly calibrated. Post-hoc calibration provides a simple and widely used solution, but the large number of proposed…

Machine Learning · Computer Science 2026-05-29 Eugène Berta , David Holzmüller , Francis Bach , Michael I. Jordan

Modern artificial intelligence systems make critical decisions yet often fail silently when uncertain -- even well-calibrated models provide no mechanism to identify \textit{which specific predictions} are unreliable. We develop a geometric…

Machine Learning · Statistics 2025-12-02 Soumojit Das , Nairanjana Dasgupta , Prashanta Dutta

Calibrating deep learning models to yield uncertainty-aware predictions is crucial as deep neural networks get increasingly deployed in safety-critical applications. While existing post-hoc calibration methods achieve impressive results on…

Machine Learning · Computer Science 2023-07-06 Christian Tomani , Futa Waseda , Yuesong Shen , Daniel Cremers

Machine learning classifiers often produce probabilistic predictions that are critical for accurate and interpretable decision-making in various domains. The quality of these predictions is generally evaluated with proper losses, such as…

Machine Learning · Computer Science 2025-06-26 Eugène Berta , David Holzmüller , Michael I. Jordan , Francis Bach

Calibration is a classical notion from the forecasting literature which aims to address the question: how should predicted probabilities be interpreted? In a world where we only get to observe (discrete) outcomes, how should we evaluate a…

Machine Learning · Computer Science 2025-09-03 Parikshit Gopalan , Lunjia Hu

Deep neural networks often produce miscalibrated probability estimates, leading to overconfident predictions. A common approach for calibration is fitting a post-hoc calibration map on unseen validation data that transforms predicted…

Machine Learning · Computer Science 2025-07-10 Yunrui Zhang , Gustavo Batista , Salil S. Kanhere

Since neural classifiers are known to be sensitive to adversarial perturbations that alter their accuracy, \textit{certification methods} have been developed to provide provable guarantees on the insensitivity of their predictions to such…

Machine Learning · Computer Science 2025-02-26 Cornelius Emde , Francesco Pinto , Thomas Lukasiewicz , Philip H. S. Torr , Adel Bibi

Well-calibrated predictions of user preferences are essential for many applications. Since recommender systems typically select the top-N items for users, calibration for those top-N items, rather than for all items, is important. We show…

Information Retrieval · Computer Science 2024-08-22 Masahiro Sato

Being cautious is crucial for enhancing the trustworthiness of machine learning systems integrated into decision-making pipelines. Although calibrated probabilities help in optimal decision-making, perfect calibration remains unattainable,…

Machine Learning · Computer Science 2024-08-12 Mari-Liis Allikivi , Joonas Järve , Meelis Kull

We present a novel approach to calibrating linguistic expressions of certainty, e.g., "Maybe" and "Likely". Unlike prior work that assigns a single score to each certainty phrase, we model uncertainty as distributions over the simplex to…

Computation and Language · Computer Science 2025-04-03 Peiqi Wang , Barbara D. Lam , Yingcheng Liu , Ameneh Asgari-Targhi , Rameswar Panda , William M. Wells , Tina Kapur , Polina Golland

Seasonal forecasting is a crucial task when it comes to detecting the extreme heat and colds that occur due to climate change. Confidence in the predictions should be reliable since a small increase in the temperatures in a year has a big…

Machine Learning · Computer Science 2024-04-05 Busra Asan , Abdullah Akgül , Alper Unal , Melih Kandemir , Gozde Unal

Multi-class classification methods that produce sets of probabilistic classifiers, such as ensemble learning methods, are able to model aleatoric and epistemic uncertainty. Aleatoric uncertainty is then typically quantified via the Bayes…

Machine Learning · Statistics 2023-04-20 Thomas Mortier , Viktor Bengs , Eyke Hüllermeier , Stijn Luca , Willem Waegeman

In many safety-critical applications such as autonomous driving and surgical robots, it is desirable to obtain prediction uncertainties from object detection modules to help support safe decision-making. Specifically, such modules need to…

Machine Learning · Computer Science 2018-11-29 Buu Phan , Rick Salay , Krzysztof Czarnecki , Vahdat Abdelzad , Taylor Denouden , Sachin Vernekar

Most supervised machine learning tasks are subject to irreducible prediction errors. Probabilistic predictive models address this limitation by providing probability distributions that represent a belief over plausible targets, rather than…

Machine Learning · Statistics 2022-10-25 David Widmann , Fredrik Lindsten , Dave Zachariah

Accurate uncertainty quantification is critical for reliable predictive modeling. Existing methods typically address either aleatoric uncertainty due to measurement noise or epistemic uncertainty resulting from limited data, but not both in…

Machine Learning · Statistics 2026-03-04 Ilia Azizi , Juraj Bodik , Jakob Heiss , Bin Yu

Accurate uncertainty estimates are important in sequential model-based decision-making tasks such as Bayesian optimization. However, these estimates can be imperfect if the data violates assumptions made by the model (e.g., Gaussianity).…

Machine Learning · Computer Science 2024-06-27 Shachi Deshpande , Charles Marx , Volodymyr Kuleshov

Data-driven methods based on machine learning have the potential to accelerate computational analysis of atomic structures. In this context, reliable uncertainty estimates are important for assessing confidence in predictions and enabling…

Machine Learning · Computer Science 2021-11-04 Jonas Busk , Peter Bjørn Jørgensen , Arghya Bhowmik , Mikkel N. Schmidt , Ole Winther , Tejs Vegge

In typical machine learning systems, an estimate of the probability of the prediction is used to assess the system's confidence in the prediction. This confidence measure is usually uncalibrated; i.e.\ the system's confidence in the…

Computation and Language · Computer Science 2022-05-24 Shehzaad Dhuliawala , Leonard Adolphs , Rajarshi Das , Mrinmaya Sachan

Continual Learning (CL) focuses on maximizing the predictive performance of a model across a non-stationary stream of data. Unfortunately, CL models tend to forget previous knowledge, thus often underperforming when compared with an offline…

Machine Learning · Computer Science 2024-04-15 Lanpei Li , Elia Piccoli , Andrea Cossu , Davide Bacciu , Vincenzo Lomonaco