English
Related papers

Related papers: Class-wise and reduced calibration methods

200 papers

Reliable confidence estimation for the predictions is important in many safety-critical applications. However, modern deep neural networks are often overconfident for their incorrect predictions. Recently, many calibration methods have been…

Machine Learning · Computer Science 2023-03-07 Fei Zhu , Zhen Cheng , Xu-Yao Zhang , Cheng-Lin Liu

Advanced classification algorithms are being increasingly used in safety-critical applications like health-care, engineering, etc. In such applications, miss-classifications made by ML algorithms can result in substantial financial or…

Machine Learning · Computer Science 2024-12-06 Disha Ghandwani , Neeraj Sarna , Yuanyuan Li , Yang Lin

Calibration$\unicode{x2014}$the problem of ensuring that predicted probabilities align with observed class frequencies$\unicode{x2014}$is a basic desideratum for reliable prediction with machine learning systems. Calibration error is…

Machine Learning · Statistics 2026-03-02 Eugène Berta , Sacha Braun , David Holzmüller , Francis Bach , Michael I. Jordan

The task of calibration is to retrospectively adjust the outputs from a machine learning model to provide better probability estimates on the target variable. While calibration has been investigated thoroughly in classification, it has not…

Machine Learning · Statistics 2018-06-21 Hao Song , Meelis Kull , Peter Flach

Proper confidence calibration of deep neural networks is essential for reliable predictions in safety-critical tasks. Miscalibration can lead to model over-confidence and/or under-confidence; i.e., the model's confidence in its prediction…

Machine Learning · Computer Science 2023-08-08 Shuang Ao , Stefan Rueger , Advaith Siddharthan

The class-wise training losses often diverge as a result of the various levels of intra-class and inter-class appearance variation, and we find that the diverging class-wise training losses cause the uncalibrated prediction with its…

Machine Learning · Computer Science 2023-06-21 Seungjin Jung , Seungmo Seo , Yonghyun Jeong , Jongwon Choi

A much studied issue is the extent to which the confidence scores provided by machine learning algorithms are calibrated to ground truth probabilities. Our starting point is that calibration is seemingly incompatible with class weighting, a…

Machine Learning · Computer Science 2022-08-02 Andrew Caplin , Daniel Martin , Philip Marx

Deep neural networks have demonstrated remarkable performance across numerous learning tasks but often suffer from miscalibration, resulting in unreliable probability outputs. This has inspired many recent works on mitigating…

Machine Learning · Computer Science 2025-09-23 Wenjian Huang , Guiping Cao , Jiahao Xia , Jingkun Chen , Hao Wang , Jianguo Zhang

We propose a novel methodology for general multi-class classification in arbitrary feature spaces, which results in a potentially well-calibrated classifier. Calibrated classifiers are important in many applications because, in addition to…

Machine Learning · Statistics 2023-02-22 Raoul Heese , Jochen Schmid , Michał Walczak , Michael Bortz

Uncertainty estimates must be calibrated (i.e., accurate) and sharp (i.e., informative) in order to be useful. This has motivated a variety of methods for recalibration, which use held-out data to turn an uncalibrated model into a…

Machine Learning · Computer Science 2022-07-06 Charles Marx , Shengjia Zhao , Willie Neiswanger , Stefano Ermon

While the accuracy of modern deep learning models has significantly improved in recent years, the ability of these models to generate uncertainty estimates has not progressed to the same degree. Uncertainty methods are designed to provide…

Machine Learning · Statistics 2020-06-17 Adam M. Oberman , Chris Finlay , Alexander Iannantuono , Tiago Salvador

Recommender systems utilize users' historical data to learn and predict their future interests, providing them with suggestions tailored to their tastes. Calibration ensures that the distribution of recommended item categories is consistent…

Information Retrieval · Computer Science 2022-08-23 Mohammadmehdi Naghiaei , Hossein A. Rahmani , Mohammad Aliannejadi , Nasim Sonboli

Confidence calibration -- the problem of predicting probability estimates representative of the true correctness likelihood -- is important for classification models in many applications. We discover that modern neural networks, unlike…

Machine Learning · Computer Science 2017-08-04 Chuan Guo , Geoff Pleiss , Yu Sun , Kilian Q. Weinberger

Machine-generated probability predictions are essential in modern classification tasks such as image classification. A model is well calibrated when its predicted probabilities correspond to observed event frequencies. Despite the need for…

Machine Learning · Statistics 2026-02-24 Amy Vennos , Xin Xing , Christopher T. Franck

We introduce a framework for calibrating machine learning models so that their predictions satisfy explicit, finite-sample statistical guarantees. Our calibration algorithms work with any underlying model and (unknown) data-generating…

Machine Learning · Computer Science 2022-10-03 Anastasios N. Angelopoulos , Stephen Bates , Emmanuel J. Candès , Michael I. Jordan , Lihua Lei

Analyzing classification model performance is a crucial task for machine learning practitioners. While practitioners often use count-based metrics derived from confusion matrices, like accuracy, many applications, such as weather…

Human-Computer Interaction · Computer Science 2022-07-29 Peter Xenopoulos , Joao Rulff , Luis Gustavo Nonato , Brian Barr , Claudio Silva

Learning classifiers using skewed or imbalanced datasets can occasionally lead to classification issues; this is a serious issue. In some cases, one class contains the majority of examples while the other, which is frequently the more…

Machine Learning · Computer Science 2022-11-11 Satyendra Singh Rawat , Amit Kumar Mishra

Calibration is an essential prerequisite for the accurate data fusion of LiDAR and camera sensors. Traditional calibration techniques often require specific targets or suitable scenes to obtain reliable 2D-3D correspondences. To tackle the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Shujuan Huang , Chunyu Lin , Yao Zhao

Ensuring that classifiers are well-calibrated, i.e., their predictions align with observed frequencies, is a minimal and fundamental requirement for classifiers to be viewed as trustworthy. Existing methods for assessing multiclass…

Machine Learning · Computer Science 2025-10-30 Mahmoud Hegazy , Michael I. Jordan , Aymeric Dieuleveut

A reliable deep learning system should be able to accurately express its confidence with respect to its predictions, a quality known as calibration. One of the most effective ways to produce reliable confidence estimates with a pre-trained…

Machine Learning · Computer Science 2024-10-10 Thomas P. Zollo , Zhun Deng , Jake C. Snell , Toniann Pitassi , Richard Zemel