English
Related papers

Related papers: How to Fix a Broken Confidence Estimator: Evaluati…

200 papers

Finding a better feasible solution in a shorter time is an integral part of solving Mixed Integer Programs. We present a post-hoc method based on Neural Diving to build heuristics more flexibly. We hypothesize that variables with higher…

Optimization and Control · Mathematics 2022-03-16 Taehyun Yoon

Although neural networks (especially deep neural networks) have achieved \textit{better-than-human} performance in many fields, their real-world deployment is still questionable due to the lack of awareness about the limitation in their…

Machine Learning · Computer Science 2023-04-12 Mehedi Hasan , Moloud Abdar , Abbas Khosravi , Uwe Aickelin , Pietro Lio' , Ibrahim Hossain , Ashikur Rahman , Saeid Nahavandi

Deep neural networks (DNNs) have achieved significant success across various tasks, but ensuring reliable uncertainty estimates, known as model calibration, is crucial for their safe and effective deployment. Modern DNNs often suffer from…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Linwei Tao , Minjing Dong , Chang Xu

Machine learning classifiers often produce probabilistic predictions that are critical for accurate and interpretable decision-making in various domains. The quality of these predictions is generally evaluated with proper losses, such as…

Machine Learning · Computer Science 2025-06-26 Eugène Berta , David Holzmüller , Michael I. Jordan , Francis Bach

We propose a generic framework to calibrate accuracy and confidence of a prediction in deep neural networks through stochastic inferences. We interpret stochastic regularization using a Bayesian model, and analyze the relation between…

Machine Learning · Computer Science 2019-04-25 Seonguk Seo , Paul Hongsuck Seo , Bohyung Han

Understanding the trustworthiness of a prediction yielded by a classifier is critical for the safe and effective use of AI models. Prior efforts have been proven to be reliable on small-scale datasets. In this work, we study the problem of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Yan Luo , Yongkang Wong , Mohan S. Kankanhalli , Qi Zhao

Uncertainty quantification is critical in safety-sensitive applications but is often omitted from off-the-shelf neural networks due to adverse effects on predictive performance. Retrofitting uncertainty estimates post-hoc typically requires…

Machine Learning · Computer Science 2025-06-03 Lennart Bramlage , Cristóbal Curio

In semantic segmentation, even state-of-the-art deep learning models fall short of the performance required in certain high-stakes applications such as medical image analysis. In these cases, performance can be improved by allowing a model…

Machine Learning · Computer Science 2026-05-26 Bruno Laboissiere Camargos Borges , Bruno Machado Pacheco , Danilo Silva

In large deep neural networks that seem to perform surprisingly well on many tasks, we also observe a few failures related to accuracy, social biases, and alignment with human values, among others. Therefore, before deploying these models,…

Machine Learning · Computer Science 2024-06-17 Som Sagar , Aditya Taparia , Ransalu Senanayake

Deep networks have shown remarkable performance across a wide range of tasks, yet getting a global concept-level understanding of how they function remains a key challenge. Many post-hoc concept-based approaches have been introduced to…

Machine Learning · Computer Science 2026-04-15 Amin Parchami-Araghi , Sukrut Rao , Jonas Fischer , Bernt Schiele

Machine learning classifiers are probabilistic in nature, and thus inevitably involve uncertainty. Predicting the probability of a specific input to be correct is called uncertainty (or confidence) estimation and is crucial for risk…

Machine Learning · Computer Science 2023-01-11 Gabriella Chouraqui , Liron Cohen , Gil Einziger , Liel Leman

The use of complex machine learning models can make systems opaque to users. Machine learning research proposes the use of post-hoc explanations. However, it is unclear if they give users insights into otherwise uninterpretable models. One…

Human-Computer Interaction · Computer Science 2019-05-09 Martin Schuessler , Philipp Weiß

This paper studies the problem of post-hoc calibration of machine learning classifiers. We introduce the following desiderata for uncertainty calibration: (a) accuracy-preserving, (b) data-efficient, and (c) high expressive power. We show…

Machine Learning · Computer Science 2020-07-01 Jize Zhang , Bhavya Kailkhura , T. Yong-Jin Han

Recently, deep neural networks have become to be used in a variety of applications. While the accuracy of deep neural networks is increasing, the confidence score, which indicates the reliability of the prediction results, is becoming more…

Machine Learning · Computer Science 2021-04-20 Shohei Enomoto , Takeharu Eda

Detecting out-of-distribution inputs is critical for safe deployment of machine learning models in the real world. However, neural networks are known to suffer from the overconfidence issue, where they produce abnormally high confidence for…

Machine Learning · Computer Science 2022-06-27 Hongxin Wei , Renchunzi Xie , Hao Cheng , Lei Feng , Bo An , Yixuan Li

To train robust deep neural networks (DNNs), we systematically study several target modification approaches, which include output regularisation, self and non-self label correction (LC). Two key issues are discovered: (1) Self LC is the…

Machine Learning · Computer Science 2021-06-03 Xinshao Wang , Yang Hua , Elyor Kodirov , David A. Clifton , Neil M. Robertson

Confidence estimation aims to quantify the confidence of the model prediction, providing an expectation of success. A well-calibrated confidence estimate enables accurate failure prediction and proper risk measurement when given noisy…

Computation and Language · Computer Science 2022-03-23 Yu Lu , Jiali Zeng , Jiajun Zhang , Shuangzhi Wu , Mu Li

Machine learning plays an increasingly significant role in many aspects of our lives (including medicine, transportation, security, justice and other domains), making the potential consequences of false predictions increasingly devastating.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 Yuval Bahat , Gregory Shakhnarovich

Confidence calibration is a major concern when applying artificial neural networks in safety-critical applications. Since most research in this area has focused on classification in the past, confidence calibration in the scope of object…

Computer Vision and Pattern Recognition · Computer Science 2021-01-11 Franziska Schwaiger , Maximilian Henne , Fabian Küppers , Felippe Schmoeller Roza , Karsten Roscher , Anselm Haselhoff

Deep neural network(DNN) based classifiers do extremely well in discriminating between observations, resulting in higher ROC AUC and accuracy metrics, but their outputs are often miscalibrated with respect to true event likelihoods.…

Machine Learning · Computer Science 2025-12-30 Dhruv Nigam