English
Related papers

Related papers: Beyond In-Domain Scenarios: Robust Density-Aware C…

200 papers

Improving calibration performance in deep learning (DL) classification models is important when planning the use of DL in a decision-support setting. In such a scenario, a confident wrong prediction could lead to a lack of trust and/or harm…

Machine Learning · Computer Science 2024-05-13 Tareen Dawood , Bram Ruijsink , Reza Razavi , Andrew P. King , Esther Puyol-Antón

Deep neural networks (DNNs) have made great strides in pushing the state-of-the-art in several challenging domains. Recent studies reveal that they are prone to making overconfident predictions. This greatly reduces the overall trust in…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Vinith Kugathasan , Muhammad Haris Khan

Albeit revealing impressive predictive performance for several computer vision tasks, deep neural networks (DNNs) are prone to making overconfident predictions. This limits the adoption and wider utilization of DNNs in many safety-critical…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Muhammad Akhtar Munir , Salman Khan , Muhammad Haris Khan , Mohsen Ali , Fahad Shahbaz Khan

Deep neural networks (DNNs) enable innovative applications of machine learning like image recognition, machine translation, or malware detection. However, deep learning is often criticized for its lack of robustness in adversarial settings…

Machine Learning · Computer Science 2018-03-14 Nicolas Papernot , Patrick McDaniel

Deep neural networks often produce miscalibrated probability estimates, leading to overconfident predictions. A common approach for calibration is fitting a post-hoc calibration map on unseen validation data that transforms predicted…

Machine Learning · Computer Science 2025-07-10 Yunrui Zhang , Gustavo Batista , Salil S. Kanhere

Deep neural network (DNN) classifiers are often overconfident, producing miscalibrated class probabilities. In high-risk applications like healthcare, practitioners require $\textit{fully calibrated}$ probability predictions for…

Machine Learning · Statistics 2022-12-09 Zhen Lin , Shubhendu Trivedi , Jimeng Sun

Probability calibration for deep models is highly desirable in safety-critical applications such as medical imaging. It makes output probabilities of deep networks interpretable, by aligning prediction probability with the actual accuracy…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Cheng Ouyang , Shuo Wang , Chen Chen , Zeju Li , Wenjia Bai , Bernhard Kainz , Daniel Rueckert

Active domain adaptation (DA) aims to maximally boost the model adaptation on a new target domain by actively selecting limited target data to annotate, whereas traditional active learning methods may be less effective since they do not…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Mixue Xie , Shuang Li , Rui Zhang , Chi Harold Liu

Deep neural network(DNN) based classifiers do extremely well in discriminating between observations, resulting in higher ROC AUC and accuracy metrics, but their outputs are often miscalibrated with respect to true event likelihoods.…

Machine Learning · Computer Science 2025-12-30 Dhruv Nigam

To facilitate a wide-spread acceptance of AI systems guiding decision making in real-world applications, trustworthiness of deployed models is key. That is, it is crucial for predictive models to be uncertainty-aware and yield…

Machine Learning · Computer Science 2021-03-04 Christian Tomani , Florian Buettner

Model calibration measures the agreement between the predicted probability estimates and the true correctness likelihood. Proper model calibration is vital for high-risk applications. Unfortunately, modern deep neural networks are poorly…

Image and Video Processing · Electrical Eng. & Systems 2022-09-14 Skylar E. Stolte , Kyle Volle , Aprinda Indahlastari , Alejandro Albizu , Adam J. Woods , Kevin Brink , Matthew Hale , Ruogu Fang

This paper studies the problem of post-hoc calibration of machine learning classifiers. We introduce the following desiderata for uncertainty calibration: (a) accuracy-preserving, (b) data-efficient, and (c) high expressive power. We show…

Machine Learning · Computer Science 2020-07-01 Jize Zhang , Bhavya Kailkhura , T. Yong-Jin Han

Although deep neural networks yield high classification accuracy given sufficient training data, their predictions are typically overconfident or under-confident, i.e., the prediction confidences cannot truly reflect the accuracy. Post-hoc…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Jiexin Wang , Jiahao Chen , Bing Su

Deep learning models frequently encounter feature uncertainty in diverse learning scenarios, significantly impacting their performance and reliability. This challenge is particularly complex in multi-modal scenarios, where models must…

Machine Learning · Computer Science 2025-06-05 Jiahao Qin , Bei Peng , Feng Liu , Guangliang Cheng , Lu Zong

Fine-tuning pre-trained neural network models has become a widely adopted approach across various domains. However, it can lead to the distortion of pre-trained feature extractors that already possess strong generalization capabilities.…

Machine Learning · Computer Science 2024-03-27 Seokhyeon Ha , Sunbeom Jung , Jungwoo Lee

Out-of-distribution (OOD) detection remains a fundamental challenge for deep neural networks, particularly due to overconfident predictions on unseen OOD samples during testing. We reveal a key insight: OOD samples predicted as the same…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Yanqi Wu , Qichao Chen , Runhe Lai , Xinhua Lu , Jia-Xin Zhuang , Zhilin Zhao , Wei-Shi Zheng , Ruixuan Wang

To analyse local robustness properties of deep neural networks (DNNs), we present a practical framework from a model learning perspective. Based on black-box model learning with scenario optimisation, we abstract the local behaviour of a…

Machine Learning · Computer Science 2022-04-14 Renjue Li , Pengfei Yang , Cheng-Chao Huang , Youcheng Sun , Bai Xue , Lijun Zhang

Optimal decision making requires that classifiers produce uncertainty estimates consistent with their empirical accuracy. However, deep neural networks are often under- or over-confident in their predictions. Consequently, methods have been…

In many applications, it is desirable that a classifier not only makes accurate predictions, but also outputs calibrated posterior probabilities. However, many existing classifiers, especially deep neural network classifiers, tend to be…

Machine Learning · Statistics 2021-06-24 Xingchen Ma , Matthew B. Blaschko

Predicting calibrated confidence scores for multi-class deep networks is important for avoiding rare but costly mistakes. A common approach is to learn a post-hoc calibration function that transforms the output of the original network into…

Machine Learning · Computer Science 2020-10-26 Amir Rahimi , Amirreza Shaban , Ching-An Cheng , Richard Hartley , Byron Boots