English
Related papers

Related papers: Deep Neural Network Calibration by Reducing Classi…

200 papers

Deep neural networks are powerful tools to detect hidden patterns in data and leverage them to make predictions, but they are not designed to understand uncertainty and estimate reliable probabilities. In particular, they tend to be…

Machine Learning · Statistics 2022-11-10 Bat-Sheva Einbinder , Yaniv Romano , Matteo Sesia , Yanfei Zhou

Calibrating deep learning models to yield uncertainty-aware predictions is crucial as deep neural networks get increasingly deployed in safety-critical applications. While existing post-hoc calibration methods achieve impressive results on…

Machine Learning · Computer Science 2023-07-06 Christian Tomani , Futa Waseda , Yuesong Shen , Daniel Cremers

Bayesian Neural Networks (BNNs) offer a principled and natural framework for proper uncertainty quantification in the context of deep learning. They address the typical challenges associated with conventional deep learning methods, such as…

Computation · Statistics 2024-11-13 Zahra Moslemi , Yang Meng , Shiwei Lan , Babak Shahbaba

Proper confidence calibration of deep neural networks is essential for reliable predictions in safety-critical tasks. Miscalibration can lead to model over-confidence and/or under-confidence; i.e., the model's confidence in its prediction…

Machine Learning · Computer Science 2023-08-08 Shuang Ao , Stefan Rueger , Advaith Siddharthan

Deep Neural Networks (DNNs) have achieved state-of-the-art accuracy performance in many tasks. However, recent works have pointed out that the outputs provided by these models are not well-calibrated, seriously limiting their use in…

Machine Learning · Computer Science 2020-07-16 Juan Maroñas , Roberto Paredes , Daniel Ramos

A key challenge for deploying deep neural networks (DNNs) in safety critical settings is the need to provide rigorous ways to quantify their uncertainty. In this paper, we propose a novel algorithm for constructing predicted classification…

Machine Learning · Computer Science 2021-03-19 Sangdon Park , Shuo Li , Insup Lee , Osbert Bastani

Regularizing Deep Neural Networks (DNNs) is essential for improving generalizability and preventing overfitting. Fixed penalty methods, though common, lack adaptability and suffer from hyperparameter sensitivity. In this paper, we propose a…

Machine Learning · Computer Science 2023-10-26 Diogo Lavado , Cláudia Soares , Alessandra Micheletti

Recently, deep neural networks have become to be used in a variety of applications. While the accuracy of deep neural networks is increasing, the confidence score, which indicates the reliability of the prediction results, is becoming more…

Machine Learning · Computer Science 2021-04-20 Shohei Enomoto , Takeharu Eda

In terms of accuracy, deep learning (DL) models have had considerable success in classification problems for medical imaging applications. However, it is well-known that the outputs of such models, which typically utilise the SoftMax…

Image and Video Processing · Electrical Eng. & Systems 2023-02-28 Tareen Dawood , Emily Chan , Reza Razavi , Andrew P. King , Esther Puyol-Anton

Calibrating deep neural models plays an important role in building reliable, robust AI systems in safety-critical applications. Recent work has shown that modern neural networks that possess high predictive capability are poorly calibrated…

Machine Learning · Computer Science 2025-09-16 Cheng Wang

Despite achieving enormous success in predictive accuracy for visual classification problems, deep neural networks (DNNs) suffer from providing overconfident probabilities on out-of-distribution (OOD) data. Yet, accurate uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Zongyao Lyu , Nolan B. Gutierrez , William J. Beksi

Deep neural networks (DNNs) have enabled astounding progress in several vision-based problems. Despite showing high predictive accuracy, recently, several works have revealed that they tend to provide overconfident predictions and thus are…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Muhammad Akhtar Munir , Muhammad Haris Khan , Salman Khan , Fahad Shahbaz Khan

Modern convolutional neural networks (CNNs) are known to be overconfident in terms of their calibration on unseen input data. That is to say, they are more confident than they are accurate. This is undesirable if the probabilities predicted…

Machine Learning · Computer Science 2021-12-03 Guoxuan Xia , Sangwon Ha , Tiago Azevedo , Partha Maji

To increase the trustworthiness of deep neural network (DNN) classifiers, an accurate prediction confidence that represents the true likelihood of correctness is crucial. Towards this end, many post-hoc calibration methods have been…

Machine Learning · Computer Science 2020-06-17 Zhihui Shao , Jianyi Yang , Shaolei Ren

Deep neural networks (DNNs) have achieved significant success across various tasks, but ensuring reliable uncertainty estimates, known as model calibration, is crucial for their safe and effective deployment. Modern DNNs often suffer from…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Linwei Tao , Minjing Dong , Chang Xu

Many applications of classification methods not only require high accuracy but also reliable estimation of predictive uncertainty. However, while many current classification frameworks, in particular deep neural networks, achieve high…

Machine Learning · Computer Science 2020-02-28 Jonathan Wenger , Hedvig Kjellström , Rudolph Triebel

We propose a generic framework to calibrate accuracy and confidence of a prediction in deep neural networks through stochastic inferences. We interpret stochastic regularization using a Bayesian model, and analyze the relation between…

Machine Learning · Computer Science 2019-04-25 Seonguk Seo , Paul Hongsuck Seo , Bohyung Han

Although deep Neural Networks (DNNs) have achieved tremendous success in audio classification tasks, their uncertainty calibration are still under-explored. A well-calibrated model should be accurate when it is certain about its prediction…

Sound · Computer Science 2022-06-28 Tong Ye , Shijing Si , Jianzong Wang , Ning Cheng , Jing Xiao

Deep learning has revolutionized modern data science. However, how to accurately quantify the uncertainty of predictions from large-scale deep neural networks (DNNs) remains an unresolved issue. To address this issue, we introduce a novel…

Machine Learning · Statistics 2025-08-05 Yan Sun , Faming Liang

Calibration is crucial in deep learning applications, especially in fields like healthcare and autonomous driving, where accurate confidence estimates are vital for decision-making. However, deep neural networks often suffer from…

Machine Learning · Computer Science 2024-10-17 Linwei Tao , Haolan Guo , Minjing Dong , Chang Xu