English
Related papers

Related papers: Addressing Deep Learning Model Calibration Using E…

200 papers

This paper questions the effectiveness of a modern predictive uncertainty quantification approach, called \emph{evidential deep learning} (EDL), in which a single neural network model is trained to learn a meta distribution over the…

Machine Learning · Computer Science 2024-11-04 Maohao Shen , J. Jon Ryu , Soumya Ghosh , Yuheng Bu , Prasanna Sattigeri , Subhro Das , Gregory W. Wornell

In this work, we examine the effectiveness of an uncertainty quantification framework known as Evidential Deep Learning applied in the context of biomedical image segmentation. This class of models involves assigning Dirichlet distributions…

Image and Video Processing · Electrical Eng. & Systems 2025-04-24 Hai Siong Tan , Kuancheng Wang , Rafe Mcbeth

Deep Neural Networks (DNN) represent the state of the art in many tasks. However, due to their overparameterization, their generalization capabilities are in doubt and still a field under study. Consequently, DNN can overfit and assign…

Machine Learning · Computer Science 2021-05-19 Juan Maroñas , Daniel Ramos , Roberto Paredes

The proliferation of Deep Neural Networks has resulted in machine learning systems becoming increasingly more present in various real-world applications. Consequently, there is a growing demand for highly reliable models in many domains,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Pedro Conde , Rui L. Lopes , Cristiano Premebida

Optimal decision making requires that classifiers produce uncertainty estimates consistent with their empirical accuracy. However, deep neural networks are often under- or over-confident in their predictions. Consequently, methods have been…

Real-world sensor-based learning systems require uncertainty estimation that is both reliable and computationally efficient. Evidential Deep Learning (EDL) provides single-pass uncertainty estimation by modeling the class probabilities via…

Machine Learning · Computer Science 2026-05-22 Berk Hayta , Hannah Laus , Simon Mittermaier , Felix Krahmer

In recent years, deep neural networks (DNNs) have demonstrated state-of-the-art performance across various domains. However, despite their success, they often face calibration issues, particularly in safety-critical applications such as…

Machine Learning · Computer Science 2025-04-15 Jiani Ni , He Zhao , Jintong Gao , Dandan Guo , Hongyuan Zha

Fine-tuned large language models (LLMs) often exhibit overconfidence, particularly when trained on small datasets, resulting in poor calibration and inaccurate uncertainty estimates. Evidential Deep Learning (EDL), an uncertainty-aware…

Machine Learning · Computer Science 2025-02-12 Yawei Li , David Rügamer , Bernd Bischl , Mina Rezaei

Reliable uncertainty calibration is essential for safely deploying deep neural networks in high-stakes applications. Deep neural networks are known to exhibit systematic overconfidence, especially under distribution shifts. Although…

Machine Learning · Computer Science 2025-06-12 Achim Hekler , Lukas Kuhn , Florian Buettner

Convolutional Neural Networks (CNNs) have proven to be state-of-the-art models for supervised computer vision tasks, such as image classification. However, large labeled data sets are generally needed for the training and validation of such…

Machine Learning · Computer Science 2020-10-28 Patrick Hemmer , Niklas Kühl , Jakob Schöffer

Although deep Neural Networks (DNNs) have achieved tremendous success in audio classification tasks, their uncertainty calibration are still under-explored. A well-calibrated model should be accurate when it is certain about its prediction…

Sound · Computer Science 2022-06-28 Tong Ye , Shijing Si , Jianzong Wang , Ning Cheng , Jing Xiao

Miscalibration - a mismatch between a model's confidence and its correctness - of Deep Neural Networks (DNNs) makes their predictions hard to rely on. Ideally, we want networks to be accurate, calibrated and confident. We show that, as…

Machine Learning · Computer Science 2020-10-27 Jishnu Mukhoti , Viveka Kulharia , Amartya Sanyal , Stuart Golodetz , Philip H. S. Torr , Puneet K. Dokania

Deep Learning (DL) has made remarkable achievements in computer vision and adopted in safety critical domains such as medical imaging or autonomous drive. Thus, it is necessary to understand the uncertainty of the model to effectively…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Hyekyoung Hwang , Jitae Shin

Dynamic neural networks are a recent technique that promises a remedy for the increasing size of modern deep learning models by dynamically adapting their computational cost to the difficulty of the inputs. In this way, the model can adjust…

Machine Learning · Computer Science 2023-12-11 Lassi Meronen , Martin Trapp , Andrea Pilzer , Le Yang , Arno Solin

Miscalibration in deep learning refers to there is a discrepancy between the predicted confidence and performance. This problem usually arises due to the overfitting problem, which is characterized by learning everything presented in the…

Machine Learning · Computer Science 2024-07-16 Zongbo Han , Yifeng Yang , Changqing Zhang , Linjun Zhang , Joey Tianyi Zhou , Qinghua Hu

Deep neural networks (DNN) are prone to miscalibrated predictions, often exhibiting a mismatch between the predicted output and the associated confidence scores. Contemporary model calibration techniques mitigate the problem of…

Machine Learning · Computer Science 2022-12-21 Ramya Hebbalaguppe , Rishabh Patra , Tirtharaj Dash , Gautam Shroff , Lovekesh Vig

Accurate quantification of both aleatoric and epistemic uncertainties is essential when deploying Graph Neural Networks (GNNs) in high-stakes applications such as drug discovery and financial fraud detection, where reliable predictions are…

Machine Learning · Computer Science 2025-03-12 Linlin Yu , Kangshuo Li , Pritom Kumar Saha , Yifei Lou , Feng Chen

The full acceptance of Deep Learning (DL) models in the clinical field is rather low with respect to the quantity of high-performing solutions reported in the literature. Particularly, end users are reluctant to rely on the rough…

Image and Video Processing · Electrical Eng. & Systems 2022-10-11 Benjamin Lambert , Florence Forbes , Alan Tucholka , Senan Doyle , Harmonie Dehaene , Michel Dojat

In recent years, deep neural networks (DNNs) have shown competitive results in many fields. Despite this success, they often suffer from poor calibration, especially in safety-critical scenarios such as autonomous driving and healthcare,…

Machine Learning · Computer Science 2025-08-13 Jiani Ni , He Zhao , Yibo Yang , Dandan Guo

In the field of deep learning based computer vision, the development of deep object detection has led to unique paradigms (e.g., two-stage or set-based) and architectures (e.g., Faster-RCNN or DETR) which enable outstanding performance on…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Denis Huseljic , Marek Herde , Mehmet Muejde , Bernhard Sick