English
Related papers

Related papers: Uncertainty Calibration with Energy Based Instance…

200 papers

Despite the recent progress in deep neural networks (DNNs), it remains challenging to explain the predictions made by DNNs. Existing explanation methods for DNNs mainly focus on post-hoc explanations where another explanatory model is…

Machine Learning · Computer Science 2024-01-04 Wei Qian , Chenxu Zhao , Yangyi Li , Fenglong Ma , Chao Zhang , Mengdi Huai

Confidence calibration is of great importance to the reliability of decisions made by machine learning systems. However, discriminative classifiers based on deep neural networks are often criticized for producing overconfident predictions…

Machine Learning · Computer Science 2021-08-17 Yezhen Wang , Bo Li , Tong Che , Kaiyang Zhou , Ziwei Liu , Dongsheng Li

Although deep neural networks yield high classification accuracy given sufficient training data, their predictions are typically overconfident or under-confident, i.e., the prediction confidences cannot truly reflect the accuracy. Post-hoc…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Jiexin Wang , Jiahao Chen , Bing Su

With model trustworthiness being crucial for sensitive real-world applications, practitioners are putting more and more focus on improving the uncertainty calibration of deep neural networks. Calibration errors are designed to quantify the…

Machine Learning · Computer Science 2024-03-14 Sebastian G. Gruber , Florian Buettner

Existing deep neural network (DNN) based wireless localization approaches typically do not capture uncertainty inherent in their estimates. In this work, we propose and evaluate variational and scalable DNN approaches to measure the…

Signal Processing · Electrical Eng. & Systems 2021-06-10 Artan Salihu , Stefan Schwarz , Markus Rupp

Rigorous statistical methods, including parameter estimation with accompanying uncertainties, underpin the validity of scientific discovery, especially in the natural sciences. With increasingly complex data models such as deep learning…

Machine Learning · Computer Science 2026-02-18 Aurora Grefsrud , Nello Blaser , Trygve Buanes

Although deep Neural Networks (DNNs) have achieved tremendous success in audio classification tasks, their uncertainty calibration are still under-explored. A well-calibrated model should be accurate when it is certain about its prediction…

Sound · Computer Science 2022-06-28 Tong Ye , Shijing Si , Jianzong Wang , Ning Cheng , Jing Xiao

Modern neural networks have found to be miscalibrated in terms of confidence calibration, i.e., their predicted confidence scores do not reflect the observed accuracy or precision. Recent work has introduced methods for post-hoc confidence…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Fabian Küppers , Jan Kronenberger , Jonas Schneider , Anselm Haselhoff

Physics-informed neural networks (PINNs) have recently emerged as an alternative way of solving partial differential equations (PDEs) without the need of building elaborate grids, instead, using a straightforward implementation. In…

Analysis of PDEs · Mathematics 2019-09-04 Dongkun Zhang , Lu Lu , Ling Guo , George Em Karniadakis

Deep neural networks often produce miscalibrated probability estimates, leading to overconfident predictions. A common approach for calibration is fitting a post-hoc calibration map on unseen validation data that transforms predicted…

Machine Learning · Computer Science 2025-07-10 Yunrui Zhang , Gustavo Batista , Salil S. Kanhere

Many applications of classification methods not only require high accuracy but also reliable estimation of predictive uncertainty. However, while many current classification frameworks, in particular deep neural networks, achieve high…

Machine Learning · Computer Science 2020-02-28 Jonathan Wenger , Hedvig Kjellström , Rudolph Triebel

Recent advances in deep learning have shown that uncertainty estimation is becoming increasingly important in applications such as medical imaging, natural language processing, and autonomous systems. However, accurately quantifying…

Machine Learning · Computer Science 2023-07-04 Uddeshya Upadhyay , Jae Myung Kim , Cordelia Schmidt , Bernhard Schölkopf , Zeynep Akata

A key factor for ensuring safety in Autonomous Vehicles (AVs) is to avoid any abnormal behaviors under undesirable and unpredicted circumstances. As AVs increasingly rely on Deep Neural Networks (DNNs) to perform safety-critical tasks,…

Machine Learning · Computer Science 2020-07-03 Fabio Arnez , Huascar Espinoza , Ansgar Radermacher , François Terrier

Inference accuracy of deep neural networks (DNNs) is a crucial performance metric, but can vary greatly in practice subject to actual test datasets and is typically unknown due to the lack of ground truth labels. This has raised significant…

Machine Learning · Computer Science 2020-07-06 Zhihui Shao , Jianyi Yang , Shaolei Ren

This paper studies the problem of post-hoc calibration of machine learning classifiers. We introduce the following desiderata for uncertainty calibration: (a) accuracy-preserving, (b) data-efficient, and (c) high expressive power. We show…

Machine Learning · Computer Science 2020-07-01 Jize Zhang , Bhavya Kailkhura , T. Yong-Jin Han

The recent decade has seen an enormous rise in the popularity of deep learning and neural networks. These algorithms have broken many previous records and achieved remarkable results. Their outstanding performance has significantly sped up…

Subset selection-based methods are widely used to explain deep vision models: they attribute predictions by highlighting the most influential image regions and support object-level explanations. While these methods perform well in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Madhav Gupta , Vishak Prasad C , Ganesh Ramakrishnan

With rapid adoption of deep learning in critical applications, the question of when and how much to trust these models often arises, which drives the need to quantify the inherent uncertainties. While identifying all sources that account…

Machine Learning · Statistics 2019-11-22 Jayaraman J. Thiagarajan , Bindya Venkatesh , Prasanna Sattigeri , Peer-Timo Bremer

In this paper, we study the post-hoc calibration of modern neural networks, a problem that has drawn a lot of attention in recent years. Many calibration methods of varying complexity have been proposed for the task, but there is no…

Machine Learning · Computer Science 2022-08-02 Sergio A. Balanya , Juan Maroñas , Daniel Ramos

Deep Neural Networks (DNNs) have achieved state-of-the-art accuracy performance in many tasks. However, recent works have pointed out that the outputs provided by these models are not well-calibrated, seriously limiting their use in…

Machine Learning · Computer Science 2020-07-16 Juan Maroñas , Roberto Paredes , Daniel Ramos