English
Related papers

Related papers: Quantifying Epistemic Uncertainty in Deep Learning

200 papers

An in-depth understanding of uncertainty is the first step to making effective decisions under uncertainty. Deep/machine learning (ML/DL) has been hugely leveraged to solve complex problems involved with processing high-dimensional data.…

Artificial Intelligence · Computer Science 2022-06-15 Zhen Guo , Zelin Wan , Qisheng Zhang , Xujiang Zhao , Feng Chen , Jin-Hee Cho , Qi Zhang , Lance M. Kaplan , Dong H. Jeong , Audun Jøsang

Reliable uncertainty quantification is essential for the use of machine learning in physics, where scientific discoveries depend on validated probabilistic statements. We provide a structured overview of uncertainty quantification in ML for…

Machine Learning · Statistics 2026-05-12 Manuel Haußmann , Ramon Winterhalder , Maria Ubiali

Quantitative characterizations and estimations of uncertainty are of fundamental importance in optimization and decision-making processes. Herein, we propose intuitive scores, which we call certainty and doubt, that can be used in both a…

Uncertainty quantification (UQ) is important for reliability assessment and enhancement of machine learning models. In deep learning, uncertainties arise not only from data, but also from the training procedure that often injects…

Machine Learning · Statistics 2023-11-13 Ziyi Huang , Henry Lam , Haofeng Zhang

Deep learning (DL) has shown great potential in medical image enhancement problems, such as super-resolution or image synthesis. However, to date, little consideration has been given to uncertainty quantification over the output image. Here…

Uncertainty in machine learning is not generally taught as general knowledge in Machine Learning course curricula. In this paper we propose a short curriculum for a course about uncertainty in machine learning, and complement the course…

Machine Learning · Computer Science 2021-08-20 Matias Valdenegro-Toro

Uncertainty plays a crucial role in the machine learning field. Both model trustworthiness and performance require the understanding of uncertainty, especially for models used in high-stake applications where errors can cause cataclysmic…

Machine Learning · Computer Science 2022-11-29 Shuo Chen

This paper questions the effectiveness of a modern predictive uncertainty quantification approach, called \emph{evidential deep learning} (EDL), in which a single neural network model is trained to learn a meta distribution over the…

Machine Learning · Computer Science 2024-11-04 Maohao Shen , J. Jon Ryu , Soumya Ghosh , Yuheng Bu , Prasanna Sattigeri , Subhro Das , Gregory W. Wornell

Epistemic uncertainty is crucial for safety-critical applications and data acquisition tasks. Yet, we find an important phenomenon in deep learning models: an epistemic uncertainty collapse as model complexity increases, challenging the…

Machine Learning · Computer Science 2025-05-27 Andreas Kirsch

Uncertainty-quantification methods are applied to estimate the confidence of deep-neural-networks classifiers over their predictions. However, most widely used methods are known to be overconfident. We address this problem by developing an…

Machine Learning · Computer Science 2023-05-19 Luigi Sbailò , Luca M. Ghiringhelli

Uncertainty Quantification (UQ) research has primarily focused on closed-book factual question answering (QA), while contextual QA remains unexplored, despite its importance in real-world applications. In this work, we focus on UQ for the…

Deep Neural Networks (DNNs) have demonstrated remarkable performance across various domains, including computer vision and natural language processing. However, they often struggle to accurately quantify the uncertainty of their…

Machine Learning · Computer Science 2025-11-14 Adrien Lafage , Olivier Laurent , Firas Gabetni , Gianni Franchi

Deep learning based methods for automatic organ segmentation have shown promise in aiding diagnosis and treatment planning. However, quantifying and understanding the uncertainty associated with model predictions is crucial in critical…

Image and Video Processing · Electrical Eng. & Systems 2023-08-16 Jadie Adams , Shireen Y. Elhabian

Much of uncertainty quantification to date has focused on determining the effect of variables modeled probabilistically, and with a known distribution, on some physical or engineering system. We develop methods to obtain information on the…

Numerical Analysis · Mathematics 2015-03-19 Kamaljit Chowdhary , Paul Dupuis

Data-driven forecasts of air quality have recently achieved more accurate short-term predictions. Despite their success, most of the current data-driven solutions lack proper quantifications of model uncertainty that communicate how much to…

Machine Learning · Computer Science 2021-12-07 Abdulmajid Murad , Frank Alexander Kraemer , Kerstin Bach , Gavin Taylor

Bayesian inference is often utilized for uncertainty quantification tasks. A recent analysis by Xu and Raginsky 2022 rigorously decomposed the predictive uncertainty in Bayesian inference into two uncertainties, called aleatoric and…

Machine Learning · Statistics 2023-07-25 Futoshi Futami , Tomoharu Iwata

Uncertainty and confidence have been shown to be useful metrics in a wide variety of techniques proposed for deep learning testing, including test data selection and system supervision.We present uncertainty-wizard, a tool that allows to…

Machine Learning · Computer Science 2021-01-29 Michael Weiss , Paolo Tonella

Statistical learning algorithms provide a generally-applicable framework to sidestep time-consuming experiments, or accurate physics-based modeling, but they introduce a further source of error on top of the intrinsic limitations of the…

Chemical Physics · Physics 2024-05-17 Matthias Kellner , Michele Ceriotti

Uncertainty quantification (UQ) is crucial in machine learning, yet most (axiomatic) studies of uncertainty measures focus on classification, leaving a gap in regression settings with limited formal justification and evaluations. In this…

Machine Learning · Computer Science 2025-05-19 Christopher Bülte , Yusuf Sale , Timo Löhr , Paul Hofman , Gitta Kutyniok , Eyke Hüllermeier

Uncertainty quantification is a key pillar of trustworthy machine learning. It enables safe reactions under unsafe inputs, like predicting only when the machine learning model detects sufficient evidence, discarding anomalous data, or…

Machine Learning · Computer Science 2024-08-27 Michael Kirchhof