English
Related papers

Related papers: DEUP: Direct Epistemic Uncertainty Prediction

200 papers

Bayesian model comparison (BMC) offers a principled probabilistic approach to study and rank competing models. In standard BMC, we construct a discrete probability distribution over the set of possible models, conditional on the observed…

Machine Learning · Statistics 2023-02-22 Marvin Schmitt , Stefan T. Radev , Paul-Christian Bürkner

Evidential Deep Learning (EDL) is a popular framework for uncertainty-aware classification that models predictive uncertainty via Dirichlet distributions parameterized by neural networks. Despite its popularity, its theoretical foundations…

Machine Learning · Statistics 2026-02-03 Pietro Carlotti , Nevena Gligić , Arya Farahi

When the cost of misclassifying a sample is high, it is useful to have an accurate estimate of uncertainty in the prediction for that sample. There are also multiple types of uncertainty which are best estimated in different ways, for…

Machine Learning · Computer Science 2019-03-18 Richard Harang , Ethan M. Rudd

Credal sets, i.e., closed convex sets of probability measures, provide a natural framework to represent aleatoric and epistemic uncertainty in machine learning. Yet how to quantify these two types of uncertainty for a given credal set,…

In this article a novel approach for training deep neural networks using Bayesian techniques is presented. The Bayesian methodology allows for an easy evaluation of model uncertainty and additionally is robust to overfitting. These are…

Machine Learning · Computer Science 2019-04-03 Konstantin Posch , Jürgen Pilz

Reliable uncertainty estimation has become a crucial requirement for the industrial deployment of deep learning algorithms, particularly in high-risk applications such as autonomous driving and medical diagnosis. However, mainstream…

Machine Learning · Computer Science 2024-09-10 Junyu Gao , Mengyuan Chen , Liangyu Xiang , Changsheng Xu

The ability to acknowledge the inevitable uncertainty in their knowledge and reasoning is a prerequisite for AI systems to be truly truthful and reliable. In this paper, we present a taxonomy of uncertainty specific to vision-language AI…

Artificial Intelligence · Computer Science 2024-07-03 Khyathi Raghavi Chandu , Linjie Li , Anas Awadalla , Ximing Lu , Jae Sung Park , Jack Hessel , Lijuan Wang , Yejin Choi

Uncertainty estimation bears the potential to make deep learning (DL) systems more reliable. Standard techniques for uncertainty estimation, however, come along with specific combinations of strengths and weaknesses, e.g., with respect to…

Machine Learning · Computer Science 2022-05-02 Joachim Sicking , Maram Akila , Jan David Schneider , Fabian Hüger , Peter Schlicht , Tim Wirtz , Stefan Wrobel

Uncertainty quantification in inverse medical imaging tasks with deep learning has received little attention. However, deep models trained on large data sets tend to hallucinate and create artifacts in the reconstructed output that are not…

Image and Video Processing · Electrical Eng. & Systems 2020-08-21 Max-Heinrich Laves , Malte Tölle , Tobias Ortmaier

We present a novel approach to uncertainty quantification in classification tasks based on label-wise decomposition of uncertainty measures. This label-wise perspective allows uncertainty to be quantified at the individual class level,…

Machine Learning · Computer Science 2024-06-05 Yusuf Sale , Paul Hofman , Timo Löhr , Lisa Wimmer , Thomas Nagler , Eyke Hüllermeier

There is a significant need for principled uncertainty reasoning in machine learning systems as they are increasingly deployed in safety-critical domains. A new approach with uncertainty-aware regression-based neural networks (NNs), based…

Machine Learning · Computer Science 2023-07-21 Nis Meinert , Jakob Gawlikowski , Alexander Lavin

Automatic classification of diabetic retinopathy from retinal images has been widely studied using deep neural networks with impressive results. However, there is a clinical need for estimation of the uncertainty in the classifications, a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-03 Joel Jaskari , Jaakko Sahlsten , Theodoros Damoulas , Jeremias Knoblauch , Simo Särkkä , Leo Kärkkäinen , Kustaa Hietala , Kimmo Kaski

The problem of machine learning with missing values is common in many areas. A simple approach is to first construct a dataset without missing values simply by discarding instances with missing entries or by imputing a fixed value for each…

Machine Learning · Statistics 2018-03-02 Hiroyuki Hanada , Toshiyuki Takada , Jun Sakuma , Ichiro Takeuchi

Past research on pedestrian trajectory forecasting mainly focused on deterministic predictions which provide only point estimates of future states. These future estimates can help an autonomous vehicle plan its trajectory and avoid…

Machine Learning · Computer Science 2023-01-16 Anshul Nayak , Azim Eskandarian , Zachary Doerzaph

Automating chest radiograph interpretation using Deep Learning (DL) models has the potential to significantly improve clinical workflows, decision-making, and large-scale health screening. However, in medical settings, merely optimising…

Computation and Language · Computer Science 2025-05-08 Gianluca Manzo , Julia Ive

Uncertainty quantification is critical for deploying deep neural networks (DNNs) in real-world applications. An Auxiliary Uncertainty Estimator (AuxUE) is one of the most effective means to estimate the uncertainty of the main task…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Xuanlong Yu , Gianni Franchi , Jindong Gu , Emanuel Aldea

Existing methods for estimating uncertainty in deep learning tend to require multiple forward passes, making them unsuitable for applications where computational resources are limited. To solve this, we perform probabilistic reasoning over…

Machine Learning · Statistics 2020-12-08 Javier Antorán , James Urquhart Allingham , José Miguel Hernández-Lobato

This paper deals with uncertainty quantification and out-of-distribution detection in deep learning using Bayesian and ensemble methods. It proposes a practical solution to the lack of prediction diversity observed recently for standard…

Machine Learning · Computer Science 2025-02-03 Antoine de Mathelin , François Deheeger , Mathilde Mougeot , Nicolas Vayatis

This work introduces an efficient novel approach for epistemic uncertainty estimation for ensemble models for regression tasks using pairwise-distance estimators (PaiDEs). Utilizing the pairwise-distance between model components, these…

Machine Learning · Computer Science 2025-09-29 Lucas Berry , David Meger

Deep neural networks are often ignorant about what they do not know and overconfident when they make uninformed predictions. Some recent approaches quantify classification uncertainty directly by training the model to output high…

Machine Learning · Computer Science 2020-06-09 Murat Sensoy , Lance Kaplan , Federico Cerutti , Maryam Saleki