English
Related papers

Related papers: Uncertainty Estimation using Variance-Gated Distri…

200 papers

Neural networks make accurate predictions but often fail to provide reliable uncertainty estimates, especially under covariate distribution shifts between training and testing. To address this problem, we propose a Bayesian framework for…

Machine Learning · Statistics 2025-12-22 Yuli Slavutsky , David M. Blei

Model uncertainty quantification involves measuring and evaluating the uncertainty linked to a model's predictions, helping assess their reliability and confidence. Noise injection is a technique used to enhance the robustness of neural…

Machine Learning · Statistics 2025-04-25 Xueqiong Yuan , Jipeng Li , Ercan Engin Kuruoglu

Ensemble learning is a standard approach to building machine learning systems that capture complex phenomena in real-world data. An important aspect of these systems is the complete and valid quantification of model uncertainty. We…

Machine Learning · Computer Science 2019-11-12 Jeremiah Zhe Liu , John Paisley , Marianthi-Anna Kioumourtzoglou , Brent Coull

Understanding and quantifying uncertainty in black box Neural Networks (NNs) is critical when deployed in real-world settings such as healthcare. Recent works using Bayesian and non-Bayesian methods have shown how a unified predictive…

Machine Learning · Computer Science 2020-09-29 Utkarsh Sarawgi , Wazeer Zulfikar , Rishab Khincha , Pattie Maes

Uncertainty estimation is essential to make neural networks trustworthy in real-world applications. Extensive research efforts have been made to quantify and reduce predictive uncertainty. However, most existing works are designed for…

Machine Learning · Computer Science 2022-10-07 Myong Chol Jung , He Zhao , Joanna Dipnall , Belinda Gabbe , Lan Du

Bayesian inference can quantify uncertainty in the predictions of neural networks using posterior distributions for model parameters and network output. By looking at these posterior distributions, one can separate the origin of uncertainty…

Machine Learning · Computer Science 2023-11-23 H. Linander , O. Balabanov , H. Yang , B. Mehlig

Reliable estimation of predictive uncertainty is crucial for machine learning applications, particularly in high-stakes scenarios where hedging against risks is essential. Despite its significance, there is no universal agreement on how to…

Machine Learning · Computer Science 2025-06-17 Kajetan Schweighofer , Lukas Aichberger , Mykyta Ielanskyi , Sepp Hochreiter

Explainability and uncertainty quantification are key to trustable artificial intelligence. However, the reasoning behind uncertainty estimates is generally left unexplained. Identifying the drivers of uncertainty complements explanations…

Machine Learning · Computer Science 2025-05-13 Pascal Iversen , Simon Witzke , Katharina Baum , Bernhard Y. Renard

Uncertainty Quantification (UQ) is essential in probabilistic machine learning models, particularly for assessing the reliability of predictions. In this paper, we present a systematic framework for estimating both epistemic and aleatoric…

Machine Learning · Statistics 2025-09-11 Marzieh Ajirak , Anand Ravishankar , Petar M. Djuric

Probabilistic regression models the entire predictive distribution of a response variable, offering richer insights than classical point estimates and directly allowing for uncertainty quantification. While diffusion-based generative models…

Machine Learning · Computer Science 2025-10-07 Carlo Kneissl , Christopher Bülte , Philipp Scholl , Gitta Kutyniok

We address the problem of uncertainty quantification and propose measures of total, aleatoric, and epistemic uncertainty based on a known decomposition of (strictly) proper scoring rules, a specific type of loss function, into a divergence…

Machine Learning · Computer Science 2025-05-29 Paul Hofman , Yusuf Sale , Eyke Hüllermeier

Neural networks predictions are unreliable when the input sample is out of the training distribution or corrupted by noise. Being able to detect such failures automatically is fundamental to integrate deep learning algorithms into robotics.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Antonio Loquercio , Mattia Segù , Davide Scaramuzza

This paper introduces a novel Bayesian approach to detect changes in the variance of a Gaussian sequence model, focusing on quantifying the uncertainty in the change point locations and providing a scalable algorithm for inference. Such a…

Methodology · Statistics 2025-03-04 Lorenzo Cappello , Oscar Hernan Madrid Padilla

We consider the problem of uncertainty estimation in the context of (non-Bayesian) deep neural classification. In this context, all known methods are based on extracting uncertainty signals from a trained network optimized to solve the…

Machine Learning · Computer Science 2019-04-25 Yonatan Geifman , Guy Uziel , Ran El-Yaniv

In this study, we explore in depth a few under-studied topics at the intersection of uncertainty estimation and segmentation. Prior work has shown that the quality of uncertainty estimates can be very sensitive to a range of variables. As…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Michael Smith , Frank P. Ferrie

Existing uncertainty modeling approaches try to detect an out-of-distribution point from the in-distribution dataset. We extend this argument to detect finer-grained uncertainty that distinguishes between (a). certain points, (b). uncertain…

Machine Learning · Computer Science 2020-02-12 Rahul Soni , Naresh Shah , Jimmy D. Moore

We introduce a novel uncertainty estimation for classification tasks for Bayesian convolutional neural networks with variational inference. By normalizing the output of a Softplus function in the final layer, we estimate aleatoric and…

Machine Learning · Computer Science 2019-05-15 Kumar Shridhar , Felix Laumann , Marcus Liwicki

Graph Neural Networks (GNNs) have shown remarkable performance in the healthcare domain. However, what remained challenging is quantifying the predictive uncertainty of GNNs, which is an important aspect of trustworthiness in clinical…

Machine Learning · Computer Science 2025-08-28 Hirad Daneshvar , Reza Samavi

We address the problem of uncertainty quantification for graph-structured data, or, more specifically, the problem to quantify the predictive uncertainty in (semi-supervised) node classification. Key questions in this regard concern the…

Machine Learning · Computer Science 2024-06-07 Clemens Damke , Eyke Hüllermeier

In this article a novel approach for training deep neural networks using Bayesian techniques is presented. The Bayesian methodology allows for an easy evaluation of model uncertainty and additionally is robust to overfitting. These are…

Machine Learning · Computer Science 2019-04-03 Konstantin Posch , Jürgen Pilz