English
Related papers

Related papers: Experimental Comparison of Classification Uncertai…

200 papers

Deep learning models struggle with uncertainty estimation. Many approaches are either computationally infeasible or underestimate uncertainty. We investigate \textit{BatchEnsemble} as a general and scalable method for uncertainty estimation…

Machine Learning · Computer Science 2026-01-30 Morten Blørstad , Herman Jangsett Mostein , Nello Blaser , Pekka Parviainen

This study evaluated the probability and uncertainty forecasts of five recently proposed Bayesian deep learning methods relative to a deterministic residual neural network (ResNet) baseline for 0-1 h convective initiation (CI) nowcasting…

Atmospheric and Oceanic Physics · Physics 2025-07-23 Da Fan , David John Gagne , Steven J. Greybush , Eugene E. Clothiaux , John S. Schreck , Chaopeng Shen

We evaluate two different methods for the integration of prediction uncertainty into diagnostic image classifiers to increase patient safety in deep learning. In the first method, Monte Carlo sampling is applied with dropout at test time to…

Image and Video Processing · Electrical Eng. & Systems 2019-08-05 Max-Heinrich Laves , Sontje Ihler , Tobias Ortmaier

We establish the first mathematically rigorous link between Bayesian, variational Bayesian, and ensemble methods. A key step towards this it to reformulate the non-convex optimisation problem typically encountered in deep learning as a…

Machine Learning · Statistics 2023-10-24 Veit David Wild , Sahra Ghalebikesabi , Dino Sejdinovic , Jeremias Knoblauch

Deep neural networks(NNs) have achieved impressive performance, often exceed human performance on many computer vision tasks. However, one of the most challenging issues that still remains is that NNs are overconfident in their predictions,…

Machine Learning · Computer Science 2019-12-30 Chanwoo Park , Jae Myung Kim , Seok Hyeon Ha , Jungwoo Lee

Weather forecasting is fundamentally challenged by the chaotic nature of the atmosphere, necessitating probabilistic approaches to quantify uncertainty. While traditional ensemble prediction (EPS) addresses this through computationally…

Machine Learning · Computer Science 2025-11-19 Xinlei Xiong , Wenbo Hu , Shuxun Zhou , Kaifeng Bi , Lingxi Xie , Ying Liu , Richang Hong , Qi Tian

Recent deep learning approaches focus on improving quantitative scores of dedicated benchmarks, and therefore only reduce the observation-related (aleatoric) uncertainty. However, the model-immanent (epistemic) uncertainty is less…

Image and Video Processing · Electrical Eng. & Systems 2021-10-25 Dominik Narnhofer , Alexander Effland , Erich Kobler , Kerstin Hammernik , Florian Knoll , Thomas Pock

In this research work, probabilistic decision-making approaches are studied, e.g. Bayesian and Boltzmann strategies, along with various deterministic exploration strategies, e.g. greedy, epsilon-Greedy and random approaches. In this…

Artificial Intelligence · Computer Science 2019-06-04 Arsh Javed Rehman , Pradeep Tomar

Deep neural networks lack interpretability and tend to be overconfident, which poses a serious problem in safety-critical applications like autonomous driving, medical imaging, or machine vision tasks with high demands on reliability.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Steven Landgraf , Kira Wursthorn , Markus Hillemann , Markus Ulrich

Understanding how different classes are distributed in an unlabeled data set is an important challenge for the calibration of probabilistic classifiers and uncertainty quantification. Approaches like adjusted classify and count, black-box…

Machine Learning · Statistics 2024-06-19 Albert Ziegler , Paweł Czyż

Despite the huge success of deep neural networks (NNs), finding good mechanisms for quantifying their prediction uncertainty is still an open problem. Bayesian neural networks are one of the most popular approaches to uncertainty…

Machine Learning · Statistics 2020-01-01 Agustinus Kristiadi , Sina Däubener , Asja Fischer

Uncertainty quantification is a critical aspect of reinforcement learning and deep learning, with numerous applications ranging from efficient exploration and stable offline reinforcement learning to outlier detection in medical…

Machine Learning · Computer Science 2025-03-27 Moritz A. Zanger , Pascal R. Van der Vaart , Wendelin Böhmer , Matthijs T. J. Spaan

In model-free deep reinforcement learning (RL) algorithms, using noisy value estimates to supervise policy evaluation and optimization is detrimental to the sample efficiency. As this noise is heteroscedastic, its effects can be mitigated…

Machine Learning · Computer Science 2022-05-04 Vincent Mai , Kaustubh Mani , Liam Paull

Deep neural network ensembles are powerful tools for uncertainty quantification, which have recently been re-interpreted from a Bayesian perspective. However, current methods inadequately leverage second-order information of the loss…

Machine Learning · Statistics 2024-11-05 Klemens Flöge , Mohammed Abdul Moeed , Vincent Fortuin

Ensembling neural networks is an effective way to increase accuracy, and can often match the performance of individual larger models. This observation poses a natural question: given the choice between a deep ensemble and a single neural…

Machine Learning · Computer Science 2022-10-14 Taiga Abe , E. Kelly Buchanan , Geoff Pleiss , Richard Zemel , John P. Cunningham

Bayesian clustering methods have the widely touted advantage of providing a probabilistic characterization of uncertainty in clustering through the posterior distribution. An amazing variety of priors and likelihoods have been proposed for…

Methodology · Statistics 2025-11-21 Garritt L. Page , Andrés F. Barrientos , David B. Dahl , David B. Dunson

Traditional deep neural nets (NNs) have shown the state-of-the-art performance in the task of classification in various applications. However, NNs have not considered any types of uncertainty associated with the class probabilities to…

Machine Learning · Computer Science 2019-10-16 Xujiang Zhao , Yuzhe Ou , Lance Kaplan , Feng Chen , Jin-Hee Cho

A method for conducting Bayesian elicitation and learning in risk assessment is presented. It assumes that the risk process can be described as a fault tree. This is viewed as a belief network, for which prior distributions on primary event…

Methodology · Statistics 2019-04-08 Cristina De Persis , Jose Luis Bosque , Irene Huertas , Simon Paul Wilson

In recent times, neural networks have become a powerful tool for the analysis of complex and abstract data models. However, their introduction intrinsically increases our uncertainty about which features of the analysis are model-related…

Machine Learning · Statistics 2020-11-09 Tom Charnock , Laurence Perreault-Levasseur , François Lanusse

Tree-based models are used in many high-stakes application domains such as finance and medicine, where robustness and interpretability are of utmost importance. Yet, methods for improving and certifying their robustness are severely…

Machine Learning · Computer Science 2022-11-16 Miklós Z. Horváth , Mark Niklas Müller , Marc Fischer , Martin Vechev