English
Related papers

Related papers: AutoDEUQ: Automated Deep Ensemble with Uncertainty…

200 papers

The hybrid neural differentiable models mark a significant advancement in the field of scientific machine learning. These models, integrating numerical representations of known physics into deep neural networks, offer enhanced predictive…

Machine Learning · Computer Science 2024-01-02 Deepak Akhare , Tengfei Luo , Jian-Xun Wang

Uncertainty estimation in deep learning has become a leading research field in medical image analysis due to the need for safe utilisation of AI algorithms in clinical practice. Most approaches for uncertainty estimation require sampling…

Image and Video Processing · Electrical Eng. & Systems 2022-04-12 Kaisar Kushibar , Víctor Manuel Campello , Lidia Garrucho Moras , Akis Linardos , Petia Radeva , Karim Lekadir

Image classification with neural networks (NNs) is widely used in industrial processes, situations where the model likely encounters unknown objects during deployment, i.e., out-of-distribution (OOD) data. Worryingly, NNs tend to make…

Machine Learning · Computer Science 2025-01-14 Arthur Thuy , Dries F. Benoit

This work introduces a novel probabilistic deep learning technique called deep Gaussian mixture ensembles (DGMEs), which enables accurate quantification of both epistemic and aleatoric uncertainty. By assuming the data generating process…

Machine Learning · Statistics 2023-06-13 Yousef El-Laham , Niccolò Dalmasso , Elizabeth Fons , Svitlana Vyetrenko

While neural networks have demonstrated impressive performance across various tasks, accurately quantifying uncertainty in their predictions is essential to ensure their trustworthiness and enable widespread adoption in critical systems.…

Machine Learning · Statistics 2025-11-11 Joseph Wilson , Chris van der Heide , Liam Hodgkinson , Fred Roosta

For many practical, high-risk applications, it is essential to quantify uncertainty in a model's predictions to avoid costly mistakes. While predictive uncertainty is widely studied for neural networks, the topic seems to be under-explored…

Machine Learning · Computer Science 2021-04-05 Andrey Malinin , Liudmila Prokhorenkova , Aleksei Ustimenko

Deep learning has become very popular for tasks such as predictive modeling and pattern recognition in handling big data. Deep learning is a powerful machine learning method that extracts lower level features and feeds them forward for the…

Machine Learning · Computer Science 2018-03-07 Steven Young , Tamer Abdou , Ayse Bener

Graph Neural Networks (GNNs) have emerged as a prominent class of data-driven methods for molecular property prediction. However, a key limitation of typical GNN models is their inability to quantify uncertainties in the predictions. This…

Machine Learning · Computer Science 2024-07-02 Shengli Jiang , Shiyi Qin , Reid C. Van Lehn , Prasanna Balaprakash , Victor M. Zavala

Deep neural networks excel in perception tasks such as semantic segmentation and monocular depth estimation, making them indispensable in safety-critical applications like autonomous driving and industrial inspection. However, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Steven Landgraf , Markus Hillemann , Theodor Kapler , Markus Ulrich

Bayesian neural networks and deep ensembles represent two modern paradigms of uncertainty quantification in deep learning. Yet these approaches struggle to scale mainly due to memory inefficiency issues, since they require parameter storage…

Machine Learning · Statistics 2021-11-24 Hippolyt Ritter , Martin Kukla , Cheng Zhang , Yingzhen Li

The ensemble of deep neural networks has been shown, both theoretically and empirically, to improve generalization accuracy on the unseen test set. However, the high training cost hinders its efficiency since we need a sufficient number of…

Machine Learning · Computer Science 2021-12-28 Wentao Zhang , Jiawei Jiang , Yingxia Shao , Bin Cui

Deep neural networks have enhanced the performance of decision making systems in many applications including image understanding, and further gains can be achieved by constructing ensembles. However, designing an ensemble of deep networks…

Machine Learning · Computer Science 2021-11-16 Sara Atito Ali Ahmed , Cemre Zor , Berrin Yanikoglu , Muhammad Awais , Josef Kittler

The importance of accurately quantifying forecast uncertainty has motivated much recent research on probabilistic forecasting. In particular, a variety of deep learning approaches has been proposed, with forecast distributions obtained as…

Machine Learning · Statistics 2024-11-11 Benedikt Schulz , Lutz Köhler , Sebastian Lerch

Quantifying uncertainty in a model's predictions is important as it enables the safety of an AI system to be increased by acting on the model's output in an informed manner. This is crucial for applications where the cost of an error is…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Aria Khoshsirat

Neural network classifiers trained with cross-entropy loss achieve strong predictive accuracy but lack the capability to provide inherent predictive uncertainty estimates, thus requiring external techniques to obtain these estimates. In…

Machine Learning · Statistics 2026-04-08 Courtney Franzen , Farhad Pourkamali-Anaraki

Neural network ensembles have been effectively used to improve generalization by combining the predictions of multiple independently trained models. However, the growing scale and complexity of deep neural networks have led to these methods…

Machine Learning · Computer Science 2024-07-09 Tim Whitaker

Real-world time series data often exhibits substantial missing values, posing challenges for advanced analysis. A common approach to addressing this issue is imputation, where the primary challenge lies in determining the appropriate values…

Machine Learning · Computer Science 2025-12-02 Ying Liu , Peng Cui , Wenbo Hu , Richang Hong

Bayesian neural networks (BNNs) augment deep networks with uncertainty quantification by Bayesian treatment of the network weights. However, such models face the challenge of Bayesian inference in a high-dimensional and usually…

Machine Learning · Computer Science 2021-03-30 Zhijie Deng , Yucen Luo , Jun Zhu , Bo Zhang

Objective: Convolutional neural networks (CNNs) have demonstrated promise in automated cardiac magnetic resonance image segmentation. However, when using CNNs in a large real-world dataset, it is important to quantify segmentation…

Image and Video Processing · Electrical Eng. & Systems 2023-01-02 Matthew Ng , Fumin Guo , Labonny Biswas , Steffen E. Petersen , Stefan K. Piechnik , Stefan Neubauer , Graham Wright

Recently, deep learning has emerged as a promising tool for statistical downscaling, the set of methods for generating high-resolution climate fields from coarse low-resolution variables. Nevertheless, their ability to generalize to climate…

Machine Learning · Computer Science 2023-05-03 Jose González-Abad , Jorge Baño-Medina