English
Related papers

Related papers: Evaluating Prediction Uncertainty Estimates from B…

200 papers

Recurrent neural network based solutions are increasingly being used in the analysis of longitudinal Electronic Health Record data. However, most works focus on prediction accuracy and neglect prediction uncertainty. We propose Deep Kernel…

Machine Learning · Computer Science 2021-07-27 Zhiliang Wu , Yinchong Yang , Peter A. Fasching , Volker Tresp

Deep ensembles can be considered as the current state-of-the-art for uncertainty quantification in deep learning. While the approach was originally proposed as a non-Bayesian technique, arguments supporting its Bayesian footing have been…

Machine Learning · Computer Science 2021-11-19 Lara Hoffmann , Clemens Elster

Monte Carlo (MC) dropout is a simple and efficient ensembling method that can improve the accuracy and confidence calibration of high-capacity deep neural network models. However, MC dropout is not as effective as more compute-intensive…

Machine Learning · Computer Science 2021-06-10 Zhilu Zhang , Vianne R. Gao , Mert R. Sabuncu

Dirichlet-based uncertainty (DBU) models are a recent and promising class of uncertainty-aware models. DBU models predict the parameters of a Dirichlet distribution to provide fast, high-quality uncertainty estimates alongside with class…

Machine Learning · Computer Science 2021-06-14 Anna-Kathrin Kopetzki , Bertrand Charpentier , Daniel Zügner , Sandhya Giri , Stephan Günnemann

Understanding and quantifying uncertainty in black box Neural Networks (NNs) is critical when deployed in real-world settings such as healthcare. Recent works using Bayesian and non-Bayesian methods have shown how a unified predictive…

Machine Learning · Computer Science 2020-09-29 Utkarsh Sarawgi , Wazeer Zulfikar , Rishab Khincha , Pattie Maes

Uncertainty quantification in automated image analysis is highly desired in many applications. Typically, machine learning models in classification or segmentation are only developed to provide binary answers; however, quantifying the…

Real-world time series data often exhibits substantial missing values, posing challenges for advanced analysis. A common approach to addressing this issue is imputation, where the primary challenge lies in determining the appropriate values…

Machine Learning · Computer Science 2025-12-02 Ying Liu , Peng Cui , Wenbo Hu , Richang Hong

Uncertainty quantification in a neural network is one of the most discussed topics for safety-critical applications. Though Neural Networks (NNs) have achieved state-of-the-art performance for many applications, they still provide…

Machine Learning · Computer Science 2022-05-09 Mehedi Hasan , Abbas Khosravi , Ibrahim Hossain , Ashikur Rahman , Saeid Nahavandi

Deep learning has emerged as a promising paradigm to give access to highly accurate predictions of molecular and materials properties. A common short-coming shared by current approaches, however, is that neural networks only give point…

Computational Physics · Physics 2023-05-10 Albert Zhu , Simon Batzner , Albert Musaelian , Boris Kozinsky

Deep neural networks (NNs) are powerful black box predictors that have recently achieved impressive performance on a wide spectrum of tasks. Quantifying predictive uncertainty in NNs is a challenging and yet unsolved problem. Bayesian NNs,…

Machine Learning · Statistics 2017-11-07 Balaji Lakshminarayanan , Alexander Pritzel , Charles Blundell

Ensemble learning is a standard approach to building machine learning systems that capture complex phenomena in real-world data. An important aspect of these systems is the complete and valid quantification of model uncertainty. We…

Machine Learning · Computer Science 2019-11-12 Jeremiah Zhe Liu , John Paisley , Marianthi-Anna Kioumourtzoglou , Brent Coull

Among the various options to estimate uncertainty in deep neural networks, Monte-Carlo dropout is widely popular for its simplicity and effectiveness. However the quality of the uncertainty estimated through this method varies and choices…

Machine Learning · Computer Science 2021-07-14 Francesco Verdoja , Ville Kyrki

Deep learning (DL) has shown great potential in digital pathology applications. The robustness of a diagnostic DL-based solution is essential for safe clinical deployment. In this work we evaluate if adding uncertainty estimates for DL…

Machine Learning · Computer Science 2022-05-23 Milda Pocevičiūtė , Gabriel Eilertsen , Sofia Jarkman , Claes Lundström

Modern deep models for summarization attains impressive benchmark performance, but they are prone to generating miscalibrated predictive uncertainty. This means that they assign high confidence to low-quality predictions, leading to…

Computation and Language · Computer Science 2023-04-19 Polina Zablotskaia , Du Phan , Joshua Maynez , Shashi Narayan , Jie Ren , Jeremiah Liu

In this study, we explore in depth a few under-studied topics at the intersection of uncertainty estimation and segmentation. Prior work has shown that the quality of uncertainty estimates can be very sensitive to a range of variables. As…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Michael Smith , Frank P. Ferrie

Ensembling multiple predictions is a widely used technique for improving the accuracy of various machine learning tasks. One obvious drawback of ensembling is its higher execution cost during inference. In this paper, we first describe our…

Machine Learning · Computer Science 2019-03-11 Hiroshi Inoue

With the advancements made in deep learning, computer vision problems like object detection and segmentation have seen a great improvement in performance. However, in many real-world applications such as autonomous driving vehicles, the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Kumari Deepshikha , Sai Harsha Yelleni , P. K. Srijith , C Krishna Mohan

Probabilistic prediction of sequences from images and other high-dimensional data is a key challenge, particularly in risk-sensitive applications. In these settings, it is often desirable to quantify the uncertainty associated with the…

Machine Learning · Computer Science 2024-10-31 Qidong Yang , Weicheng Zhu , Joseph Keslin , Laure Zanna , Tim G. J. Rudner , Carlos Fernandez-Granda

We present the Incremental Generative Monte Carlo (IGMC) method, designed to measure uncertainty in deep neural networks using deep generative approaches. IGMC iteratively trains generative models, adding their output to the dataset, to…

Machine Learning · Computer Science 2023-10-17 Yunsheng Zhang

Data-driven forecasts of air quality have recently achieved more accurate short-term predictions. Despite their success, most of the current data-driven solutions lack proper quantifications of model uncertainty that communicate how much to…

Machine Learning · Computer Science 2021-12-07 Abdulmajid Murad , Frank Alexander Kraemer , Kerstin Bach , Gavin Taylor