English
Related papers

Related papers: When in Doubt: Neural Non-Parametric Uncertainty Q…

200 papers

Deep neural networks(NNs) have achieved impressive performance, often exceed human performance on many computer vision tasks. However, one of the most challenging issues that still remains is that NNs are overconfident in their predictions,…

Machine Learning · Computer Science 2019-12-30 Chanwoo Park , Jae Myung Kim , Seok Hyeon Ha , Jungwoo Lee

While deep neural networks (DNNs) are used for prediction, inference on DNN-estimated subject-specific means for categorical or exponential family outcomes remains underexplored. We address this by proposing a DNN estimator under…

Machine Learning · Statistics 2026-03-18 Xuran Meng , Yi Li

Modern deep models for summarization attains impressive benchmark performance, but they are prone to generating miscalibrated predictive uncertainty. This means that they assign high confidence to low-quality predictions, leading to…

Computation and Language · Computer Science 2023-04-19 Polina Zablotskaia , Du Phan , Joshua Maynez , Shashi Narayan , Jie Ren , Jeremiah Liu

Estimating how uncertain an AI system is in its predictions is important to improve the safety of such systems. Uncertainty in predictive can result from uncertainty in model parameters, irreducible data uncertainty and uncertainty due to…

Machine Learning · Statistics 2018-12-03 Andrey Malinin , Mark Gales

Extended Kalman Filtering (EKF) can be used to propagate and quantify input uncertainty through a Deep Neural Network (DNN) assuming mild hypotheses on the input distribution. This methodology yields results comparable to existing methods…

Machine Learning · Computer Science 2018-09-18 Jessica S. Titensky , Hayden Jananthan , Jeremy Kepner

Probabilistic forecasts are essential for various downstream applications such as business development, traffic planning, and electrical grid balancing. Many of these probabilistic forecasts are performed on time series data that contain…

Machine Learning · Computer Science 2023-02-07 Benedikt Heidrich , Kaleb Phipps , Oliver Neumann , Marian Turowski , Ralf Mikut , Veit Hagenmeyer

Estimating the uncertainty in deep neural network predictions is crucial for many real-world applications. A common approach to model uncertainty is to choose a parametric distribution and fit the data to it using maximum likelihood…

Machine Learning · Computer Science 2022-11-28 Ali Harakeh , Jordan Hu , Naiqing Guan , Steven L. Waslander , Liam Paull

Effective quantification of uncertainty is an essential and still missing step towards a greater adoption of deep-learning approaches in different applications, including mission-critical ones. In particular, investigations on the…

Machine Learning · Computer Science 2023-04-14 Marco Forgione , Dario Piga

Uncertainty quantification has become an important factor in understanding the data representations produced by Graph Neural Networks (GNNs). Despite their predictive capabilities being ever useful across industrial workspaces, the inherent…

Artificial Intelligence · Computer Science 2026-05-13 Tommy Woodley , Shireen Kudukkil Manchingal , Matteo Tolloso , Davide Bacciu , Fabio Cuzzolin

Uncertainty quantification (UQ) is important for reliability assessment and enhancement of machine learning models. In deep learning, uncertainties arise not only from data, but also from the training procedure that often injects…

Machine Learning · Statistics 2023-11-13 Ziyi Huang , Henry Lam , Haofeng Zhang

Recurrent neural network based solutions are increasingly being used in the analysis of longitudinal Electronic Health Record data. However, most works focus on prediction accuracy and neglect prediction uncertainty. We propose Deep Kernel…

Machine Learning · Computer Science 2021-07-27 Zhiliang Wu , Yinchong Yang , Peter A. Fasching , Volker Tresp

We present a simple comparative framework for testing and developing uncertainty modeling in uncertain marching cubes implementations. The selection of a model to represent the probability distribution of uncertain values directly…

Human-Computer Interaction · Computer Science 2024-09-16 Robert Sisneros , Tushar M. Athawale , David Pugmire , Kenneth Moreland

Epidemic forecasting tools embrace the stochasticity and heterogeneity of disease spread to predict the growth and size of outbreaks. Conceptually, stochasticity and heterogeneity are often modeled as branching processes or as percolation…

Populations and Evolution · Quantitative Biology 2025-07-08 Mariah C. Boudreau , William H. W. Thompson , Christopher M. Danforth , Jean-Gabriel Young , Laurent Hébert-Dufresne

Uncertainty can be classified as either aleatoric (intrinsic randomness) or epistemic (imperfect knowledge of parameters). The majority of frameworks assessing infectious disease risk consider only epistemic uncertainty. We only ever…

The belief function approach to uncertainty quantification as proposed in the Demspter-Shafer theory of evidence is established upon the general mathematical models for set-valued observations, called random sets. Set-valued predictions are…

Machine Learning · Computer Science 2022-06-16 Shireen Kudukkil Manchingal , Fabio Cuzzolin

Existing deep learning approaches for travel mode choice modeling fail to inform modelers about their prediction uncertainty. Even when facing scenarios that are out of the distribution of training data, which implies high prediction…

Machine Learning · Computer Science 2024-06-18 Shuwen Zheng , Zhou Fang , Liang Zhao

Understanding the uncertainty of a neural network's (NN) predictions is essential for many purposes. The Bayesian framework provides a principled approach to this, however applying it to NNs is challenging due to large numbers of parameters…

Machine Learning · Statistics 2020-02-27 Tim Pearce , Felix Leibfried , Alexandra Brintrup , Mohamed Zaki , Andy Neely

Estimating and disentangling epistemic uncertainty, uncertainty that is reducible with more training data, and aleatoric uncertainty, uncertainty that is inherent to the task at hand, is critically important when applying machine learning…

Machine Learning · Computer Science 2024-11-08 Matthew A. Chan , Maria J. Molina , Christopher A. Metzler

Uncertainty quantification (UQ) methods play an important role in reducing errors in weather forecasting. Conventional approaches in UQ for weather forecasting rely on generating an ensemble of forecasts from physics-based simulations to…

Machine Learning · Computer Science 2024-12-19 Ayush Khot , Xihaier Luo , Ai Kagawa , Shinjae Yoo

Quantifying uncertainty is important for actionable predictions in real-world applications. A crucial part of predictive uncertainty quantification is the estimation of epistemic uncertainty, which is defined as an integral of the product…

Machine Learning · Computer Science 2023-10-25 Kajetan Schweighofer , Lukas Aichberger , Mykyta Ielanskyi , Günter Klambauer , Sepp Hochreiter