English
Related papers

Related papers: Gradient-based Uncertainty Attribution for Explain…

200 papers

Hyper-differential sensitivity analysis with respect to model discrepancy was recently developed to enable uncertainty quantification for optimization problems. The approach consists of two primary steps: (i) Bayesian calibration of the…

Numerical Analysis · Mathematics 2025-10-09 Joseph Hart , Bart van Bloemen Waanders , Jixian Li , Timbwaoga A. J. Ouermi , Chris R. Johnson

Reliable probability estimation is of crucial importance in many real-world applications where there is inherent (aleatoric) uncertainty. Probability-estimation models are trained on observed outcomes (e.g. whether it has rained or not, or…

Quantifying predictive uncertainty of neural networks has recently attracted increasing attention. In this work, we focus on measuring uncertainty of graph neural networks (GNNs) for the task of node classification. Most existing GNNs model…

Machine Learning · Computer Science 2023-04-04 Zhao Xu , Carolin Lawrence , Ammar Shaker , Raman Siarheyeu

Deterministic mathematical models, such as those specified via differential equations, are a powerful tool to communicate scientific insight. However, such models are necessarily simplified descriptions of the real world. Generalised…

Methodology · Statistics 2025-03-24 Zheyang Shen , Jeremias Knoblauch , Sam Power , Chris. J. Oates

This paper deals with uncertainty quantification and out-of-distribution detection in deep learning using Bayesian and ensemble methods. It proposes a practical solution to the lack of prediction diversity observed recently for standard…

Machine Learning · Computer Science 2025-02-03 Antoine de Mathelin , François Deheeger , Mathilde Mougeot , Nicolas Vayatis

Currently, college-going students are taking longer to graduate than their parental generations. Further, in the United States, the six-year graduation rate has been 59% for decades. Improving the educational quality by training…

Artificial Intelligence · Computer Science 2019-02-28 Qian Hu , Huzefa Rangwala

The reliability assessment of a machine learning model's prediction is an important quantity for the deployment in safety critical applications. Not only can it be used to detect novel sceneries, either as out-of-distribution or anomaly…

Machine Learning · Computer Science 2022-05-12 Steve Dias Da Cruz , Bertram Taetz , Thomas Stifter , Didier Stricker

Differential equations in general and neural ODEs in particular are an essential technique in continuous-time system identification. While many deterministic learning algorithms have been designed based on numerical integration via the…

Machine Learning · Computer Science 2021-10-18 Lenart Treven , Philippe Wenk , Florian Dörfler , Andreas Krause

Deep-learning-based data-driven forecasting methods have produced impressive results for traffic forecasting. A major limitation of these methods, however, is that they provide forecasts without estimates of uncertainty, which are critical…

Machine Learning · Computer Science 2022-04-07 Tanwi Mallick , Prasanna Balaprakash , Jane Macfarlane

Deep learning models frequently make incorrect predictions with high confidence when presented with test examples that are not well represented in their training dataset. We propose a novel and straightforward approach to estimate…

Machine Learning · Computer Science 2019-10-04 Tiago Ramalho , Miguel Miranda

Classification of high dimensional data finds wide-ranging applications. In many of these applications equipping the resulting classification with a measure of uncertainty may be as important as the classification itself. In this paper we…

Machine Learning · Computer Science 2018-02-12 Andrea L. Bertozzi , Xiyang Luo , Andrew M. Stuart , Konstantinos C. Zygalakis

There are various measures of predictive uncertainty in the literature, but their relationships to each other remain unclear. This paper uses a decomposition of statistical pointwise risk into components, associated with different sources…

Machine Learning · Statistics 2025-02-18 Nikita Kotelevskii , Vladimir Kondratyev , Martin Takáč , Éric Moulines , Maxim Panov

Bayesian inference allows machine learning models to express uncertainty. Current machine learning models use only a single learnable parameter combination when making predictions, and as a result are highly overconfident when their…

Machine Learning · Computer Science 2022-02-23 Andrew Wood , Moshik Hershcovitch , Daniel Waddington , Sarel Cohen , Peter Chin

Robustness to out-of-distribution (OOD) data is an important goal in building reliable machine learning systems. Especially in autonomous systems, wrong predictions for OOD inputs can cause safety critical situations. As a first step…

Machine Learning · Computer Science 2020-04-17 Andreas Sedlmeier , Thomas Gabor , Thomy Phan , Lenz Belzner , Claudia Linnhoff-Popien

We develop a novel deep learning method for uncertainty quantification in stochastic partial differential equations based on Bayesian neural network (BNN) and Hamiltonian Monte Carlo (HMC). A BNN efficiently learns the posterior…

Machine Learning · Statistics 2022-10-24 Jeahan Jung , Minseok Choi

Stress and material deformation field predictions are among the most important tasks in computational mechanics. These predictions are typically made by solving the governing equations of continuum mechanics using finite element analysis,…

Machine Learning · Statistics 2024-06-24 George D. Pasparakis , Lori Graham-Brady , Michael D. Shields

While neural networks have demonstrated impressive performance across various tasks, accurately quantifying uncertainty in their predictions is essential to ensure their trustworthiness and enable widespread adoption in critical systems.…

Machine Learning · Statistics 2025-11-11 Joseph Wilson , Chris van der Heide , Liam Hodgkinson , Fred Roosta

A key factor for ensuring safety in Autonomous Vehicles (AVs) is to avoid any abnormal behaviors under undesirable and unpredicted circumstances. As AVs increasingly rely on Deep Neural Networks (DNNs) to perform safety-critical tasks,…

Machine Learning · Computer Science 2020-07-03 Fabio Arnez , Huascar Espinoza , Ansgar Radermacher , François Terrier

Neural networks (NNs) lack measures of "reliability" estimation that would enable reasoning over their predictions. Despite the vital importance, especially in areas of human well-being and health, state-of-the-art uncertainty estimation…

Machine Learning · Computer Science 2021-02-12 Lorena Qendro , Jagmohan Chauhan , Alberto Gil C. P. Ramos , Cecilia Mascolo

In this work, we introduce a novel Deep Learning-based method to perceive the environment of a vehicle based on radar scans while accounting for uncertainties in its predictions. The environment of the host vehicle is segmented into equally…

Machine Learning · Computer Science 2023-06-06 Marco Braun , Moritz Luszek , Jan Siegemund , Kevin Kollek , Anton Kummert