English
Related papers

Related papers: Uncertainty Quantification for Deep Learning

200 papers

This paper proposes a fast and scalable method for uncertainty quantification of machine learning models' predictions. First, we show the principled way to measure the uncertainty of predictions for a classifier based on Nadaraya-Watson's…

While neural networks have demonstrated impressive performance across various tasks, accurately quantifying uncertainty in their predictions is essential to ensure their trustworthiness and enable widespread adoption in critical systems.…

Machine Learning · Statistics 2025-11-11 Joseph Wilson , Chris van der Heide , Liam Hodgkinson , Fred Roosta

Operator learning has been increasingly adopted in scientific and engineering applications, many of which require calibrated uncertainty quantification. Since the output of operator learning is a continuous function, quantifying uncertainty…

Machine Learning · Computer Science 2024-02-07 Ziqi Ma , Kamyar Azizzadenesheli , Anima Anandkumar

Due to their intuitive appeal, Bayesian methods of modeling and uncertainty quantification have become popular in modern machine and deep learning. When providing a prior distribution over the parameter space, it is straightforward to…

Machine Learning · Statistics 2025-06-05 Ivan Melev , Goeran Kauermann

Proper quantification of predictive uncertainty is essential for the use of machine learning in safety-critical applications. Various uncertainty measures have been proposed for this purpose, typically claiming superiority over other…

Machine Learning · Computer Science 2025-12-16 Paul Hofman , Yusuf Sale , Eyke Hüllermeier

Deep neural networks (DNNs) have made a revolution in numerous fields during the last decade. However, in tasks with high safety requirements, such as medical or autonomous driving applications, providing an assessment of the models…

Machine Learning · Computer Science 2020-11-20 Omer Achrack , Raizy Kellerman , Ouriel Barzilay

Accurate quantification of model uncertainty has long been recognized as a fundamental requirement for trusted AI. In regression tasks, uncertainty is typically quantified using prediction intervals calibrated to a specific operating point,…

Machine Learning · Computer Science 2021-06-03 Jiri Navratil , Benjamin Elder , Matthew Arnold , Soumya Ghosh , Prasanna Sattigeri

Continual learning aims to learn new tasks without forgetting previously learned ones. This is especially challenging when one cannot access data from previous tasks and when the model has a fixed capacity. Current regularization-based…

Machine Learning · Computer Science 2020-02-21 Sayna Ebrahimi , Mohamed Elhoseiny , Trevor Darrell , Marcus Rohrbach

Artificial neural networks will always make a prediction, even when completely uncertain and regardless of the consequences. This obliviousness of uncertainty is a major obstacle towards their adoption in practice. Techniques exist,…

Machine Learning · Computer Science 2021-05-13 Hans Weytjens , Jochen De Weerdt

Deep neural networks are increasingly being used for the analysis of medical images. However, most works neglect the uncertainty in the model's prediction. We propose an uncertainty-aware deep kernel learning model which permits the…

Machine Learning · Computer Science 2021-06-11 Zhiliang Wu , Yinchong Yang , Jindong Gu , Volker Tresp

In this work, we introduce a novel Deep Learning-based method to perceive the environment of a vehicle based on radar scans while accounting for uncertainties in its predictions. The environment of the host vehicle is segmented into equally…

Machine Learning · Computer Science 2023-06-06 Marco Braun , Moritz Luszek , Jan Siegemund , Kevin Kollek , Anton Kummert

Uncertainty quantification in deep learning is crucial for safe and reliable decision-making in downstream tasks. Existing methods quantify uncertainty at the last layer or other approximations of the network which may miss some sources of…

Machine Learning · Statistics 2025-04-25 James McInerney , Nathan Kallus

With the wide development of black-box machine learning algorithms, particularly deep neural network (DNN), the practical demand for the reliability assessment is rapidly rising. On the basis of the concept that `Bayesian deep learning…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Kenta Hama , Takashi Matsubara , Kuniaki Uehara , Jianfei Cai

Deep neural networks (DNNs) are becoming more prevalent in important safety-critical applications, where reliability in the prediction is paramount. Despite their exceptional prediction capabilities, current DNNs do not have an implicit…

Machine Learning · Computer Science 2021-05-14 David Betancourt , Rafi Muhanna

Deep learning models have significantly improved prediction accuracy in various fields, gaining recognition across numerous disciplines. Yet, an aspect of deep learning that remains insufficiently addressed is the assessment of prediction…

Machine Learning · Statistics 2024-12-18 Asaf Ben Arie , Malka Gorfine

To better understand the theoretical behavior of large neural networks, several works have analyzed the case where a network's width tends to infinity. In this regime, the effect of random initialization and the process of training a neural…

Machine Learning · Computer Science 2022-01-14 Florian Juengermann , Maxime Laasri , Marius Merkle

The uncertainty quantification of sensor measurements coupled with deep learning networks is crucial for many robotics systems, especially for safety-critical applications such as self-driving cars. This paper develops an uncertainty…

Robotics · Computer Science 2025-06-23 Qiyuan Wu , Mark Campbell

We present a deep learning framework for quantifying and propagating uncertainty in systems governed by non-linear differential equations using physics-informed neural networks. Specifically, we employ latent variable models to construct…

Machine Learning · Statistics 2019-06-26 Yibo Yang , Paris Perdikaris

Deep learning is gaining increasing popularity for spatiotemporal forecasting. However, prior works have mostly focused on point estimates without quantifying the uncertainty of the predictions. In high stakes domains, being able to…

Artificial Intelligence · Computer Science 2021-06-15 Dongxia Wu , Liyao Gao , Xinyue Xiong , Matteo Chinazzi , Alessandro Vespignani , Yi-An Ma , Rose Yu

Deep Bayesian neural network has aroused a great attention in recent years since it combines the benefits of deep neural network and probability theory. Because of this, the network can make predictions and quantify the uncertainty of the…

Machine Learning · Computer Science 2019-03-25 Yikuan Li , Yajie Zhu