English
Related papers

Related papers: Quantifying Sources of Uncertainty in Deep Learnin…

200 papers

This paper presents a novel machine-learning framework for reconstructing low-order gust-encounter flow field and lift coefficients from sparse, noisy surface pressure measurements. Our study thoroughly investigates the time-varying…

Machine Learning · Computer Science 2025-06-25 Hanieh Mousavi , Jeff D. Eldredge

Dynamic neural networks are a recent technique that promises a remedy for the increasing size of modern deep learning models by dynamically adapting their computational cost to the difficulty of the inputs. In this way, the model can adjust…

Machine Learning · Computer Science 2023-12-11 Lassi Meronen , Martin Trapp , Andrea Pilzer , Le Yang , Arno Solin

The idea to distinguish and quantify two important types of uncertainty, often referred to as aleatoric and epistemic, has received increasing attention in machine learning research in the last couple of years. In this paper, we consider…

Machine Learning · Computer Science 2021-12-13 Mohammad Hossein Shaker , Eyke Hüllermeier

Existing methods for estimating uncertainty in deep learning tend to require multiple forward passes, making them unsuitable for applications where computational resources are limited. To solve this, we perform probabilistic reasoning over…

Machine Learning · Statistics 2020-12-08 Javier Antorán , James Urquhart Allingham , José Miguel Hernández-Lobato

For many applications it is critical to know the uncertainty of a neural network's predictions. While a variety of neural network parameter estimation methods have been proposed for uncertainty estimation, they have not been rigorously…

Machine Learning · Computer Science 2019-12-05 Nabeel Seedat , Christopher Kanan

Deep Neural Networks (DNNs) are powerful tools for various computer vision tasks, yet they often struggle with reliable uncertainty quantification - a critical requirement for real-world applications. Bayesian Neural Networks (BNN) are…

Machine Learning · Computer Science 2023-12-27 Gianni Franchi , Olivier Laurent , Maxence Leguéry , Andrei Bursuc , Andrea Pilzer , Angela Yao

Accurate image reconstruction is at the heart of diagnostics in medical imaging. Supervised deep learning-based approaches have been investigated for solving inverse problems including image reconstruction. However, these trained models…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Danyal F. Bhutto , Bo Zhu , Jeremiah Z. Liu , Neha Koonjoo , Hongwei B. Li , Bruce R. Rosen , Matthew S. Rosen

We present a Bayesian perspective on quantifying the uncertainty of graph signals estimated or reconstructed from imperfect observations. We show that many conventional methods of graph signal estimation, reconstruction and imputation, can…

Signal Processing · Electrical Eng. & Systems 2025-05-22 Lennard Rompelberg , Michael T. Schaub

We propose a simple and effective method to estimate the uncertainty of closed-source deep neural network image classification models. Given a base image, our method creates multiple transformed versions and uses them to query the top-1…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Konstantinos Pitas , Julyan Arbel

Despite the promise of Convolutional neural network (CNN) based classification models for histopathological images, it is infeasible to quantify its uncertainties. Moreover, CNNs may suffer from overfitting when the data is biased. We show…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Ponkrshnan Thiagarajan , Pushkar Khairnar , Susanta Ghosh

Graph contrastive learning has shown great promise when labeled data is scarce, but large unlabeled datasets are available. However, it often does not take uncertainty estimation into account. We show that a variational Bayesian neural…

Machine Learning · Computer Science 2023-12-04 Alexander Möllers , Alexander Immer , Elvin Isufi , Vincent Fortuin

Assessing the quality of aleatoric uncertainty estimates from uncertainty quantification (UQ) deep learning methods is important in scientific contexts, where uncertainty is physically meaningful and important to characterize and interpret…

Machine Learning · Computer Science 2024-11-14 Rebecca Nevin , Aleksandra Ćiprijanović , Brian D. Nord

Deep learning offers promising new ways to accurately model aleatoric uncertainty in robotic state estimation systems, particularly when the uncertainty distributions do not conform to traditional assumptions of being fixed and Gaussian. In…

Machine Learning · Computer Science 2025-02-28 Aastha Acharya , Caleb Lee , Marissa D'Alonzo , Jared Shamwell , Nisar R. Ahmed , Rebecca Russell

Contrastive approaches to representation learning have recently shown great promise. In contrast to generative approaches, these contrastive models learn a deterministic encoder with no notion of uncertainty or confidence. In this paper, we…

Machine Learning · Computer Science 2020-10-06 Mike Wu , Noah Goodman

We develop a novel deep learning method for uncertainty quantification in stochastic partial differential equations based on Bayesian neural network (BNN) and Hamiltonian Monte Carlo (HMC). A BNN efficiently learns the posterior…

Machine Learning · Statistics 2022-10-24 Jeahan Jung , Minseok Choi

Equation learning aims to infer differential equation models from data. While a number of studies have shown that differential equation models can be successfully identified when the data are sufficiently detailed and corrupted with…

Quantitative Methods · Quantitative Biology 2021-09-30 Simon Martina-Perez , Matthew J. Simpson , Ruth E. Baker

Reinforcement learning agents are faced with two types of uncertainty. Epistemic uncertainty stems from limited data and is useful for exploration, whereas aleatoric uncertainty arises from stochastic environments and must be accounted for…

Machine Learning · Computer Science 2020-09-10 William R. Clements , Bastien Van Delft , Benoît-Marie Robaglia , Reda Bahi Slaoui , Sébastien Toth

We evaluate two different methods for the integration of prediction uncertainty into diagnostic image classifiers to increase patient safety in deep learning. In the first method, Monte Carlo sampling is applied with dropout at test time to…

Image and Video Processing · Electrical Eng. & Systems 2019-08-05 Max-Heinrich Laves , Sontje Ihler , Tobias Ortmaier

Applying standard algorithms to sparse data problems in photoacoustic tomography (PAT) yields low-quality images containing severe under-sampling artifacts. To some extent, these artifacts can be reduced by iterative image reconstruction…

Numerical Analysis · Mathematics 2024-12-20 Stephan Antholzer , Johannes Schwab , Robert Nuster , Markus Haltmeier

We propose a novel iterative algorithm for estimating a deterministic but unknown parameter vector in the presence of model uncertainties. This iterative algorithm is based on a system model where an overall noise term describes both, the…

Statistics Theory · Mathematics 2017-11-27 Oliver Lang , Michael Lunglmayr , Mario Huemer