English
Related papers

Related papers: What Uncertainties Do We Need in Bayesian Deep Lea…

200 papers

Bayesian inference is often utilized for uncertainty quantification tasks. A recent analysis by Xu and Raginsky 2022 rigorously decomposed the predictive uncertainty in Bayesian inference into two uncertainties, called aleatoric and…

Machine Learning · Statistics 2023-07-25 Futoshi Futami , Tomoharu Iwata

Bayesian neural networks with latent variables are scalable and flexible probabilistic models: They account for uncertainty in the estimation of the network weights and, by making use of latent variables, can capture complex noise patterns…

Machine Learning · Statistics 2018-06-19 Stefan Depeweg , José Miguel Hernández-Lobato , Finale Doshi-Velez , Steffen Udluft

Neural networks are powerful tools in various applications, and quantifying their uncertainty is crucial for reliable decision-making. In the deep learning field, the uncertainties are usually categorized into aleatoric (data) and epistemic…

Machine Learning · Computer Science 2023-12-21 Wang Zhang , Ziwen Ma , Subhro Das , Tsui-Wei Weng , Alexandre Megretski , Luca Daniel , Lam M. Nguyen

Data-driven control in unknown environments requires a clear understanding of the involved uncertainties for ensuring safety and efficient exploration. While aleatoric uncertainty that arises from measurement noise can often be explicitly…

Machine Learning · Computer Science 2023-07-13 Neha Das , Jonas Umlauft , Armin Lederer , Thomas Beckers , Sandra Hirche

The ability to acknowledge the inevitable uncertainty in their knowledge and reasoning is a prerequisite for AI systems to be truly truthful and reliable. In this paper, we present a taxonomy of uncertainty specific to vision-language AI…

Artificial Intelligence · Computer Science 2024-07-03 Khyathi Raghavi Chandu , Linjie Li , Anas Awadalla , Ximing Lu , Jae Sung Park , Jack Hessel , Lijuan Wang , Yejin Choi

One of the main challenges of deep learning tools is their inability to capture model uncertainty. While Bayesian deep learning can be used to tackle the problem, Bayesian neural networks often require more time and computational power to…

Machine Learning · Computer Science 2020-10-20 Jiaming Zeng , Adam Lesnikowski , Jose M. Alvarez

Deep unrolling is an emerging deep learning-based image reconstruction methodology that bridges the gap between model-based and purely deep learning-based image reconstruction methods. Although deep unrolling methods achieve…

Image and Video Processing · Electrical Eng. & Systems 2022-12-21 Canberk Ekmekci , Mujdat Cetin

When collaborating with an AI system, we need to assess when to trust its recommendations. If we mistakenly trust it in regions where it is likely to err, catastrophic failures may occur, hence the need for Bayesian approaches for…

Artificial Intelligence · Computer Science 2021-02-23 Federico Cerutti , Lance M. Kaplan , Angelika Kimmig , Murat Sensoy

In this article a novel approach for training deep neural networks using Bayesian techniques is presented. The Bayesian methodology allows for an easy evaluation of model uncertainty and additionally is robust to overfitting. These are…

Machine Learning · Computer Science 2019-04-03 Konstantin Posch , Jürgen Pilz

Decomposing prediction uncertainty into aleatoric (irreducible) and epistemic (reducible) components is critical for the reliable deployment of machine learning systems. While the mutual information between the response variable and model…

Machine Learning · Statistics 2026-02-10 Anchit Jain , Stephen Bates

We present a novel approach for training deep neural networks in a Bayesian way. Classical, i.e. non-Bayesian, deep learning has two major drawbacks both originating from the fact that network parameters are considered to be deterministic.…

Machine Learning · Statistics 2019-03-11 Konstantin Posch , Jan Steinbrener , Jürgen Pilz

Datasets collected from the open world unavoidably suffer from various forms of randomness or noiseness, leading to the ubiquity of aleatoric (data) uncertainty. Quantifying such uncertainty is particularly pivotal for object detection,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Peng Cui , Guande He , Dan Zhang , Zhijie Deng , Yinpeng Dong , Jun Zhu

The use of AI systems in healthcare for the early screening of diseases is of great clinical importance. Deep learning has shown great promise in medical imaging, but the reliability and trustworthiness of AI systems limit their deployment…

Image and Video Processing · Electrical Eng. & Systems 2023-05-17 Ke Zou , Zhihao Chen , Xuedong Yuan , Xiaojing Shen , Meng Wang , Huazhu Fu

Advances in architectural design, data availability, and compute have driven remarkable progress in semantic segmentation. Yet, these models often rely on relaxed Bayesian assumptions, omitting critical uncertainty information needed for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 M. M. A. Valiuddin , R. J. G. van Sloun , C. G. A. Viviers , P. H. N. de With , F. van der Sommen

Graph Neural Networks (GNN) provide a powerful framework that elegantly integrates Graph theory with Machine learning for modeling and analysis of networked data. We consider the problem of quantifying the uncertainty in predictions of GNN…

Machine Learning · Computer Science 2022-05-23 Sai Munikoti , Deepesh Agarwal , Laya Das , Balasubramaniam Natarajan

Deep neural networks are highly susceptible to learning biases in visual data. While various methods have been proposed to mitigate such bias, the majority require explicit knowledge of the biases present in the training data in order to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Rebecca S Stone , Nishant Ravikumar , Andrew J Bulpitt , David C Hogg

Neural Linear Models (NLM) are deep Bayesian models that produce predictive uncertainty by learning features from the data and then performing Bayesian linear regression over these features. Despite their popularity, few works have focused…

Machine Learning · Statistics 2021-06-25 Cooper Lorsung

In recent times, neural networks have become a powerful tool for the analysis of complex and abstract data models. However, their introduction intrinsically increases our uncertainty about which features of the analysis are model-related…

Machine Learning · Statistics 2020-11-09 Tom Charnock , Laurence Perreault-Levasseur , François Lanusse

Deep learning models have exhibited superior performance in predictive tasks with the explosively increasing Electronic Health Records (EHR). However, due to the lack of transparency, behaviors of deep learning models are difficult to…

Machine Learning · Computer Science 2019-07-16 Riyi Qiu , Yugang Jia , Mirsad Hadzikadic , Michael Dulin , Xi Niu , Xin Wang

Equation learning aims to infer differential equation models from data. While a number of studies have shown that differential equation models can be successfully identified when the data are sufficiently detailed and corrupted with…

Quantitative Methods · Quantitative Biology 2021-09-30 Simon Martina-Perez , Matthew J. Simpson , Ruth E. Baker