English
Related papers

Related papers: Bayesian neural networks for predicting uncertaint…

200 papers

End-to-end trained neural networks (NNs) are a compelling approach to autonomous vehicle control because of their ability to learn complex tasks without manual engineering of rule-based decisions. However, challenging road conditions,…

Artificial Intelligence · Computer Science 2021-11-24 Alexander Amini , Ava Soleimany , Sertac Karaman , Daniela Rus

Prior information often takes the form of parameter constraints. Bayesian methods include such information through prior distributions having constrained support. By using posterior sampling algorithms, one can quantify uncertainty without…

Methodology · Statistics 2018-09-25 Leo L Duan , Alexander L Young , Akihiko Nishimura , David B Dunson

Estimating predictive uncertainty is crucial for many computer vision tasks, from image classification to autonomous driving systems. Hamiltonian Monte Carlo (HMC) is an sampling method for performing Bayesian inference. On the other hand,…

Machine Learning · Computer Science 2019-07-03 Diego Vergara , Sergio Hernández , Matias Valdenegro-Toro , Felipe Jorquera

The Bayesian elastic net regression model is characterized by the regression coefficient prior distribution, the negative log density of which corresponds to the elastic net penalty function. While Markov chain Monte Carlo (MCMC) methods…

Computation · Statistics 2025-01-03 Christopher M. Hans , Ningyi Liu

Bayesian clustering methods have the widely touted advantage of providing a probabilistic characterization of uncertainty in clustering through the posterior distribution. An amazing variety of priors and likelihoods have been proposed for…

Methodology · Statistics 2025-11-21 Garritt L. Page , Andrés F. Barrientos , David B. Dahl , David B. Dunson

Deep neural networks are increasingly being used for the analysis of medical images. However, most works neglect the uncertainty in the model's prediction. We propose an uncertainty-aware deep kernel learning model which permits the…

Machine Learning · Computer Science 2021-06-11 Zhiliang Wu , Yinchong Yang , Jindong Gu , Volker Tresp

Bayesian neural networks and deep ensembles represent two modern paradigms of uncertainty quantification in deep learning. Yet these approaches struggle to scale mainly due to memory inefficiency issues, since they require parameter storage…

Machine Learning · Statistics 2021-11-24 Hippolyt Ritter , Martin Kukla , Cheng Zhang , Yingzhen Li

Recent advances in reconstruction methods for inverse problems leverage powerful data-driven models, e.g., deep neural networks. These techniques have demonstrated state-of-the-art performances for several imaging tasks, but they often do…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Riccardo Barbano , Chen Zhang , Simon Arridge , Bangti Jin

Traditional deep learning (DL) models are powerful classifiers, but many approaches do not provide uncertainties for their estimates. Uncertainty quantification (UQ) methods for DL models have received increased attention in the literature…

Machine Learning · Computer Science 2023-08-14 Daniel Ries , Joshua Michalenko , Tyler Ganter , Rashad Imad-Fayez Baiyasi , Jason Adams

The widespread adoption of machine learning surrogate models has significantly improved the scale and complexity of systems and processes that can be explored accurately and efficiently using atomistic modeling. However, the inherently…

Chemical Physics · Physics 2025-03-13 Federico Grasselli , Sanggyu Chong , Venkat Kapil , Silvia Bonfanti , Kevin Rossi

As machine learning systems get widely adopted for high-stake decisions, quantifying uncertainty over predictions becomes crucial. While modern neural networks are making remarkable gains in terms of predictive accuracy, characterizing…

Machine Learning · Computer Science 2019-06-14 Melanie F. Pradier , Weiwei Pan , Jiayu Yao , Soumya Ghosh , Finale Doshi-velez

Stress analysis of heterogeneous media, like composite materials, using Finite Element Analysis (FEA) has become commonplace in design and analysis. However, determining stress distributions in heterogeneous media using FEA can be…

Applied Physics · Physics 2021-04-22 Haotian Feng , Pavana Prabhakar

The Bayesian inversion method demonstrates significant potential for solving inverse problems, enabling both point estimation and uncertainty quantification (UQ). However, Bayesian maximum a posteriori (MAP) estimation may become unstable…

Numerical Analysis · Mathematics 2025-06-04 Ruibiao Song , Liying Zhang

Fully convolutional U-shaped neural networks have largely been the dominant approach for pixel-wise image segmentation. In this work, we tackle two defects that hinder their deployment in real-world applications: 1) Predictions lack…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Martin Ferianc , Divyansh Manocha , Hongxiang Fan , Miguel Rodrigues

Bayesian Neural Networks (BNNs) offer a mathematically grounded framework to quantify the uncertainty of model predictions but come with a prohibitive computation cost for both training and inference. In this work, we show a novel network…

Machine Learning · Computer Science 2022-02-10 Duo Wang , Yiren Zhao , Ilia Shumailov , Robert Mullins

Bayesian methods for learning Gaussian graphical models offer a principled framework for quantifying model uncertainty and incorporating prior knowledge. However, their scalability is constrained by the computational cost of jointly…

Methodology · Statistics 2025-08-28 Reza Mohammadi , Marit Schoonhoven , Lucas Vogels , S. Ilker Birbil

Deep Learning (DL) holds great promise in reshaping the industry owing to its precision, efficiency, and objectivity. However, the brittleness of DL models to noisy and out-of-distribution inputs is ailing their deployment in sensitive…

Image and Video Processing · Electrical Eng. & Systems 2025-10-03 Giuseppina Carannante , Nidhal C. Bouaynaya , Dimah Dera , Hassan M. Fathallah-Shaykh , Ghulam Rasool

Monte Carlo (MC) dropout is one of the state-of-the-art approaches for uncertainty estimation in neural networks (NNs). It has been interpreted as approximately performing Bayesian inference. Based on previous work on the approximation of…

Machine Learning · Computer Science 2020-07-13 Joachim Sicking , Maram Akila , Tim Wirtz , Sebastian Houben , Asja Fischer

Despite recent advances, sampling-based inference for Bayesian Neural Networks (BNNs) remains a significant challenge in probabilistic deep learning. While sampling-based approaches do not require a variational distribution assumption,…

Machine Learning · Computer Science 2025-02-11 Emanuel Sommer , Jakob Robnik , Giorgi Nozadze , Uros Seljak , David Rügamer

Popular approaches for quantifying predictive uncertainty in deep neural networks often involve distributions over weights or multiple models, for instance via Markov Chain sampling, ensembling, or Monte Carlo dropout. These techniques…

Machine Learning · Computer Science 2023-03-08 Dennis Ulmer , Christian Hardmeier , Jes Frellsen