English
Related papers

Related papers: Dropout Injection at Test Time for Post Hoc Uncert…

200 papers

Introduced by Hinton et al. in 2012, dropout has stood the test of time as a regularizer for preventing overfitting in neural networks. In this study, we demonstrate that dropout can also mitigate underfitting when used at the start of…

Machine Learning · Computer Science 2023-06-01 Zhuang Liu , Zhiqiu Xu , Joseph Jin , Zhiqiang Shen , Trevor Darrell

We introduce inherent measures for effective quality control of brain segmentation based on a Bayesian fully convolutional neural network, using model uncertainty. Monte Carlo samples from the posterior distribution are efficiently…

Computer Vision and Pattern Recognition · Computer Science 2018-06-11 Abhijit Guha Roy , Sailesh Conjeti , Nassir Navab , Christian Wachinger

Although neural networks (especially deep neural networks) have achieved \textit{better-than-human} performance in many fields, their real-world deployment is still questionable due to the lack of awareness about the limitation in their…

Machine Learning · Computer Science 2023-04-12 Mehedi Hasan , Moloud Abdar , Abbas Khosravi , Uwe Aickelin , Pietro Lio' , Ibrahim Hossain , Ashikur Rahman , Saeid Nahavandi

Epistemic uncertainty quantification (UQ) identifies where models lack knowledge. Traditional UQ methods, often based on Bayesian neural networks, are not suitable for pre-trained non-Bayesian models. Our study addresses quantifying…

Machine Learning · Computer Science 2024-04-17 Hanjing Wang , Qiang Ji

Recently, machine learning systems have gained prominence in real-time, critical decision-making domains, such as autonomous driving and industrial automation. Their implementations should avoid overconfident predictions through uncertainty…

Machine Learning · Computer Science 2023-06-21 Soyed Tuhin Ahmed , Kamal Danouchi , Michael Hefenbrock , Guillaume Prenat , Lorena Anghel , Mehdi B. Tahoori

Uncertainty analysis in the outcomes of model predictions is a key element in decision-based material design to establish confidence in the models and evaluate the fidelity of models. Uncertainty Propagation (UP) is a technique to determine…

Machine Learning · Computer Science 2023-02-13 Danial Khatamsaz , Vahid Attari , Raymundo Arroyave , Douglas L. Allaire

Bayesian analysis often concerns an evaluation of models with different dimensionality as is necessary in, for example, model selection or mixture models. To facilitate this evaluation, transdimensional Markov chain Monte Carlo (MCMC)…

Methodology · Statistics 2018-08-13 Daniel W. Heck , Antony M. Overstall , Quentin F. Gronau , Eric-Jan Wagenmakers

The Monte Carlo (MC) method is the most common technique used for uncertainty quantification, due to its simplicity and good statistical results. However, its computational cost is extremely high, and, in many cases, prohibitive.…

Computation · Statistics 2021-05-21 A. Cunha , R. Nasser , R. Sampaio , H. Lopes , K. Breitman

Machine learning classifiers are probabilistic in nature, and thus inevitably involve uncertainty. Predicting the probability of a specific input to be correct is called uncertainty (or confidence) estimation and is crucial for risk…

Machine Learning · Computer Science 2023-01-11 Gabriella Chouraqui , Liron Cohen , Gil Einziger , Liel Leman

Deep Learning sets the state-of-the-art in many challenging tasks showing outstanding performance in a broad range of applications. Despite its success, it still lacks robustness hindering its adoption in medical applications. Modeling…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 Agnieszka Tomczack , Nassir Navab , Shadi Albarqouni

In this work, we propose the use of dropout as a Bayesian estimator for increasing the generalizability of a deep neural network (DNN) for speech enhancement. By using Monte Carlo (MC) dropout, we show that the DNN performs better…

Audio and Speech Processing · Electrical Eng. & Systems 2018-08-29 Nazreen P. M. , A. G. Ramakrishnan

Automated segmentation of BUS images is important for precise lesion delineation and tumor characterization, but is challenged by inherent artifacts and dataset inconsistencies. In this work, we evaluate the use of a modified Residual…

We explore the utility of information contained within a dropout based Bayesian neural network (BNN) for the task of detecting out of distribution (OOD) data. We first show how previous attempts to leverage the randomized embeddings induced…

Machine Learning · Computer Science 2022-02-21 Andre T. Nguyen , Fred Lu , Gary Lopez Munoz , Edward Raff , Charles Nicholas , James Holt

Quantifying uncertainty in deep regression models is important both for understanding the confidence of the model and for safe decision-making in high-risk domains. Existing approaches that yield prediction intervals overlook distributional…

Machine Learning · Computer Science 2025-12-02 Adriel Sosa Marco , John Daniel Kirwan , Alexia Toumpa , Simos Gerasimou

Recently, there has been a significant amount of interest in satellite telemetry anomaly detection (AD) using neural networks (NN). For AD purposes, the current approaches focus on either forecasting or reconstruction of the time series,…

Machine Learning · Computer Science 2022-11-29 Mohammad Amin Maleki Sadr , Yeying Zhu , Peng Hu

Recently, deep learning has achieved remarkable successes in medical image analysis. Although deep neural networks generate clinically important predictions, they have inherent uncertainty. Such uncertainty is a major barrier to report…

Image and Video Processing · Electrical Eng. & Systems 2022-06-03 Qing Lyu , Christopher T. Whitlow , Ge Wang

Data-Driven Product Development (DDPD) leverages data to learn the relationship between product design specifications and resulting properties. To discover improved designs, we train a neural network on past experiments and apply Projected…

Machine Learning · Computer Science 2026-01-06 Andrea Thomas Nava , Lijo Johny , Fabio Azzalini , Johannes Schneider , Arianna Casanova

This work introduces a new method designed for Bayesian deep learning called scalable Bayesian Monte Carlo (SBMC). The method is comprised of a model and an algorithm. The model interpolates between a point estimator and the posterior. The…

The vast majority of uncertainty quantification methods for deep object detectors such as variational inference are based on the network output. Here, we study gradient-based epistemic uncertainty metrics for deep object detectors to obtain…

Computer Vision and Pattern Recognition · Computer Science 2022-03-21 Tobias Riedlinger , Matthias Rottmann , Marius Schubert , Hanno Gottschalk

The widespread use of Deep Neural Networks (DNNs) has recently resulted in their application to challenging scientific visualization tasks. While advanced DNNs demonstrate impressive generalization abilities, understanding factors like…

Graphics · Computer Science 2024-08-13 Atul Kumar , Siddharth Garg , Soumya Dutta