English
Related papers

Related papers: Dropout Injection at Test Time for Post Hoc Uncert…

200 papers

Uncertainty quantification in a neural network is one of the most discussed topics for safety-critical applications. Though Neural Networks (NNs) have achieved state-of-the-art performance for many applications, they still provide…

Machine Learning · Computer Science 2022-05-09 Mehedi Hasan , Abbas Khosravi , Ibrahim Hossain , Ashikur Rahman , Saeid Nahavandi

Among the various options to estimate uncertainty in deep neural networks, Monte-Carlo dropout is widely popular for its simplicity and effectiveness. However the quality of the uncertainty estimated through this method varies and choices…

Machine Learning · Computer Science 2021-07-14 Francesco Verdoja , Ville Kyrki

Traditional neural networks provide deterministic predictions without inherent uncertainty estimates. While Bayesian Neural Networks (BNNs) offer a principled approach to uncertainty quantification, their computational complexity limits…

Machine Learning · Statistics 2026-05-25 Rouaa Hoblos , Noura Dridi , Noureddine Zerhouni , Zeina Al Masry

Reliable uncertainty estimation is crucial for machine learning models, especially in safety-critical domains. While exact Bayesian inference offers a principled approach, it is often computationally infeasible for deep neural networks.…

Machine Learning · Computer Science 2025-12-18 Aslak Djupskås , Alexander Johannes Stasik , Signe Riemer-Sørensen

The Monte Carlo dropout method has proved to be a scalable and easy-to-use approach for estimating the uncertainty of deep neural network predictions. This approach was recently applied to Fault Detection and Di-agnosis (FDD) applications…

Machine Learning · Computer Science 2019-09-11 Baihong Jin , Yingshui Tan , Yuxin Chen , Alberto Sangiovanni-Vincentelli

In this report, we present qualitative analysis of Monte Carlo (MC) dropout method for measuring model uncertainty in neural network (NN) models. We first consider the sources of uncertainty in NNs, and briefly review Bayesian Neural…

Machine Learning · Statistics 2020-07-06 Ronald Seoh

Accurate uncertainty estimation is crucial for deploying neural networks in risk-sensitive applications such as medical diagnosis. Monte Carlo Dropout is a widely used technique for approximating predictive uncertainty by performing…

Machine Learning · Computer Science 2025-06-05 Tal Zeevi , Ravid Shwartz-Ziv , Yann LeCun , Lawrence H. Staib , John A. Onofrey

Knowing the uncertainty associated with the output of a deep neural network is of paramount importance in making trustworthy decisions, particularly in high-stakes fields like medical diagnosis and autonomous systems. Monte Carlo Dropout…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Hamzeh Asgharnezhad , Afshar Shamsi , Roohallah Alizadehsani , Arash Mohammadi , Hamid Alinejad-Rokny

Dropout is conventionally used during the training phase as regularization method and for quantifying uncertainty in deep learning. We propose to use dropout during training as well as inference steps, and average multiple predictions to…

Image and Video Processing · Electrical Eng. & Systems 2023-11-07 Mehmet Yigit Avci , Ziyu Li , Qiuyun Fan , Susie Huang , Berkin Bilgic , Qiyuan Tian

Monte Carlo dropout may effectively capture model uncertainty in deep learning, where a measure of uncertainty is obtained by using multiple instances of dropout at test time. However, Monte Carlo dropout is applied across the whole network…

Signal Processing · Electrical Eng. & Systems 2020-02-03 Liangping Ma , John Kaewell

We present a sampling-free approach for computing the epistemic uncertainty of a neural network. Epistemic uncertainty is an important quantity for the deployment of deep neural networks in safety-critical applications, since it represents…

Machine Learning · Computer Science 2019-12-04 Janis Postels , Francesco Ferroni , Huseyin Coskun , Nassir Navab , Federico Tombari

Monte-Carlo (MC) Dropout provides a practical solution for estimating predictive distributions in deterministic neural networks. Traditional dropout, applied within the signal space, may fail to account for frequency-related noise common in…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Tal Zeevi , Lawrence H. Staib , John A. Onofrey

Monte Carlo (MC) dropout is one of the state-of-the-art approaches for uncertainty estimation in neural networks (NNs). It has been interpreted as approximately performing Bayesian inference. Based on previous work on the approximation of…

Machine Learning · Computer Science 2020-07-13 Joachim Sicking , Maram Akila , Tim Wirtz , Sebastian Houben , Asja Fischer

Estimating predictive uncertainty is crucial for many computer vision tasks, from image classification to autonomous driving systems. Hamiltonian Monte Carlo (HMC) is an sampling method for performing Bayesian inference. On the other hand,…

Machine Learning · Computer Science 2019-07-03 Diego Vergara , Sergio Hernández , Matias Valdenegro-Toro , Felipe Jorquera

As deep learning-based computer vision algorithms continue to advance the state of the art, their robustness to real-world data continues to be an issue, making it difficult to bring an algorithm from the lab to the real world.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Michael Smith , Frank Ferrie

We develop a multilevel Monte Carlo (MLMC) framework for uncertainty quantification with Monte Carlo dropout. Treating dropout masks as a source of epistemic randomness, we define a fidelity hierarchy by the number of stochastic forward…

Machine Learning · Computer Science 2026-01-21 Aaron Pim , Tristan Pryer

Uncertainty quantification of machine learning and deep learning methods plays an important role in enhancing trust to the obtained result. In recent years, a numerous number of uncertainty quantification methods have been introduced. Monte…

Machine Learning · Computer Science 2023-02-07 Afshar Shamsi , Hamzeh Asgharnezhad , AmirReza Tajally , Saeid Nahavandi , Henry Leung

Uncertainty estimation in Neural Networks (NNs) is vital in improving reliability and confidence in predictions, particularly in safety-critical applications. Bayesian Neural Networks (BayNNs) with Dropout as an approximation offer a…

Machine Learning · Computer Science 2024-01-12 Soyed Tuhin Ahmed , Kamal Danouchi , Michael Hefenbrock , Guillaume Prenat , Lorena Anghel , Mehdi B. Tahoori

Popular approaches for quantifying predictive uncertainty in deep neural networks often involve distributions over weights or multiple models, for instance via Markov Chain sampling, ensembling, or Monte Carlo dropout. These techniques…

Machine Learning · Computer Science 2023-03-08 Dennis Ulmer , Christian Hardmeier , Jes Frellsen

Model uncertainty quantification involves measuring and evaluating the uncertainty linked to a model's predictions, helping assess their reliability and confidence. Noise injection is a technique used to enhance the robustness of neural…

Machine Learning · Statistics 2025-04-25 Xueqiong Yuan , Jipeng Li , Ercan Engin Kuruoglu
‹ Prev 1 2 3 10 Next ›