English
Related papers

Related papers: Qualitative Analysis of Monte Carlo Dropout

200 papers

The Monte Carlo (MC) method is the most common technique used for uncertainty quantification, due to its simplicity and good statistical results. However, its computational cost is extremely high, and, in many cases, prohibitive.…

Computation · Statistics 2021-05-21 A. Cunha , R. Nasser , R. Sampaio , H. Lopes , K. Breitman

Bayesian analysis often concerns an evaluation of models with different dimensionality as is necessary in, for example, model selection or mixture models. To facilitate this evaluation, transdimensional Markov chain Monte Carlo (MCMC)…

Methodology · Statistics 2018-08-13 Daniel W. Heck , Antony M. Overstall , Quentin F. Gronau , Eric-Jan Wagenmakers

Dropout as regularization has been used extensively to prevent overfitting for training neural networks. During training, units and their connections are randomly dropped, which could be considered as sampling many different submodels from…

Machine Learning · Computer Science 2022-04-28 Zhaoyuan Yang , Arpit Jain

In predictive modeling with simulation or machine learning, it is critical to accurately assess the quality of estimated values through output analysis. In recent decades output analysis has become enriched with methods that quantify the…

Methodology · Statistics 2023-10-27 Kimia Vahdat , Sara Shashaani

Accurate proton dose calculation using Monte Carlo (MC) is computationally demanding in workflows like robust optimisation, adaptive replanning, and probabilistic inference, which require repeated evaluations. To address this, we develop a…

Machine Learning · Statistics 2025-09-24 Aaron Pim , Tristan Pryer

Neural networks are lately more and more often being used in the context of data-driven control, as an approximate model of the true system dynamics. Model Predictive Control (MPC) adopts this practise leading to neural MPC strategies. This…

Systems and Control · Electrical Eng. & Systems 2024-06-05 Spyridon Syntakas , Kostas Vlachos

In this work, we propose the use of dropouts as a Bayesian estimator for increasing the generalizability of a deep neural network (DNN) for speech enhancement. By using Monte Carlo (MC) dropout, we show that the DNN performs better…

Audio and Speech Processing · Electrical Eng. & Systems 2018-06-05 Nazreen P M , A G Ramakrishnan

MC Dropout is a mainstream "free lunch" method in medical imaging for approximate Bayesian computations (ABC). Its appeal is to solve out-of-the-box the daunting task of ABC and uncertainty quantification in Neural Networks (NNs); to fall…

Deep neural networks have become the gold-standard approach for the automated segmentation of 3D medical images. Their full acceptance by clinicians remains however hampered by the lack of intelligible uncertainty assessment of the provided…

Image and Video Processing · Electrical Eng. & Systems 2022-09-23 Benjamin Lambert , Florence Forbes , Senan Doyle , Alan Tucholka , Michel Dojat

We introduce inherent measures for effective quality control of brain segmentation based on a Bayesian fully convolutional neural network, using model uncertainty. Monte Carlo samples from the posterior distribution are efficiently…

Computer Vision and Pattern Recognition · Computer Science 2018-06-11 Abhijit Guha Roy , Sailesh Conjeti , Nassir Navab , Christian Wachinger

Uncertainty quantification is essential for robotic perception, as overconfident or point estimators can lead to collisions and damages to the environment and the robot. In this paper, we evaluate scalable approaches to uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Javier Rodríguez-Puigvert , Rubén Martínez-Cantín , Javier Civera

The use of Deep Neural Network (DNN) models in risk-based decision-making has attracted extensive attention with broad applications in medical, finance, manufacturing, and quality control. To mitigate prediction-related risks in decision…

Machine Learning · Statistics 2023-10-11 Maryam Kheirandish , Shengfan Zhang , Donald G. Catanzaro , Valeriu Crudu

Estimating epistemic uncertainty of models used in low-latency applications and Out-Of-Distribution samples detection is a challenge due to the computationally demanding nature of uncertainty estimation techniques. Estimating model…

Machine Learning · Computer Science 2020-10-28 Akshatha Kamath , Dwaraknath Gnaneshwar , Matias Valdenegro-Toro

Deep neural networks (DNNs) have achieved state-of-the-art performances in many important domains, including medical diagnosis, security, and autonomous driving. In these domains where safety is highly critical, an erroneous decision can…

Machine Learning · Computer Science 2019-06-12 Aryan Mobiny , Hien V. Nguyen , Supratik Moulik , Naveen Garg , Carol C. Wu

Inputs to machine learning models can have associated noise or uncertainties, but they are often ignored and not modelled. It is unknown if Bayesian Neural Networks and their approximations are able to consider uncertainty in their inputs.…

Machine Learning · Computer Science 2025-01-15 Matias Valdenegro-Toro , Marco Zullich

Computer vision leveraging deep learning has achieved significant success in the last decade. Despite the promising performance of the existing deep models in the recent literature, the extent of models' reliability remains unknown.…

Computer Vision and Pattern Recognition · Computer Science 2020-04-13 Seyed Omid Sajedi , Xiao Liang

The Computer_Aided Diagnosis (CAD) systems facilitate accurate diagnosis of diseases. The development of CADs by leveraging third generation neural network, namely, Spiking Neural Network (SNN), is essential to utilize of the benefits of…

Image and Video Processing · Electrical Eng. & Systems 2025-04-28 Mohaddeseh Chegini , Ali Mahloojifar

Detecting surface landmines and unexploded ordnances (UXOs) using deep learning has shown promise in humanitarian demining. However, deterministic neural networks can be vulnerable to noisy conditions and adversarial attacks, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Sagar Lekhak , Emmett J. Ientilucci , Dimah Dera , Susmita Ghosh

If the conclusion of a data analysis is sensitive to dropping very few data points, that conclusion might hinge on the particular data at hand rather than representing a more broadly applicable truth. How could we check whether this…

Methodology · Statistics 2024-11-12 Tin D. Nguyen , Ryan Giordano , Rachael Meager , Tamara Broderick

Traditional deep learning (DL) models are powerful classifiers, but many approaches do not provide uncertainties for their estimates. Uncertainty quantification (UQ) methods for DL models have received increased attention in the literature…

Machine Learning · Computer Science 2023-08-14 Daniel Ries , Joshua Michalenko , Tyler Ganter , Rashad Imad-Fayez Baiyasi , Jason Adams