English
Related papers

Related papers: Controlled Dropout for Uncertainty Estimation

200 papers

With the advancements made in deep learning, computer vision problems like object detection and segmentation have seen a great improvement in performance. However, in many real-world applications such as autonomous driving vehicles, the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Kumari Deepshikha , Sai Harsha Yelleni , P. K. Srijith , C Krishna Mohan

Neural activation coverage (NAC) is a recently-proposed technique for out-of-distribution detection and generalization. We build upon this promising foundation and extend the method to work as an uncertainty estimation technique for…

Machine Learning · Computer Science 2026-04-27 Benedikt Franke , Nils Förster , Frank Köster , Asja Fischer , Markus Lange , Arne Raulf

Deep neural networks have become the gold-standard approach for the automated segmentation of 3D medical images. Their full acceptance by clinicians remains however hampered by the lack of intelligible uncertainty assessment of the provided…

Image and Video Processing · Electrical Eng. & Systems 2022-09-23 Benjamin Lambert , Florence Forbes , Senan Doyle , Alan Tucholka , Michel Dojat

Dropout is used as a practical tool to obtain uncertainty estimates in large vision models and reinforcement learning (RL) tasks. But to obtain well-calibrated uncertainty estimates, a grid-search over the dropout probabilities is necessary…

Machine Learning · Statistics 2017-05-23 Yarin Gal , Jiri Hron , Alex Kendall

Dropout has been commonly used to quantify prediction uncertainty, i.e, the variations of model predictions on a given input example. However, using dropout in practice can be expensive as it requires running dropout inferences many times.…

Machine Learning · Computer Science 2022-06-20 Haichao Yu , Zhe Chen , Dong Lin , Gil Shamir , Jie Han

Advances in deep neural network (DNN) based molecular property prediction have recently led to the development of models of remarkable accuracy and generalization ability, with graph convolution neural networks (GCNNs) reporting…

Machine Learning · Computer Science 2019-10-09 Gabriele Scalia , Colin A. Grambow , Barbara Pernici , Yi-Pei Li , William H. Green

Deep neural networks have become the default choice for many of the machine learning tasks such as classification and regression. Dropout, a method commonly used to improve the convergence of deep neural networks, generates an ensemble of…

Machine Learning · Statistics 2019-04-11 Tal Kachman , Michal Moshkovitz , Michal Rosen-Zvi

Deep neural networks (NNs) are known for their high-prediction performances. However, NNs are prone to yield unreliable predictions when encountering completely new situations without indicating their uncertainty. Bayesian variants of NNs…

Machine Learning · Computer Science 2023-08-25 Kai Brach , Beate Sick , Oliver Dürr

Uncertainty quantification (UQ) includes the characterization, integration, and propagation of uncertainties that result from stochastic variations and a lack of knowledge or data in the natural world. Monte Carlo (MC) method is a…

Methodology · Statistics 2020-11-03 Jiaxin Zhang

Deep neural networks have shown great success in prediction quality while reliable and robust uncertainty estimation remains a challenge. Predictive uncertainty supplements model predictions and enables improved functionality of downstream…

Machine Learning · Computer Science 2021-12-02 Johanna Rock , Tiago Azevedo , René de Jong , Daniel Ruiz-Muñoz , Partha Maji

Early detection of incipient faults is of vital importance to reducing maintenance costs, saving energy, and enhancing occupant comfort in buildings. Popular supervised learning models such as deep neural networks are considered promising…

Machine Learning · Computer Science 2019-02-19 Baihong Jin , Dan Li , Seshadhri Srinivasan , See-Kiong Ng , Kameshwar Poolla , Alberto~Sangiovanni-Vincentelli

Medical images are increasingly used as input to deep neural networks to produce quantitative values that aid researchers and clinicians. However, standard deep neural networks do not provide a reliable measure of uncertainty in those…

Image and Video Processing · Electrical Eng. & Systems 2020-02-19 Jacob C. Reinhold , Yufan He , Shizhong Han , Yunqiang Chen , Dashan Gao , Junghoon Lee , Jerry L. Prince , Aaron Carass

Accurate brain tumor segmentation from MRI is vital for diagnosis and treatment planning. Although Monte Carlo (MC) Dropout is widely used to estimate model uncertainty, the effectiveness of variance-based uncertainty - computed as…

Machine Learning · Computer Science 2026-05-28 Saumya B

Uncertainty quantification is essential for robotic perception, as overconfident or point estimators can lead to collisions and damages to the environment and the robot. In this paper, we evaluate scalable approaches to uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Javier Rodríguez-Puigvert , Rubén Martínez-Cantín , Javier Civera

Accurate proton dose calculation using Monte Carlo (MC) is computationally demanding in workflows like robust optimisation, adaptive replanning, and probabilistic inference, which require repeated evaluations. To address this, we develop a…

Machine Learning · Statistics 2025-09-24 Aaron Pim , Tristan Pryer

Neural networks are a commonly used approach to replace physical models with computationally cheap surrogates. Parametric uncertainty quantification can be included in training, assuming that an accurate prior distribution of the model…

Machine Learning · Computer Science 2026-03-12 Heikki Haario , Zhi-Song Liu , Martin Simon , Hendrik Weichel

Whilst an abundance of techniques have recently been proposed to generate counterfactual explanations for the predictions of opaque black-box systems, markedly less attention has been paid to exploring the uncertainty of these generated…

Machine Learning · Computer Science 2021-07-22 Eoin Delaney , Derek Greene , Mark T. Keane

Uncertainty estimation (UE) techniques -- such as the Gaussian process (GP), Bayesian neural networks (BNN), Monte Carlo dropout (MCDropout) -- aim to improve the interpretability of machine learning models by assigning an estimated…

Machine Learning · Computer Science 2021-12-10 Yehao Liu , Matteo Pagliardini , Tatjana Chavdarova , Sebastian U. Stich

Deep neural networks tend to underestimate uncertainty and produce overly confident predictions. Recently proposed solutions, such as MC Dropout and SDENet, require complex training and/or auxiliary out-of-distribution data. We propose a…

Machine Learning · Computer Science 2021-10-14 Akib Mashrur , Wei Luo , Nayyar A. Zaidi , Antonio Robles-Kelly

Bias originates from both data and algorithmic design, often exacerbated by traditional fairness methods that fail to address the subtle impacts of protected attributes. This study introduces an approach to mitigate bias in machine learning…

Machine Learning · Computer Science 2024-10-08 Khadija Zanna , Akane Sano