English
Related papers

Related papers: Dropout Injection at Test Time for Post Hoc Uncert…

200 papers

Uncertainty quantification is essential for robotic perception, as overconfident or point estimators can lead to collisions and damages to the environment and the robot. In this paper, we evaluate scalable approaches to uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Javier Rodríguez-Puigvert , Rubén Martínez-Cantín , Javier Civera

Dropout is used as a practical tool to obtain uncertainty estimates in large vision models and reinforcement learning (RL) tasks. But to obtain well-calibrated uncertainty estimates, a grid-search over the dropout probabilities is necessary…

Machine Learning · Statistics 2017-05-23 Yarin Gal , Jiri Hron , Alex Kendall

Dropout, a simple and effective way to train deep neural networks, has led to a number of impressive empirical successes and spawned many recent theoretical investigations. However, the gap between dropout's training and inference phases,…

Machine Learning · Computer Science 2017-02-17 Xuezhe Ma , Yingkai Gao , Zhiting Hu , Yaoliang Yu , Yuntian Deng , Eduard Hovy

We propose an efficient way to output better calibrated uncertainty scores from neural networks. The Distilled Dropout Network (DDN) makes standard (non-Bayesian) neural networks more introspective by adding a new training loss which…

Computer Vision and Pattern Recognition · Computer Science 2018-09-28 Corina Gurau , Alex Bewley , Ingmar Posner

Neural networks are lately more and more often being used in the context of data-driven control, as an approximate model of the true system dynamics. Model Predictive Control (MPC) adopts this practise leading to neural MPC strategies. This…

Systems and Control · Electrical Eng. & Systems 2024-06-05 Spyridon Syntakas , Kostas Vlachos

Dropout has been commonly used to quantify prediction uncertainty, i.e, the variations of model predictions on a given input example. However, using dropout in practice can be expensive as it requires running dropout inferences many times.…

Machine Learning · Computer Science 2022-06-20 Haichao Yu , Zhe Chen , Dong Lin , Gil Shamir , Jie Han

Bayesian Inference offers principled tools to tackle many critical problems with modern neural networks such as poor calibration and generalization, and data inefficiency. However, scaling Bayesian inference to large architectures is…

With the advancements made in deep learning, computer vision problems like object detection and segmentation have seen a great improvement in performance. However, in many real-world applications such as autonomous driving vehicles, the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Kumari Deepshikha , Sai Harsha Yelleni , P. K. Srijith , C Krishna Mohan

Transformer-based language models are widely deployed for reasoning, yet their behavior under inference-time stochasticity remains underexplored. While dropout is common during training, its inference-time effects via Monte Carlo sampling…

Machine Learning · Computer Science 2026-03-19 Antônio Junior Alves Caiado , Michael Hahsler

The memorization effect of deep learning hinders its performance to effectively generalize on test set when learning with noisy labels. Prior study has discovered that epistemic uncertainty techniques are robust when trained with noisy…

Machine Learning · Computer Science 2021-03-23 Purvi Goel , Li Chen

Detecting surface landmines and unexploded ordnances (UXOs) using deep learning has shown promise in humanitarian demining. However, deterministic neural networks can be vulnerable to noisy conditions and adversarial attacks, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Sagar Lekhak , Emmett J. Ientilucci , Dimah Dera , Susmita Ghosh

Dropout is a very effective way of regularizing neural networks. Stochastically "dropping out" units with a certain probability discourages over-specific co-adaptations of feature detectors, preventing overfitting and improving network…

Neural and Evolutionary Computing · Computer Science 2017-08-04 Pietro Morerio , Jacopo Cavazza , Riccardo Volpi , Rene Vidal , Vittorio Murino

Missing instances in time series data impose a significant challenge to deep learning models, particularly in regression tasks. In the Earth Observation field, satellite failure or cloud occlusion frequently results in missing time-steps,…

Machine Learning · Computer Science 2025-09-12 Miro Miranda , Francisco Mena , Andreas Dengel

Uncertainty approximation in text classification is an important area with applications in domain adaptation and interpretability. One of the most widely used uncertainty approximation methods is Monte Carlo (MC) Dropout, which is…

Machine Learning · Computer Science 2023-07-20 Andreas Nugaard Holm , Dustin Wright , Isabelle Augenstein

The uncertainty measurement of classifiers' predictions is especially important in applications such as medical diagnoses that need to ensure limited human resources can focus on the most uncertain predictions returned by machine learning…

Machine Learning · Computer Science 2019-07-18 Xuchao Zhang , Fanglan Chen , Chang-Tien Lu , Naren Ramakrishnan

Massive Open Online Courses (MOOCs) have become a popular choice for e-learning thanks to their great flexibility. However, due to large numbers of learners and their diverse backgrounds, it is taxing to offer real-time support. Learners…

Computation and Language · Computer Science 2021-11-16 Jialin Yu , Laila Alrajhi , Anoushka Harit , Zhongtian Sun , Alexandra I. Cristea , Lei Shi

As deep learning applications are becoming more and more pervasive in robotics, the question of evaluating the reliability of inferences becomes a central question in the robotics community. This domain, known as predictive uncertainty, has…

Machine Learning · Statistics 2019-08-21 Michel Moukari , Loïc Simon , Sylvaine Picard , Frédéric Jurie

Accurately predicting customer Lifetime Value (LTV) is crucial for companies to optimize their revenue strategies. Traditional deep learning models for LTV prediction are effective but typically provide only point estimates and fail to…

Machine Learning · Computer Science 2024-11-26 Xinzhe Cao , Yadong Xu , Xiaofeng Yang

Accurate proton dose calculation using Monte Carlo (MC) is computationally demanding in workflows like robust optimisation, adaptive replanning, and probabilistic inference, which require repeated evaluations. To address this, we develop a…

Machine Learning · Statistics 2025-09-24 Aaron Pim , Tristan Pryer

To obtain uncertainty estimates with real-world Bayesian deep learning models, practical inference approximations are needed. Dropout variational inference (VI) for example has been used for machine vision and medical applications, but VI…

Machine Learning · Computer Science 2017-03-09 Yingzhen Li , Yarin Gal