English
Related papers

Related papers: Controlled Dropout for Uncertainty Estimation

200 papers

Uncertainty approximation in text classification is an important area with applications in domain adaptation and interpretability. One of the most widely used uncertainty approximation methods is Monte Carlo (MC) Dropout, which is…

Machine Learning · Computer Science 2023-07-20 Andreas Nugaard Holm , Dustin Wright , Isabelle Augenstein

Detecting surface landmines and unexploded ordnances (UXOs) using deep learning has shown promise in humanitarian demining. However, deterministic neural networks can be vulnerable to noisy conditions and adversarial attacks, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Sagar Lekhak , Emmett J. Ientilucci , Dimah Dera , Susmita Ghosh

Monte Carlo (MC) dropout is a simple and efficient ensembling method that can improve the accuracy and confidence calibration of high-capacity deep neural network models. However, MC dropout is not as effective as more compute-intensive…

Machine Learning · Computer Science 2021-06-10 Zhilu Zhang , Vianne R. Gao , Mert R. Sabuncu

Recently, there has been a significant amount of interest in satellite telemetry anomaly detection (AD) using neural networks (NN). For AD purposes, the current approaches focus on either forecasting or reconstruction of the time series,…

Machine Learning · Computer Science 2022-11-29 Mohammad Amin Maleki Sadr , Yeying Zhu , Peng Hu

Quantification of uncertainty is one of the most promising approaches to establish safe machine learning. Despite its importance, it is far from being generally solved, especially for neural networks. One of the most commonly used…

Machine Learning · Computer Science 2021-01-11 Joachim Sicking , Maram Akila , Maximilian Pintz , Tim Wirtz , Asja Fischer , Stefan Wrobel

The Monte Carlo (MC) method is the most common technique used for uncertainty quantification, due to its simplicity and good statistical results. However, its computational cost is extremely high, and, in many cases, prohibitive.…

Computation · Statistics 2021-05-21 A. Cunha , R. Nasser , R. Sampaio , H. Lopes , K. Breitman

Accurate uncertainty estimation is crucial for deploying neural networks in risk-sensitive applications such as medical diagnosis. Monte Carlo Dropout is a widely used technique for approximating predictive uncertainty by performing…

Machine Learning · Computer Science 2025-06-05 Tal Zeevi , Ravid Shwartz-Ziv , Yann LeCun , Lawrence H. Staib , John A. Onofrey

Uncertainty-aware semantic segmentation of the point clouds includes the predictive uncertainty estimation and the uncertainty-guided model optimization. One key challenge in the task is the efficiency of point-wise predictive distribution…

Computer Vision and Pattern Recognition · Computer Science 2022-01-20 Chao Qi , Jianqin Yin

Missing instances in time series data impose a significant challenge to deep learning models, particularly in regression tasks. In the Earth Observation field, satellite failure or cloud occlusion frequently results in missing time-steps,…

Machine Learning · Computer Science 2025-09-12 Miro Miranda , Francisco Mena , Andreas Dengel

The uncertainty measurement of classifiers' predictions is especially important in applications such as medical diagnoses that need to ensure limited human resources can focus on the most uncertain predictions returned by machine learning…

Machine Learning · Computer Science 2019-07-18 Xuchao Zhang , Fanglan Chen , Chang-Tien Lu , Naren Ramakrishnan

Accurately predicting customer Lifetime Value (LTV) is crucial for companies to optimize their revenue strategies. Traditional deep learning models for LTV prediction are effective but typically provide only point estimates and fail to…

Machine Learning · Computer Science 2024-11-26 Xinzhe Cao , Yadong Xu , Xiaofeng Yang

Deep neural networks (DNNs) are known for their high prediction performance, especially in perceptual tasks such as object recognition or autonomous driving. Still, DNNs are prone to yield unreliable predictions when encountering completely…

Machine Learning · Computer Science 2020-07-08 Kai Brach , Beate Sick , Oliver Dürr

Understanding decisions made by neural networks is key for the deployment of intelligent systems in real world applications. However, the opaque decision making process of these systems is a disadvantage where interpretability is essential.…

Machine Learning · Computer Science 2023-04-12 Kai Fischer , Jonas Schneider

Deploying deep learning models in safety-critical applications remains a very challenging task, mandating the provision of assurances for the dependable operation of these models. Uncertainty quantification (UQ) methods estimate the model's…

Machine Learning · Computer Science 2024-01-23 Daniel Bethell , Simos Gerasimou , Radu Calinescu

Despite of its importance for safe machine learning, uncertainty quantification for neural networks is far from being solved. State-of-the-art approaches to estimate neural uncertainties are often hybrid, combining parametric models with…

Machine Learning · Computer Science 2021-12-03 Joachim Sicking , Maram Akila , Maximilian Pintz , Tim Wirtz , Asja Fischer , Stefan Wrobel

Each year a growing number of wind farms are being added to power grids to generate electricity. The power curve of a wind turbine, which exhibits the relationship between generated power and wind speed, plays a major role in assessing the…

Neural and Evolutionary Computing · Computer Science 2021-06-10 Farzad Karami , Nasser Kehtarnavaz , Mario Rotea

Computational color constancy is a preprocessing step used in many camera systems. The main aim is to discount the effect of the illumination on the colors in the scene and restore the original colors of the objects. Recently, several deep…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Firas Laakom , Jenni Raitoharju , Alexandros Iosifidis , Jarno Nikkanen , Moncef Gabbouj

Neural networks are lately more and more often being used in the context of data-driven control, as an approximate model of the true system dynamics. Model Predictive Control (MPC) adopts this practise leading to neural MPC strategies. This…

Systems and Control · Electrical Eng. & Systems 2024-06-05 Spyridon Syntakas , Kostas Vlachos

With the rise of intelligent applications, such as self-driving cars and augmented reality, the security and reliability of wireless communication systems have become increasingly crucial. One of the most critical components of ensuring a…

Cryptography and Security · Computer Science 2023-05-05 Ferhat Ozgur Catak , Umit Cali , Murat Kuzlu , Salih Sarp

Bayesian Neural Networks (BNN) have recently emerged in the Deep Learning world for dealing with uncertainty estimation in classification tasks, and are used in many application domains such as astrophysics, autonomous driving...BNN assume…

Machine Learning · Computer Science 2021-02-04 Claire Theobald , Frédéric Pennerath , Brieuc Conan-Guez , Miguel Couceiro , Amedeo Napoli