English
Related papers

Related papers: Improving accuracy and uncertainty quantification …

200 papers

The quantification of uncertainty is important for the adoption of machine learning, especially to reject out-of-distribution (OOD) data back to human experts for review. Yet progress has been slow, as a balance must be struck between…

Machine Learning · Computer Science 2022-09-12 Derek Everett , Andre T. Nguyen , Luke E. Richards , Edward Raff

Dropout is used as a practical tool to obtain uncertainty estimates in large vision models and reinforcement learning (RL) tasks. But to obtain well-calibrated uncertainty estimates, a grid-search over the dropout probabilities is necessary…

Machine Learning · Statistics 2017-05-23 Yarin Gal , Jiri Hron , Alex Kendall

The uncertainty measurement of classifiers' predictions is especially important in applications such as medical diagnoses that need to ensure limited human resources can focus on the most uncertain predictions returned by machine learning…

Machine Learning · Computer Science 2019-07-18 Xuchao Zhang , Fanglan Chen , Chang-Tien Lu , Naren Ramakrishnan

Dropout as regularization has been used extensively to prevent overfitting for training neural networks. During training, units and their connections are randomly dropped, which could be considered as sampling many different submodels from…

Machine Learning · Computer Science 2022-04-28 Zhaoyuan Yang , Arpit Jain

In classification applications, we often want probabilistic predictions to reflect confidence or uncertainty. Dropout, a commonly used training technique, has recently been linked to Bayesian inference, yielding an efficient way to quantify…

Machine Learning · Computer Science 2019-06-25 Zhilu Zhang , Adrian V. Dalca , Mert R. Sabuncu

Computational color constancy is a preprocessing step used in many camera systems. The main aim is to discount the effect of the illumination on the colors in the scene and restore the original colors of the objects. Recently, several deep…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Firas Laakom , Jenni Raitoharju , Alexandros Iosifidis , Jarno Nikkanen , Moncef Gabbouj

Dropout, a simple and effective way to train deep neural networks, has led to a number of impressive empirical successes and spawned many recent theoretical investigations. However, the gap between dropout's training and inference phases,…

Machine Learning · Computer Science 2017-02-17 Xuezhe Ma , Yingkai Gao , Zhiting Hu , Yaoliang Yu , Yuntian Deng , Eduard Hovy

Calibrated estimates of uncertainty are critical for many real-world computer vision applications of deep learning. While there are several widely-used uncertainty estimation methods, dropout inference stands out for its simplicity and…

Computer Vision and Pattern Recognition · Computer Science 2020-11-09 Yichen Shen , Zhilu Zhang , Mert R. Sabuncu , Lin Sun

Uncertainty quantification is essential for robotic perception, as overconfident or point estimators can lead to collisions and damages to the environment and the robot. In this paper, we evaluate scalable approaches to uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Javier Rodríguez-Puigvert , Rubén Martínez-Cantín , Javier Civera

The memorization effect of deep learning hinders its performance to effectively generalize on test set when learning with noisy labels. Prior study has discovered that epistemic uncertainty techniques are robust when trained with noisy…

Machine Learning · Computer Science 2021-03-23 Purvi Goel , Li Chen

Monte Carlo (MC) dropout is a simple and efficient ensembling method that can improve the accuracy and confidence calibration of high-capacity deep neural network models. However, MC dropout is not as effective as more compute-intensive…

Machine Learning · Computer Science 2021-06-10 Zhilu Zhang , Vianne R. Gao , Mert R. Sabuncu

We propose an efficient way to output better calibrated uncertainty scores from neural networks. The Distilled Dropout Network (DDN) makes standard (non-Bayesian) neural networks more introspective by adding a new training loss which…

Computer Vision and Pattern Recognition · Computer Science 2018-09-28 Corina Gurau , Alex Bewley , Ingmar Posner

We evaluate two different methods for the integration of prediction uncertainty into diagnostic image classifiers to increase patient safety in deep learning. In the first method, Monte Carlo sampling is applied with dropout at test time to…

Image and Video Processing · Electrical Eng. & Systems 2019-08-05 Max-Heinrich Laves , Sontje Ihler , Tobias Ortmaier

Spatially referenced datasets have become increasingly prevalent across many fields, largely driven by advances in data collection methods such as satellite remote sensing. In many applications, predictions at unobserved locations are…

Computation · Statistics 2026-05-19 Isaac Amouzou , Ben Seiyon Lee

It is highly desirable to know how uncertain a model's predictions are, especially for models that are complex and hard to understand as in deep learning. Although there has been a growing interest in using deep learning methods in…

Machine Learning · Computer Science 2024-08-28 Davood Karimi , Simon K. Warfield , Ali Gholipour

Recently, artificial intelligence technologies and algorithms have become a major focus for advancements in treatment planning for radiation therapy. As these are starting to become incorporated into the clinical workflow, a major concern…

Deep neural networks have shown great success in prediction quality while reliable and robust uncertainty estimation remains a challenge. Predictive uncertainty supplements model predictions and enables improved functionality of downstream…

Machine Learning · Computer Science 2021-12-02 Johanna Rock , Tiago Azevedo , René de Jong , Daniel Ruiz-Muñoz , Partha Maji

Deep neural networks are increasingly being used for the analysis of medical images. However, most works neglect the uncertainty in the model's prediction. We propose an uncertainty-aware deep kernel learning model which permits the…

Machine Learning · Computer Science 2021-06-11 Zhiliang Wu , Yinchong Yang , Jindong Gu , Volker Tresp

Deep learning models learn to fit training data while they are highly expected to generalize well to testing data. Most works aim at finding such models by creatively designing architectures and fine-tuning parameters. To adapt to…

Computer Vision and Pattern Recognition · Computer Science 2018-09-10 Tianyang Wang , Jun Huan , Bo Li

Dropout Variational Inference, or Dropout Sampling, has been recently proposed as an approximation technique for Bayesian Deep Learning and evaluated for image classification and regression tasks. This paper investigates the utility of…

Computer Vision and Pattern Recognition · Computer Science 2018-04-19 Dimity Miller , Lachlan Nicholson , Feras Dayoub , Niko Sünderhauf