English
Related papers

Related papers: Fast and reliable uncertainty quantification with …

200 papers

We propose an efficient way to output better calibrated uncertainty scores from neural networks. The Distilled Dropout Network (DDN) makes standard (non-Bayesian) neural networks more introspective by adding a new training loss which…

Computer Vision and Pattern Recognition · Computer Science 2018-09-28 Corina Gurau , Alex Bewley , Ingmar Posner

Deep neural networks (DNNs) achieve promising performance in visual recognition under the independent and identically distributed (IID) hypothesis. In contrast, the IID hypothesis is not universally guaranteed in numerous real-world…

Image and Video Processing · Electrical Eng. & Systems 2023-06-27 Shuai Wang , Zipei Yan , Daoan Zhang , Zhongsen Li , Sirui Wu , Wenxuan Chen , Rui Li

Bringing deep neural networks (DNNs) into safety critical applications such as automated driving, medical imaging and finance, requires a thorough treatment of the model's uncertainties. Training deep neural networks is already resource…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Julian Burghoff , Robin Chan , Hanno Gottschalk , Annika Muetze , Tobias Riedlinger , Matthias Rottmann , Marius Schubert

Uncertainty estimation is critical for numerous applications of deep neural networks and draws growing attention from researchers. Here, we demonstrate an uncertainty quantification approach for deep neural networks used in inverse problems…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Luzhe Huang , Jianing Li , Xiaofu Ding , Yijie Zhang , Hanlong Chen , Aydogan Ozcan

Deep learning (DL) has shown great potential in medical image enhancement problems, such as super-resolution or image synthesis. However, to date, little consideration has been given to uncertainty quantification over the output image. Here…

Traditional deep neural nets (NNs) have shown the state-of-the-art performance in the task of classification in various applications. However, NNs have not considered any types of uncertainty associated with the class probabilities to…

Machine Learning · Computer Science 2019-10-16 Xujiang Zhao , Yuzhe Ou , Lance Kaplan , Feng Chen , Jin-Hee Cho

When incorporating deep neural networks into robotic systems, a major challenge is the lack of uncertainty measures associated with their output predictions. Methods for uncertainty estimation in the output of deep object detectors (DNNs)…

Computer Vision and Pattern Recognition · Computer Science 2019-09-17 Ali Harakeh , Michael Smart , Steven L. Waslander

In this paper, we introduce a new technique that combines two popular methods to estimate uncertainty in object detection. Quantifying uncertainty is critical in real-world robotic applications. Traditional detection models can be ambiguous…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Zongyao Lyu , Nolan B. Gutierrez , William J. Beksi

To achieve high performance of a machine learning (ML) task, a deep learning-based model must implicitly capture the entire distribution from data. Thus, it requires a huge amount of training samples, and data are expected to fully present…

Machine Learning · Computer Science 2021-11-17 Hung Nguyen , Morris Chang

Ensemble learning has proven effective in improving predictive performance and estimating uncertainty in neural networks. However, conventional ensemble methods often suffer from redundant parameter usage and computational inefficiencies…

Machine Learning · Computer Science 2024-12-23 Arnav Kharbanda , Advait Chandorkar

While deep ensembles are widely considered to be the default method for uncertainty quantification in deep learning, their effectiveness for graph-structured data is often simply assumed based on successes in domains like computer vision.…

Machine Learning · Computer Science 2026-05-22 Pedro C. Vieira , Pedro Ribeiro , Viacheslav Borovitskiy

Deep neural networks have achieved outstanding performance over various tasks, but they have a critical issue: over-confident predictions even for completely unknown samples. Many studies have been proposed to successfully filter out these…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Jihyo Kim , Jiin Koo , Sangheum Hwang

In this paper the application of uncertainty modeling to convolutional neural networks is evaluated. A novel method for adjusting the network's predictions based on uncertainty information is introduced. This allows the network to be either…

Computer Vision and Pattern Recognition · Computer Science 2016-12-23 Rene Grzeszick , Sebastian Sudholt , Gernot A. Fink

Efficiently quantifying predictive uncertainty in medical images remains a challenge. While Bayesian neural networks (BNN) offer predictive uncertainty, they require substantial computational resources to train. Although Bayesian…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Zeinab Abboud , Herve Lombaert , Samuel Kadoury

Various approaches have been proposed for out-of-distribution (OOD) detection by augmenting models, input examples, training sets, and optimization objectives. Deviating from existing work, we have a simple hypothesis that standard…

Machine Learning · Computer Science 2022-03-29 Xin Dong , Junfeng Guo , Ang Li , Wei-Te Ting , Cong Liu , H. T. Kung

Uncertainty quantification is a critical aspect of reinforcement learning and deep learning, with numerous applications ranging from efficient exploration and stable offline reinforcement learning to outlier detection in medical…

Machine Learning · Computer Science 2025-03-27 Moritz A. Zanger , Pascal R. Van der Vaart , Wendelin Böhmer , Matthijs T. J. Spaan

Deep neural networks are powerful predictors for a variety of tasks. However, they do not capture uncertainty directly. Using neural network ensembles to quantify uncertainty is competitive with approaches based on Bayesian neural networks…

Machine Learning · Computer Science 2022-07-05 Romain Egele , Romit Maulik , Krishnan Raghavan , Bethany Lusch , Isabelle Guyon , Prasanna Balaprakash

Training a diverse ensemble of models has several practical applications such as providing candidates for model selection with better out-of-distribution (OOD) generalization, and enabling the detection of OOD samples via Bayesian…

Machine Learning · Computer Science 2024-09-26 Alexander Rubinstein , Luca Scimeca , Damien Teney , Seong Joon Oh

An ensemble method that fuses the output decision vectors of multiple feedforward-designed convolutional neural networks (FF-CNNs) to solve the image classification problem is proposed in this work. To enhance the performance of the…

Computer Vision and Pattern Recognition · Computer Science 2019-01-09 Yueru Chen , Yijing Yang , Wei Wang , C. -C. Jay Kuo

Quantifying uncertainty in neural networks is a highly relevant problem which is essential to many applications. The two predominant paradigms to tackle this task are Bayesian neural networks (BNNs) and deep ensembles. Despite some…

Machine Learning · Computer Science 2025-01-31 Gabriel Loaiza-Ganem , Valentin Villecroze , Yixin Wang