English
Related papers

Related papers: Deep Sub-Ensembles for Fast Uncertainty Estimation…

200 papers

The recent success of Deep Neural Networks (DNNs) has drastically improved the state of the art for many application domains. While achieving high accuracy performance, deploying state-of-the-art DNNs is a challenge since they typically…

Neural and Evolutionary Computing · Computer Science 2018-01-24 Hokchhay Tann , Soheil Hashemi , Sherief Reda

This study aims to comprehensively investigate the deep ensemble approach, an approximate Bayesian inference, in the multi-output regression task for predicting the aerodynamic performance of a missile configuration. To this end, the effect…

Machine Learning · Computer Science 2023-11-27 Sunwoong Yang , Kwanjung Yee

Deep-learning-based data-driven forecasting methods have produced impressive results for traffic forecasting. A major limitation of these methods, however, is that they provide forecasts without estimates of uncertainty, which are critical…

Machine Learning · Computer Science 2022-04-07 Tanwi Mallick , Prasanna Balaprakash , Jane Macfarlane

This paper aims to accelerate the test-time computation of deep convolutional neural networks (CNNs). Unlike existing methods that are designed for approximating linear filters or linear responses, our method takes the nonlinear units into…

Computer Vision and Pattern Recognition · Computer Science 2014-11-18 Xiangyu Zhang , Jianhua Zou , Xiang Ming , Kaiming He , Jian Sun

Deep ensembles have emerged as a powerful technique for improving predictive performance and enhancing model robustness across various applications by leveraging model diversity. However, traditional deep ensemble methods are often…

Ensemble methods are commonly used to enhance the generalization performance of machine learning models. However, they present a challenge in deep learning systems due to the high computational overhead required to train an ensemble of deep…

Machine Learning · Computer Science 2023-05-24 Hao Guo , Jiyong Jin , Bin Liu

Deep learning models are extensively used in various safety critical applications. Hence these models along with being accurate need to be highly reliable. One way of achieving this is by quantifying uncertainty. Bayesian methods for UQ…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Swaroop Bhandary K , Nico Hochgeschwender , Paul Plöger , Frank Kirchner , Matias Valdenegro-Toro

Several neurodegenerative diseases involve the accumulation of cellular DNA damage. Comet assays are a popular way of estimating the extent of DNA damage. Current literature on the use of deep learning to quantify DNA damage presents an…

Quantitative Methods · Quantitative Biology 2021-12-28 Srikanth Namuduri , Prateek Mehta , Lise Barbe , Stephanie Lam , Zohreh Faghihmonzavi , Steve Finkbeiner , Shekhar Bhansali

Classical problems in computational physics such as data-driven forecasting and signal reconstruction from sparse sensors have recently seen an explosion in deep neural network (DNN) based algorithmic approaches. However, most DNN models do…

Machine Learning · Computer Science 2023-02-21 Romit Maulik , Romain Egele , Krishnan Raghavan , Prasanna Balaprakash

Neural networks predictions are unreliable when the input sample is out of the training distribution or corrupted by noise. Being able to detect such failures automatically is fundamental to integrate deep learning algorithms into robotics.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Antonio Loquercio , Mattia Segù , Davide Scaramuzza

Epistemic uncertainty is crucial for safety-critical applications and data acquisition tasks. Yet, we find an important phenomenon in deep learning models: an epistemic uncertainty collapse as model complexity increases, challenging the…

Machine Learning · Computer Science 2025-05-27 Andreas Kirsch

The inference structures and computational complexity of existing deep neural networks, once trained, are fixed and remain the same for all test images. However, in practice, it is highly desirable to establish a progressive structure for…

Computer Vision and Pattern Recognition · Computer Science 2018-04-27 Zhi Zhang , Guanghan Ning , Yigang Cen , Yang Li , Zhiqun Zhao , Hao Sun , Zhihai He

This proposes a novel ensemble deep learning-based model to accurately classify, detect and localize different defect categories for aggressive pitches and thin resists (High NA applications).In particular, we train RetinaNet models using…

Image and Video Processing · Electrical Eng. & Systems 2022-06-29 Bappaditya Deya , Dipam Goswamif , Sandip Haldera , Kasem Khalilb , Philippe Leraya , Magdy A. Bayoumi

Uncertainty quantification for deep learning is a challenging open problem. Bayesian statistics offer a mathematically grounded framework to reason about uncertainties; however, approximate posteriors for modern neural networks still…

Machine Learning · Statistics 2020-01-23 Nicolas Brosse , Carlos Riquelme , Alice Martin , Sylvain Gelly , Éric Moulines

In this paper, we approach the problem of uncertainty quantification in deep learning through a predictive framework, which captures uncertainty in model parameters by specifying our assumptions about the predictive distribution of unseen…

Machine Learning · Statistics 2024-03-20 Luhuan Wu , Sinead Williamson

Brain vessel segmentation of MR scans is a critical step in the diagnosis of cerebrovascular diseases. Due to the fine vessel structure, manual vessel segmentation is time consuming. Therefore, automatic deep learning (DL) based…

Image and Video Processing · Electrical Eng. & Systems 2025-03-31 Omini Rathore , Richard Paul , Abigail Morrison , Hanno Scharr , Elisabeth Pfaehler

To address the increasing need for efficient and accurate content moderation, we propose an efficient and lightweight deep classification ensemble structure. Our approach is based on a combination of simple visual features, designed for…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Mohammad Hosseini , Mahmudul Hasan

Artificial neural networks have been successfully applied to a variety of machine learning tasks, including image recognition, semantic segmentation, and machine translation. However, few studies fully investigated ensembles of artificial…

Machine Learning · Statistics 2017-04-07 Cheng Ju , Aurélien Bibaut , Mark J. van der Laan

Efficient and accurate joint representation of a collection of images, that belong to the same class, is a major research challenge for practical image set classification. Existing methods either make prior assumptions about the data…

Computer Vision and Pattern Recognition · Computer Science 2015-04-02 Muhammad Uzair , Faisal Shafait , Bernard Ghanem , Ajmal Mian

Deep neural networks are powerful predictors for a variety of tasks. However, they do not capture uncertainty directly. Using neural network ensembles to quantify uncertainty is competitive with approaches based on Bayesian neural networks…

Machine Learning · Computer Science 2022-07-05 Romain Egele , Romit Maulik , Krishnan Raghavan , Bethany Lusch , Isabelle Guyon , Prasanna Balaprakash