English
Related papers

Related papers: A Comparative Study on Multi-task Uncertainty Quan…

200 papers

A rise in popularity of Deep Neural Networks (DNNs), attributed to more powerful GPUs and widely available datasets, has seen them being increasingly used within safety-critical domains. One such domain, self-driving, has benefited from…

Machine Learning · Computer Science 2018-11-19 Rhiannon Michelmore , Marta Kwiatkowska , Yarin Gal

Deep Ensemble (DE) is an effective alternative to Bayesian neural networks for uncertainty quantification in deep learning. The uncertainty of DE is usually conveyed by the functional inconsistency among the ensemble members, say, the…

Machine Learning · Computer Science 2022-05-03 Zhijie Deng , Feng Zhou , Jianfei Chen , Guoqiang Wu , Jun Zhu

Ensemble disagreement is widely used as a proxy for epistemic uncertainty in medical image segmentation. In practice, many studies form ensembles via K-fold cross-validation (CV), yet refer to them as ``deep ensembles'' (DE). Because CV…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Tristan Kirscher , Markus Bujotzek , Yannick Kirchhoff , Maximilian Rokuss , Fabian Isensee , Kim-Celine Kahl , Balint Kovacs , Klaus Maier-Hein

While Deep Neural Networks (DNNs) achieve state-of-the-art accuracy in various applications, they often fall short in accurately estimating their predictive uncertainty and, in turn, fail to recognize when these predictions may be wrong.…

Machine Learning · Computer Science 2020-07-22 Ankur Mallick , Chaitanya Dwivedi , Bhavya Kailkhura , Gauri Joshi , T. Yong-Jin Han

Ensembles improve prediction performance and allow uncertainty quantification by aggregating predictions from multiple models. In deep ensembling, the individual models are usually black box neural networks, or recently, partially…

Machine Learning · Statistics 2022-05-26 Lucas Kook , Andrea Götschi , Philipp FM Baumann , Torsten Hothorn , Beate Sick

Deep neural networks are in the limelight of machine learning with their excellent performance in many data-driven applications. However, they can lead to inaccurate predictions when queried in out-of-distribution data points, which can…

Machine Learning · Computer Science 2023-03-01 Yana Stoyanova , Soroush Ghandi , Maryam Tavakol

Deep neural networks have become the default choice for many of the machine learning tasks such as classification and regression. Dropout, a method commonly used to improve the convergence of deep neural networks, generates an ensemble of…

Machine Learning · Statistics 2019-04-11 Tal Kachman , Michal Moshkovitz , Michal Rosen-Zvi

Depth information is important for autonomous systems to perceive environments and estimate their own state. Traditional depth estimation methods, like structure from motion and stereo vision matching, are built on feature correspondences…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Chaoqiang Zhao , Qiyu Sun , Chongzhen Zhang , Yang Tang , Feng Qian

We introduce inherent measures for effective quality control of brain segmentation based on a Bayesian fully convolutional neural network, using model uncertainty. Monte Carlo samples from the posterior distribution are efficiently…

Computer Vision and Pattern Recognition · Computer Science 2018-06-11 Abhijit Guha Roy , Sailesh Conjeti , Nassir Navab , Christian Wachinger

Deep learning-based support systems have demonstrated encouraging results in numerous clinical applications involving the processing of time series data. While such systems often are very accurate, they have no inherent mechanism for…

Machine Learning · Computer Science 2020-12-16 Kristoffer Wickstrøm , Karl Øyvind Mikalsen , Michael Kampffmeyer , Arthur Revhaug , Robert Jenssen

Speech classification has attracted increasing attention due to its wide applications, particularly in classifying physical and mental states. However, these tasks are challenging due to the high variability in speech signals. Ensemble…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-25 Bagus Tris Atmaja , Felix Burkhardt

This work delves into unsupervised monocular depth estimation in endoscopy, which leverages adjacent frames to establish a supervisory signal during the training phase. For many clinical applications, e.g., surgical navigation, temporally…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Shuwei Shao , Zhongcai Pei , Weihai Chen , Xingming Wu , Zhong Liu

The topic of deep learning has seen a surge of interest in recent years both within and outside of the field of Statistics. Deep models leverage both nonlinearity and interaction effects to provide superior predictions in many cases when…

Methodology · Statistics 2020-09-18 Paul A. Parker , Scott H. Holan

Depth estimation from a single image represents a very exciting challenge in computer vision. While other image-based depth sensing techniques leverage on the geometry between different viewpoints (e.g., stereo or structure from motion),…

Computer Vision and Pattern Recognition · Computer Science 2018-10-29 Pierluigi Zama Ramirez , Matteo Poggi , Fabio Tosi , Stefano Mattoccia , Luigi Di Stefano

Single-task learning in artificial neural networks will be able to learn the model very well, and the benefits brought by transferring knowledge thus become limited. In this regard, when the number of tasks increases (e.g., semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Mohammad R. Bayanlou , Mehdi Khoshboresh-Masouleh

Uncertainty quantification is an important and challenging problem in deep learning. Previous methods rely on dropout layers which are not present in modern deep architectures or batch normalization which is sensitive to batch sizes. In…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Lukasz Wandzik , Raul Vicente Garcia , Jörg Krüger

Deep Ensembles (DE) are a prominent approach for achieving excellent performance on key metrics such as accuracy, calibration, uncertainty estimation, and out-of-distribution detection. However, hardware limitations of real-world systems…

Monocular depth estimation is often described as an ill-posed and inherently ambiguous problem. Estimating depth from 2D images is a crucial step in scene reconstruction, 3Dobject recognition, segmentation, and detection. The problem can be…

Computer Vision and Pattern Recognition · Computer Science 2019-01-29 Amlaan Bhoi

Monocular depth estimation is one of the fundamental tasks in environmental perception and has achieved tremendous progress in virtue of deep learning. However, the performance of trained models tends to degrade or deteriorate when employed…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Qiyu Sun , Gary G. Yen , Yang Tang , Chaoqiang Zhao

Deep learning (DL) has shown great potential in medical image enhancement problems, such as super-resolution or image synthesis. However, to date, little consideration has been given to uncertainty quantification over the output image. Here…