English
Related papers

Related papers: Calibrating Ensembles for Scalable Uncertainty Qua…

200 papers

Standard deep learning methods, such as Ensemble Models, Bayesian Neural Networks and Quantile Regression Models provide estimates to prediction uncertainties for data-driven deep learning models. However, they can be limited in their…

Artificial intelligence (AI) systems accelerate medical workflows and improve diagnostic accuracy in healthcare, serving as second-opinion systems. However, the unpredictability of AI errors poses a significant challenge, particularly in…

A probabilistic model is said to be calibrated if its predicted probabilities match the corresponding empirical frequencies. Calibration is important for uncertainty quantification and decision making in safety-critical applications. While…

Machine Learning · Computer Science 2020-07-01 Anusri Pampari , Stefano Ermon

Image reconstruction methods based on deep neural networks have shown outstanding performance, equalling or exceeding the state-of-the-art results of conventional approaches, but often do not provide uncertainty information about the…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Riccardo Barbano , Željko Kereta , Chen Zhang , Andreas Hauptmann , Simon Arridge , Bangti Jin

Uncertainty quantification is essential for scientific analysis, as it allows for the evaluation and interpretation of variability and reliability in complex systems and datasets. In their original form, multivariate statistical regression…

Uncertainty Quantification (UQ) is pivotal in enhancing the robustness, reliability, and interpretability of Machine Learning (ML) systems for healthcare, optimizing resources and improving patient care. Despite the emergence of ML-based…

Machine Learning · Computer Science 2025-05-07 L. Julián Lechuga López , Shaza Elsharief , Dhiyaa Al Jorf , Firas Darwish , Congbo Ma , Farah E. Shamout

Convolutional image classifiers can achieve high predictive accuracy, but quantifying their uncertainty remains an unresolved challenge, hindering their deployment in consequential settings. Existing uncertainty quantification techniques,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Anastasios Angelopoulos , Stephen Bates , Jitendra Malik , Michael I. Jordan

In this paper, we introduce a new technique that combines two popular methods to estimate uncertainty in object detection. Quantifying uncertainty is critical in real-world robotic applications. Traditional detection models can be ambiguous…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Zongyao Lyu , Nolan B. Gutierrez , William J. Beksi

Assessing uncertainty is an important step towards ensuring the safety and reliability of machine learning systems. Existing uncertainty estimation techniques may fail when their modeling assumptions are not met, e.g. when the data…

Machine Learning · Computer Science 2017-01-24 Volodymyr Kuleshov , Stefano Ermon

Scientific imaging problems are often severely ill-posed, and hence have significant intrinsic uncertainty. Accurately quantifying the uncertainty in the solutions to such problems is therefore critical for the rigorous interpretation of…

Image and Video Processing · Electrical Eng. & Systems 2024-10-22 Julian Tachella , Marcelo Pereyra

In safety-critical applications a probabilistic model is usually required to be calibrated, i.e., to capture the uncertainty of its predictions accurately. In multi-class classification, calibration of the most confident predictions only is…

Machine Learning · Statistics 2022-09-30 David Widmann , Fredrik Lindsten , Dave Zachariah

Estimates of predictive uncertainty are important for accurate model-based planning and reinforcement learning. However, predictive uncertainties---especially ones derived from modern deep learning systems---can be inaccurate and impose a…

Machine Learning · Computer Science 2019-06-21 Ali Malik , Volodymyr Kuleshov , Jiaming Song , Danny Nemer , Harlan Seymour , Stefano Ermon

Image segmentation is a critical step in computational biomedical image analysis, typically evaluated using metrics like the Dice coefficient during training and validation. However, in clinical settings without manual annotations,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Sikha O K , Meritxell Riera-Marín , Adrian Galdran , Javier García Lopez , Julia Rodríguez-Comas , Gemma Piella , Miguel A. González Ballester

Neural networks have proven successful at learning from complex data distributions by acting as universal function approximators. However, they are often overconfident in their predictions, which leads to inaccurate and miscalibrated…

Machine Learning · Computer Science 2021-02-23 Jeffrey Willette , Juho Lee , Sung Ju Hwang

We present a simple comparative framework for testing and developing uncertainty modeling in uncertain marching cubes implementations. The selection of a model to represent the probability distribution of uncertain values directly…

Human-Computer Interaction · Computer Science 2024-09-16 Robert Sisneros , Tushar M. Athawale , David Pugmire , Kenneth Moreland

Medical image segmentation is inherently uncertain. For a given image, there may be multiple plausible segmentation hypotheses, and physicians will often disagree on lesion and organ boundaries. To be suited to real-world application,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 João Lourenço Silva , Arlindo L. Oliveira

Deep learning (DL) has shown great potential in medical image enhancement problems, such as super-resolution or image synthesis. However, to date, little consideration has been given to uncertainty quantification over the output image. Here…

We present a critical survey on the consistency of uncertainty quantification used in deep learning and highlight partial uncertainty coverage and many inconsistencies. We then provide a comprehensive and statistically consistent framework…

Machine Learning · Computer Science 2026-01-14 Peter Jan van Leeuwen , J. Christine Chiu , C. Kevin Yang

Reliable uncertainty quantification is crucial for trustworthy decision-making and the deployment of AI models in medical imaging. While prior work has explored the ability of neural networks to quantify predictive, epistemic, and aleatoric…

Machine Learning · Statistics 2025-08-07 Simon Baur , Wojciech Samek , Jackie Ma

Seismic inversion is essential for geophysical exploration and geological assessment, but it is inherently subject to significant uncertainty. This uncertainty stems primarily from the limited information provided by observed seismic data,…

Geophysics · Physics 2024-09-12 Luping Qu , Mauricio Araya-Polo , Laurent Demanet