English
Related papers

Related papers: ValUES: A Framework for Systematic Validation of U…

200 papers

Automated medical image segmentation inherently involves a certain degree of uncertainty. One key factor contributing to this uncertainty is the ambiguity that can arise in determining the boundaries of a target region of interest,…

Image and Video Processing · Electrical Eng. & Systems 2023-08-28 Qingqiao Hu , Hao Wang , Jing Luo , Yunhao Luo , Zhiheng Zhangg , Jan S. Kirschke , Benedikt Wiestler , Bjoern Menze , Jianguo Zhang , Hongwei Bran Li

Explainability of black-box machine learning models is crucial, in particular when deployed in critical applications such as medicine or autonomous cars. Existing approaches produce explanations for the predictions of models, however, how…

Machine Learning · Computer Science 2021-11-18 Jonas Schulz , Rafael Poyiadzi , Raul Santos-Rodriguez

Ensemble disagreement is widely used as a proxy for epistemic uncertainty in medical image segmentation. In practice, many studies form ensembles via K-fold cross-validation (CV), yet refer to them as ``deep ensembles'' (DE). Because CV…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Tristan Kirscher , Markus Bujotzek , Yannick Kirchhoff , Maximilian Rokuss , Fabian Isensee , Kim-Celine Kahl , Balint Kovacs , Klaus Maier-Hein

We present a deep learning framework for probabilistic pixel-wise semantic segmentation, which we term Bayesian SegNet. Semantic segmentation is an important tool for visual scene understanding and a meaningful measure of uncertainty is…

Computer Vision and Pattern Recognition · Computer Science 2016-10-12 Alex Kendall , Vijay Badrinarayanan , Roberto Cipolla

In recent years, deep neural networks have defined the state-of-the-art in semantic segmentation where their predictions are constrained to a predefined set of semantic classes. They are to be deployed in applications such as automated…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Kira Maag , Tobias Riedlinger

Reliable confidence estimation is a challenging yet fundamental requirement in many risk-sensitive applications. However, modern deep neural networks are often overconfident for their incorrect predictions, i.e., misclassified samples from…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Fei Zhu , Xu-Yao Zhang , Zhen Cheng , Cheng-Lin Liu

Deep neural networks lack interpretability and tend to be overconfident, which poses a serious problem in safety-critical applications like autonomous driving, medical imaging, or machine vision tasks with high demands on reliability.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Steven Landgraf , Kira Wursthorn , Markus Hillemann , Markus Ulrich

Uncertainty quantification complements model predictions by characterizing their reliability, which is essential for high-stakes decision making such as medical image segmentation. However, most existing methods reduce uncertainty to a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 An Sui , Yuzhu Li , Gunter Schumann , Fuping Wu , Xiahai Zhuang

Reliable uncertainty quantification is essential for the use of machine learning in physics, where scientific discoveries depend on validated probabilistic statements. We provide a structured overview of uncertainty quantification in ML for…

Machine Learning · Statistics 2026-05-12 Manuel Haußmann , Ramon Winterhalder , Maria Ubiali

Classification and segmentation are crucial in medical image analysis as they enable accurate diagnosis and disease monitoring. However, current methods often prioritize the mutual learning features and shared model parameters, while…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Kai Ren , Ke Zou , Xianjie Liu , Yidi Chen , Xuedong Yuan , Xiaojing Shen , Meng Wang , Huazhu Fu

The requirement to generate robust robotic platforms is a critical enabling step to allow such platforms to permeate safety-critical applications (i.e., the localization of autonomous platforms in urban environments). One of the primary…

Signal Processing · Electrical Eng. & Systems 2019-08-14 Ryan M. Watson , Jason N. Gross , Clark N. Taylor , Robert C. Leishman

Semantic segmentation is critical for scene understanding but demands costly pixel-wise annotations, attracting increasing attention to semi-supervised approaches to leverage abundant unlabeled data. While semi-supervised segmentation is…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Steven Landgraf , Markus Hillemann , Markus Ulrich

A crucial requirement for reliable deployment of deep learning models for safety-critical applications is the ability to identify out-of-distribution (OOD) data points, samples which differ from the training data and on which a model might…

Machine Learning · Computer Science 2021-06-11 Dennis Ulmer , Giovanni Cinà

Data following an interval structure are increasingly prevalent in many scientific applications. In medicine, clinical events are often monitored between two clinical visits, making the exact time of the event unknown and generating…

Methodology · Statistics 2025-04-01 Carlos García Meixide , Michael R. Kosorok , Marcos Matabuena

Despite recent progress in systematic evaluation frameworks, benchmarking the uncertainty of large language models (LLMs) remains a highly challenging task. Existing methods for benchmarking the uncertainty of LLMs face three key…

Computation and Language · Computer Science 2025-06-05 Xunzhi Wang , Zhuowei Zhang , Gaonan Chen , Qiongyu Li , Bitong Luo , Zhixin Han , Haotian Wang , Zhiyu li , Hang Gao , Mengting Hu

Neural networks make accurate predictions but often fail to provide reliable uncertainty estimates, especially under covariate distribution shifts between training and testing. To address this problem, we propose a Bayesian framework for…

Machine Learning · Statistics 2025-12-22 Yuli Slavutsky , David M. Blei

Deep unrolling is an emerging deep learning-based image reconstruction methodology that bridges the gap between model-based and purely deep learning-based image reconstruction methods. Although deep unrolling methods achieve…

Image and Video Processing · Electrical Eng. & Systems 2022-12-21 Canberk Ekmekci , Mujdat Cetin

Uncertainty quantification is a critical yet unsolved challenge for deep learning, especially for the time series imputation with irregularly sampled measurements. To tackle this problem, we propose a novel framework based on the principles…

Machine Learning · Computer Science 2023-06-05 Shweta Dahale , Sai Munikoti , Balasubramaniam Natarajan

Uncertainty quantification for deep learning is a challenging open problem. Bayesian statistics offer a mathematically grounded framework to reason about uncertainties; however, approximate posteriors for modern neural networks still…

Machine Learning · Statistics 2020-01-23 Nicolas Brosse , Carlos Riquelme , Alice Martin , Sylvain Gelly , Éric Moulines

Reward models (RMs) are essential for aligning large language models (LLM) with human expectations. However, existing RMs struggle to capture the stochastic and uncertain nature of human preferences and fail to assess the reliability of…

Machine Learning · Computer Science 2025-02-13 Xingzhou Lou , Dong Yan , Wei Shen , Yuzi Yan , Jian Xie , Junge Zhang