English
Related papers

Related papers: QUTCC: Quantile Uncertainty Training and Conformal…

200 papers

Uncertainty quantification (UQ) has become critical for evaluating the reliability of artificial intelligence systems, especially in medical image segmentation. This study addresses the interpretability of instance-wise uncertainty values…

Assessing the quality of aleatoric uncertainty estimates from uncertainty quantification (UQ) deep learning methods is important in scientific contexts, where uncertainty is physically meaningful and important to characterize and interpret…

Machine Learning · Computer Science 2024-11-14 Rebecca Nevin , Aleksandra Ćiprijanović , Brian D. Nord

This paper explores uncertainty quantification (UQ) as an indicator of the trustworthiness of automated deep-learning (DL) tools in the context of white matter lesion (WML) segmentation from magnetic resonance imaging (MRI) scans of…

Given that machine learning algorithms are increasingly being deployed to aid in high stakes decision-making, uncertainty quantification methods that wrap around these black box models such as conformal prediction have received much…

Machine Learning · Statistics 2026-02-09 Kayla E. Scharfstein , Arun Kumar Kuchibhotla

Conformal prediction, a post-hoc, distribution-free, finite-sample method of uncertainty quantification that offers formal coverage guarantees under the assumption of data exchangeability. Unfortunately, the resulting uncertainty regions…

Machine Learning · Computer Science 2026-04-21 Nikolaos Bousias , Lars Lindemann , George Pappas

Current instance segmentation models achieve high performance on average predictions, but lack principled uncertainty quantification: their outputs are not calibrated, and there is no guarantee that a predicted mask is close to the ground…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Kerri Lu , Dan M. Kluger , Stephen Bates , Sherrie Wang

Deterministic uncertainty quantification (UQ) in deep learning aims to estimate uncertainty with a single pass through a network by leveraging outputs from the network's feature extractor. Existing methods require that the feature extractor…

Machine Learning · Computer Science 2025-01-10 Felix Jimenez , Matthias Katzfuss

Uncertainty quantification is necessary for developers, physicians, and regulatory agencies to build trust in machine learning predictors and improve patient care. Beyond measuring uncertainty, it is crucial to express it in clinically…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Jacopo Teneggi , J Webster Stayman , Jeremias Sulam

Contrastive approaches to representation learning have recently shown great promise. In contrast to generative approaches, these contrastive models learn a deterministic encoder with no notion of uncertainty or confidence. In this paper, we…

Machine Learning · Computer Science 2020-10-06 Mike Wu , Noah Goodman

Uncertainty quantification in time series prediction is challenging due to the temporal dependence and distribution shift on sequential data. Conformal inference provides a pivotal and flexible instrument for assessing the uncertainty of…

Machine Learning · Statistics 2025-09-09 Junxi Wu , Dongjian Hu , Yajie Bao , Shu-Tao Xia , Changliang Zou

Accurate uncertainty quantification in large language models (LLMs) is essential for reliable confidence estimation, yet fine-tuned LLMs often become overconfident under limited adaptation data. Existing uncertainty methods for PEFT-based…

Machine Learning · Computer Science 2026-05-15 Ruijia Niu , Dongxia Wu , Rose Yu , Yi-An Ma

Defects are unavoidable in casting production owing to the complexity of the casting process. While conventional human-visual inspection of casting products is slow and unproductive in mass productions, an automatic and reliable defect…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Maryam Habibpour , Hassan Gharoun , AmirReza Tajally , Afshar Shamsi , Hamzeh Asgharnezhad , Abbas Khosravi , Saeid Nahavandi

We address the problem of uncertainty calibration. While standard deep neural networks typically yield uncalibrated predictions, calibrated confidence scores that are representative of the true likelihood of a prediction can be achieved…

Machine Learning · Computer Science 2021-06-24 Christian Tomani , Sebastian Gruber , Muhammed Ebrar Erdem , Daniel Cremers , Florian Buettner

Conformal prediction (CP), a distribution-free uncertainty quantification (UQ) framework, reliably provides valid predictive inference for black-box models. CP constructs prediction sets that contain the true output with a specified…

Machine Learning · Computer Science 2025-03-12 Xiaofan Zhou , Baiting Chen , Yu Gui , Lu Cheng

Unsupervised image clustering methods often introduce alternative objectives to indirectly train the model and are subject to faulty predictions and overconfident results. To overcome these challenges, the current research proposes an…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Sungwon Park , Sungwon Han , Sundong Kim , Danu Kim , Sungkyu Park , Seunghoon Hong , Meeyoung Cha

Deep neural networks are increasingly being used for the analysis of medical images. However, most works neglect the uncertainty in the model's prediction. We propose an uncertainty-aware deep kernel learning model which permits the…

Machine Learning · Computer Science 2021-06-11 Zhiliang Wu , Yinchong Yang , Jindong Gu , Volker Tresp

Most uncertainty quantification (UQ) approaches provide a single scalar value as a measure of model reliability. However, different uncertainty measures could provide complementary information on the prediction confidence. Even measures…

Quantifying uncertainty of predictions has been identified as one way to develop more trustworthy artificial intelligence (AI) models beyond conventional reporting of performance metrics. When considering their role in a clinical decision…

Imaging through scattering is an important, yet challenging problem. Tremendous progress has been made by exploiting the deterministic input-output "transmission matrix" for a fixed medium. However, this "one-to-one" mapping is highly…

Image and Video Processing · Electrical Eng. & Systems 2018-09-27 Yunzhe Li , Yujia Xue , Lei Tian

Neural networks (NNs) are currently changing the computational paradigm on how to combine data with mathematical laws in physics and engineering in a profound way, tackling challenging inverse and ill-posed problems not solvable with…

Machine Learning · Computer Science 2023-02-08 Apostolos F Psaros , Xuhui Meng , Zongren Zou , Ling Guo , George Em Karniadakis