English
Related papers

Related papers: Quantifying Epistemic Predictive Uncertainty in Co…

200 papers

Conformal Prediction (CP) stands out as a robust framework for uncertainty quantification, which is crucial for ensuring the reliability of predictions. However, common CP methods heavily rely on data exchangeability, a condition often…

We develop a predictive inference procedure that combines conformal prediction (CP) with unconditional quantile regression (QR) -- a commonly used tool in econometrics that involves regressing the recentered influence function (RIF) of the…

Machine Learning · Computer Science 2023-04-05 Ahmed M. Alaa , Zeshan Hussain , David Sontag

Uncertainty Quantification (UQ) research has primarily focused on closed-book factual question answering (QA), while contextual QA remains unexplored, despite its importance in real-world applications. In this work, we focus on UQ for the…

In this paper, we present a novel approach for conformal prediction (CP), in which we aim to identify a set of promising prediction candidates -- in place of a single prediction. This set is guaranteed to contain a correct answer with high…

Machine Learning · Computer Science 2021-02-03 Adam Fisch , Tal Schuster , Tommi Jaakkola , Regina Barzilay

Credal sets are sets of probability distributions that are considered as candidates for an imprecisely known ground-truth distribution. In machine learning, they have recently attracted attention as an appealing formalism for uncertainty…

Machine Learning · Statistics 2024-02-19 Alireza Javanmardi , David Stutz , Eyke Hüllermeier

Safe deployment of deep neural networks in high-stake real-world applications requires theoretically sound uncertainty quantification. Conformal prediction (CP) is a principled framework for uncertainty quantification of deep models in the…

Machine Learning · Computer Science 2023-03-21 Subhankar Ghosh , Taha Belkhouja , Yan Yan , Janardhan Rao Doppa

Conformal Prediction (CP) is a popular uncertainty quantification method that provides distribution-free, statistically valid prediction sets, assuming that training and test data are exchangeable. In such a case, CP's prediction sets are…

Logic in Computer Science · Computer Science 2024-11-19 Linus Jeary , Tom Kuipers , Mehran Hosseini , Nicola Paoletti

Accurate uncertainty quantification is critical for reliable predictive modeling. Existing methods typically address either aleatoric uncertainty due to measurement noise or epistemic uncertainty resulting from limited data, but not both in…

Machine Learning · Statistics 2026-03-04 Ilia Azizi , Juraj Bodik , Jakob Heiss , Bin Yu

This paper addresses a significant gap in explainable AI: the necessity of interpreting epistemic uncertainty in model explanations. Although current methods mainly focus on explaining predictions, with some including uncertainty, they fail…

Artificial Intelligence · Computer Science 2024-10-10 Helena Löfström , Tuwe Löfström , Johan Hallberg Szabadvary

Conformal Prediction (CP) is a distribution-free method for constructing prediction sets with marginal finite-sample coverage guarantees, making it a suitable framework for reliable uncertainty quantification in safety-critical object…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Christopher Ries , Moussa Kassem Sbeyti , Nicolas Bianco , Nadja Klein

Epistemic uncertainty in neural networks is commonly modeled using two second-order paradigms: distribution-based representations, which rely on posterior parameter distributions, and set-based representations based on credal sets (convex…

Machine Learning · Computer Science 2026-02-27 Kaizheng Wang , Yunjia Wang , Fabio Cuzzolin , David Moens , Hans Hallez , Siu Lun Chau

Quantifying model uncertainty is critical for understanding prediction reliability, yet distinguishing between aleatoric and epistemic uncertainty remains challenging. We extend recent work from classification to regression to provide a…

The calibration of predictive distributions has been widely studied in deep learning, but the same cannot be said about the more specific epistemic uncertainty as produced by Deep Ensembles, Bayesian Deep Networks, or Evidential Deep…

Machine Learning · Computer Science 2024-07-18 Mohammed Fellaji , Frédéric Pennerath , Brieuc Conan-Guez , Miguel Couceiro

Conformal prediction (CP) has become a cornerstone of distribution-free uncertainty quantification, conventionally evaluated by its coverage and interval length. This work critically examines the sufficiency of these standard metrics. We…

Machine Learning · Statistics 2026-01-30 Yizhou Min , Yizhou Lu , Lanqi Li , Zhen Zhang , Jiaye Teng

Uncertainty quantification plays an important role in achieving trustworthy and reliable learning-based computational imaging. Recent advances in generative modeling and Bayesian neural networks have enabled the development of…

Image and Video Processing · Electrical Eng. & Systems 2025-10-07 Canberk Ekmekci , Mujdat Cetin

Modern deep learning based classifiers show very high accuracy on test data but this does not provide sufficient guarantees for safe deployment, especially in high-stake AI applications such as medical diagnosis. Usually, predictions are…

Machine Learning · Computer Science 2022-05-09 David Stutz , Krishnamurthy , Dvijotham , Ali Taylan Cemgil , Arnaud Doucet

Conformal Prediction (CP) is a widely used technique for quantifying uncertainty in machine learning models. In its standard form, CP offers probabilistic guarantees on the coverage of the true label, but it is agnostic to sensitive…

Machine Learning · Computer Science 2025-09-30 Anutam Srinivasan , Aditya T. Vadlamani , Amin Meghrazi , Srinivasan Parthasarathy

Large Reasoning Models (LRMs) have recently demonstrated significant improvements in complex reasoning. While quantifying generation uncertainty in LRMs is crucial, traditional methods are often insufficient because they do not provide…

Artificial Intelligence · Computer Science 2026-04-16 Yangyi Li , Chenxu Zhao , Mengdi Huai

Reliable uncertainty quantification is of critical importance in time series forecasting, yet traditional methods often rely on restrictive distributional assumptions. Conformal prediction (CP) has emerged as a promising distribution-free…

Machine Learning · Computer Science 2026-02-02 Andro Sabashvili

Conformal prediction (CP) is a method for constructing a prediction interval around the output of a fitted model, whose validity does not rely on the model being correct--the CP interval offers a coverage guarantee that is…

Methodology · Statistics 2025-04-17 Aabesh Bhattacharyya , Rina Foygel Barber