English
Related papers

Related papers: Conformal Correction for Efficiency May be at Odds…

200 papers

Conformal prediction provides distribution-free prediction sets with finite-sample conditional guarantees. We build upon the RKHS-based framework of Gibbs et al. (2023), which leverages families of covariate shifts to provide approximate…

Methodology · Statistics 2026-05-29 Yating Liu , Yeo Jin Jung , Zixuan Wu , So Won Jeong , Claire Donnat

Conformal prediction (CP) generates a set of predictions for a given test sample such that the prediction set almost always contains the true label (e.g., 99.5\% of the time). CP provides comprehensive predictions on possible labels of a…

Machine Learning · Computer Science 2023-09-12 Yizhe Zhang , Shuo Wang , Yejia Zhang , Danny Z. Chen

In safety-critical applications such as medical imaging and autonomous driving, where decisions have profound implications for patient health and road safety, it is imperative to maintain both high adversarial robustness to protect against…

Machine Learning · Computer Science 2024-05-16 Ziquan Liu , Yufei Cui , Yan Yan , Yi Xu , Xiangyang Ji , Xue Liu , Antoni B. Chan

Reliable confidence measures of metrics derived from medical imaging reconstruction pipelines would improve the standard of decision-making in many clinical workflows. Conformal Prediction (CP) provides a robust framework for producing…

Quantum machine learning seeks to leverage quantum computers to improve upon classical machine learning algorithms. Currently, robust uncertainty quantification methods remain underdeveloped in the quantum domain, despite the critical need…

Machine Learning · Computer Science 2026-05-18 Douglas Spencer , Samual Nicholls , Michele Caprio

Conformal Prediction (CP) is a popular framework for constructing prediction bands with valid coverage in finite samples, while being free of any distributional assumption. A well-known limitation of conformal prediction is the lack of…

Machine Learning · Computer Science 2025-05-28 Louis Allain , Sébastien da Veiga , Brian Staber

Conformal Prediction (CP) allows to perform rigorous uncertainty quantification by constructing a prediction set $C(X)$ satisfying $\mathbb{P}(Y \in C(X))\geq 1-\alpha$ for a user-chosen $\alpha \in [0,1]$ by relying on calibration data…

Machine Learning · Computer Science 2023-10-25 David Stutz , Abhijit Guha Roy , Tatiana Matejovicova , Patricia Strachan , Ali Taylan Cemgil , Arnaud Doucet

This work introduces a novel methodology for assessing catastrophic forgetting (CF) in continual learning. We propose a new conformal prediction (CP)-based metric, termed the Conformal Prediction Confidence Factor (CPCF), to quantify and…

Machine Learning · Computer Science 2025-05-19 Ioannis Pitsiorlas , Nour Jamoussi , Marios Kountouris

We study the problem of conformal prediction in a novel online framework that directly optimizes efficiency. In our problem, we are given a target miscoverage rate $\alpha > 0$, and a time horizon $T$. On each day $t \le T$ an algorithm…

Machine Learning · Computer Science 2025-10-23 Vaidehi Srinivas

We address the problem of making Conformal Prediction (CP) intervals locally adaptive. Most existing methods focus on approximating the object-conditional validity of the intervals by partitioning or re-weighting the calibration set. Our…

Machine Learning · Computer Science 2023-06-09 Nicolo Colombo

Data-driven surrogate models offer quick approximations to complex numerical and experimental systems but typically lack uncertainty quantification, limiting their reliability in safety-critical applications. While Bayesian methods provide…

Conformal predictive systems are a recent modification of conformal predictors that output, in regression problems, probability distributions for labels of test observations rather than set predictions. The extra information provided by…

Machine Learning · Computer Science 2019-11-05 Vladimir Vovk , Ivan Petej , Ilia Nouretdinov , Valery Manokhin , Alex Gammerman

Post-hoc calibration of pre-trained models is critical for ensuring reliable inference, especially in safety-critical domains such as healthcare. Conformal Prediction (CP) offers a robust post-hoc calibration framework, providing…

Machine Learning · Computer Science 2025-05-22 Haifeng Wen , Hong Xing , Osvaldo Simeone

Data-driven approaches to predict-then-optimize decision-making problems seek to mitigate the risk of uncertainty region misspecification in safety-critical settings. Current approaches, however, suffer from considering overly conservative…

Methodology · Statistics 2023-10-17 Yash Patel , Sahana Rayan , Ambuj Tewari

Continual Learning (CL) is essential for enabling self-evolving large language models (LLMs) to adapt and remain effective amid rapid knowledge growth. Yet, despite its importance, little attention has been given to establishing statistical…

Machine Learning · Computer Science 2025-10-29 Xiaofan Zhou , Lu Cheng

Language prediction is constrained by informational entropy intrinsic to language, such that there exists a limit to how accurate any language model can become and equivalently a lower bound to language compression. The most efficient…

Computation and Language · Computer Science 2025-11-14 Benjamin L. Badger , Matthew Neligeorge

Accurate uncertainty quantification in graph neural networks (GNNs) is essential, especially in high-stakes domains where GNNs are frequently employed. Conformal prediction (CP) offers a promising framework for quantifying uncertainty by…

Machine Learning · Computer Science 2023-12-06 Seohyeon Cha , Honggu Kang , Joonhyuk Kang

We introduce a framework for robust uncertainty quantification in situations where labeled training data are corrupted, through noisy or missing labels. We build on conformal prediction, a statistical tool for generating prediction sets…

Machine Learning · Computer Science 2026-02-27 Shai Feldman , Stephen Bates , Yaniv Romano

Conformal prediction (CP) offers distribution-free uncertainty quantification for machine learning models, yet its interplay with fairness in downstream decision-making remains underexplored. Moving beyond CP as a standalone operation…

Machine Learning · Statistics 2026-02-20 Pengqi Liu , Zijun Yu , Mouloud Belbahri , Arthur Charpentier , Masoud Asgharian , Jesse C. Cresswell

Conventional frequentist learning is known to yield poorly calibrated models that fail to reliably quantify the uncertainty of their decisions. Bayesian learning can improve calibration, but formal guarantees apply only under restrictive…

Machine Learning · Statistics 2022-10-07 Sangwoo Park , Kfir M. Cohen , Osvaldo Simeone