English
Related papers

Related papers: Conformal Prediction Assessment: A Framework for C…

200 papers

Continual Test-Time Adaptation (CTTA) aims to adapt models to sequentially changing domains during testing, relying on pseudo-labels for self-adaptation. However, incorrect pseudo-labels can accumulate, leading to performance degradation.…

Machine Learning · Computer Science 2025-02-06 Fan Lyu , Hanyu Zhao , Ziqi Shi , Ye Liu , Fuyuan Hu , Zhang Zhang , Liang Wang

We introduce Conformal Interquantile Regression (CIR), a conformal regression method that efficiently constructs near-minimal prediction intervals with guaranteed coverage. CIR leverages black-box machine learning models to estimate outcome…

Machine Learning · Statistics 2026-01-07 Naixin Guo , Rui Luo , Zhixin Zhou

Traditional conformal prediction methods construct prediction sets such that the true label falls within the set with a user-specified coverage level. However, poorly chosen coverage levels can result in uninformative predictions, either…

Machine Learning · Statistics 2026-04-03 Etienne Gauthier , Francis Bach , Michael I. Jordan

Surrogate models (including deep neural networks and other machine learning algorithms in supervised learning) are capable of approximating arbitrarily complex, high-dimensional input-output problems in science and engineering, but require…

Machine Learning · Computer Science 2025-12-17 Miguel Sánchez-Domínguez , Lucas Lacasa , Javier de Vicente , Gonzalo Rubio , Eusebio Valero

Conformal prediction (CP) provides finite-sample, distribution-free marginal coverage, but standard conformal regression intervals can be inefficient under heteroscedasticity and skewness. In particular, popular constructions such as…

Machine Learning · Statistics 2026-03-03 Xiaoyi Su , Zhixin Zhou , Rui Luo

Large language models (LLMs) need reliable test-time control of hallucinations. Existing conformal methods for LLMs typically provide only \emph{marginal} guarantees and rely on a single global threshold, which can under-cover hard prompts,…

Machine Learning · Computer Science 2026-03-31 Kai Ye , Qingtao Pan , Shuo Li

We develop a predictive inference procedure that combines conformal prediction (CP) with unconditional quantile regression (QR) -- a commonly used tool in econometrics that involves regressing the recentered influence function (RIF) of the…

Machine Learning · Computer Science 2023-04-05 Ahmed M. Alaa , Zeshan Hussain , David Sontag

Cross-sectional prediction is common in many domains such as healthcare, including forecasting tasks using electronic health records, where different patients form a cross-section. We focus on the task of constructing valid prediction…

Machine Learning · Statistics 2022-10-04 Zhen Lin , Shubhendu Trivedi , Jimeng Sun

Deep learning models for medical imaging often exhibit overconfidence, creating safety risks in ambiguous diagnostic scenarios. While Conformal Prediction (CP) provides distribution-free statistical guarantees, standard methods such as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 One Octadion , Novanto Yudistira , Lailil Muflikhah

Continual Learning (CL) is essential for enabling self-evolving large language models (LLMs) to adapt and remain effective amid rapid knowledge growth. Yet, despite its importance, little attention has been given to establishing statistical…

Machine Learning · Computer Science 2025-10-29 Xiaofan Zhou , Lu Cheng

Conformal prediction equips machine learning models with a reasonable notion of uncertainty quantification without making strong distributional assumptions. It wraps around any prediction model and converts point predictions into set…

Machine Learning · Statistics 2025-10-21 Matteo Gasparin , Aaditya Ramdas

Conformal prediction (CP) provides distribution-free, finite-sample coverage guarantees but critically relies on exchangeability, a condition often violated under distribution shift. We study the robustness of split conformal prediction…

Machine Learning · Statistics 2025-12-23 Xunlei Qian , Yue Xing

Conformal Prediction (CP) is a powerful statistical machine learning tool to construct uncertainty sets with coverage guarantees, which has fueled its extensive adoption in generating prediction regions for decision-making tasks, e.g.,…

Optimization and Control · Mathematics 2025-10-21 Han Wang , Chao Ning

Conformal prediction provides distribution-free predictive intervals with finite-sample marginal coverage. However, achieving conditional validity and interval efficiency (in terms of short interval length) remains challenging, particularly…

Machine Learning · Statistics 2026-05-06 Ran Zou , Wanrong Zhu , Bin Nan

Conformal prediction is an assumption-lean approach to generating distribution-free prediction intervals or sets, for nearly arbitrary predictive models, with guaranteed finite-sample coverage. Conformal methods are an active research topic…

Methodology · Statistics 2024-01-19 Jerzy Wieczorek

Standard conformal prediction methods provide a marginal coverage guarantee, which means that for a random test point, the conformal prediction set contains the true label with a user-specified probability. In many classification problems,…

Forecasting armed conflicts is a critical area of research with the potential to save lives and mitigate suffering. While existing forecasting models offer valuable point predictions, they often lack individual-level uncertainty estimates,…

Methodology · Statistics 2026-01-14 David Randahl , Jonathan P. Williams , Håvard Hegre

Conformal prediction is a framework for providing prediction intervals with distribution-free validity, guaranteeing predictive coverage for data drawn from any distribution. Its two main variants are full conformal prediction and split…

Methodology · Statistics 2026-05-29 Aabesh Bhattacharyya , Boxuan Zhang , Rina Foygel Barber

Conformal inference provides a rigorous statistical framework for uncertainty quantification in machine learning, enabling well-calibrated prediction sets with precise coverage guarantees for any classification model. However, its reliance…

The deployment of safe and trustworthy machine learning systems, and particularly complex black box neural networks, in real-world applications requires reliable and certified guarantees on their performance. The conformal prediction…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Paul Melki , Lionel Bombrun , Boubacar Diallo , Jérôme Dias , Jean-Pierre da Costa