English
Related papers

Related papers: Conformal Prediction Assessment: A Framework for C…

200 papers

Canonical correlation analysis (CCA) is a classic statistical method for discovering latent co-variation that underpins two or more observed random vectors. Several extensions and variations of CCA have been proposed that have strengthened…

Machine Learning · Computer Science 2023-12-22 Paris A. Karakasis , Nicholas D. Sidiropoulos

Conformal inference has played a pivotal role in providing uncertainty quantification for black-box ML prediction algorithms with finite sample guarantees. Traditionally, conformal prediction inference requires a data-independent…

Methodology · Statistics 2023-07-04 Siddhaarth Sarkar , Arun Kumar Kuchibhotla

Conformal risk control (CRC) is a recently proposed technique that applies post-hoc to a conventional point predictor to provide calibration guarantees. Generalizing conformal prediction (CP), with CRC, calibration is ensured for a set…

Machine Learning · Computer Science 2024-05-02 Kfir M. Cohen , Sangwoo Park , Osvaldo Simeone , Shlomo Shamai

We introduce a method based on Conformal Prediction (CP) to quantify the uncertainty of full ranking algorithms. We focus on a specific scenario where $n+m$ items are to be ranked by some ``black box'' algorithm. It is assumed that the…

Machine Learning · Computer Science 2025-12-04 Jean-Baptiste Fermanian , Pierre Humbert , Gilles Blanchard

Conformal prediction offers finite-sample coverage guarantees under minimal assumptions. However, existing methods treat the entire modeling process as a black box, overlooking opportunities to exploit and understand modular structure. We…

Machine Learning · Statistics 2026-05-25 William Zhang , Saurabh Amin , Georgia Perakis

Conformal prediction (CP) provides a comprehensive framework to produce statistically rigorous uncertainty sets for black-box machine learning models. To further improve the efficiency of CP, conformal correction is proposed to fine-tune or…

Machine Learning · Computer Science 2025-12-03 Senrong Xu , Tianyu Wang , Zenan Li , Yuan Yao , Taolue Chen , Feng Xu , Xiaoxing Ma

Recently, there has been substantial interest in statistical guarantees for cross-validation (CV) methods of uncertainty quantification in statistical learning (cf. Barber et al. 2021a, Liang and Barber 2024, Steinberger and Leeb 2023).…

Statistics Theory · Mathematics 2025-05-09 Nicolai Amann , Hannes Leeb , Lukas Steinberger

Conformal Prediction is a widely studied technique to construct prediction sets of future observations. Most conformal prediction methods focus on achieving the necessary coverage guarantees, but do not provide formal guarantees on the size…

Machine Learning · Computer Science 2025-02-25 Chao Gao , Liren Shan , Vaidehi Srinivas , Aravindan Vijayaraghavan

Inductive Conformal Prediction (ICP) is a set of distribution-free and model agnostic algorithms devised to predict with a user-defined confidence with coverage guarantee. Instead of having point predictions, i.e., a real number in the case…

Machine Learning · Statistics 2022-07-05 Martim Sousa

Uncertainty quantification is becoming increasingly important in image segmentation, especially for high-stakes applications like medical imaging. While conformal risk control generalizes conformal prediction beyond standard miscoverage to…

Machine Learning · Computer Science 2025-04-11 Rui Luo , Zhixin Zhou

What, if anything, should a frequentist say about a single realized confidence interval (CI) and its chance of having covered the parameter? Jerzy Neyman's original answer was to refuse any nondegenerate probability for coverage ex post…

Other Statistics · Statistics 2026-03-06 Scott Lee

Reliable uncertainty quantification is essential in survival prediction, particularly in clinical settings where erroneous decisions carry high risk. Conformal prediction has attracted substantial attention as it offers a model-agnostic…

Methodology · Statistics 2025-12-04 Jaeyoung Shin , Chi Hyun Lee , Sangwook Kang

Canonical Correlation Analysis (CCA) is a linear representation learning method that seeks maximally correlated variables in multi-view data. Non-linear CCA extends this notion to a broader family of transformations, which are more powerful…

Machine Learning · Computer Science 2020-02-11 Amichai Painsky , Meir Feder , Naftali Tishby

Conformal prediction gives exact finite-sample coverage guarantees under exchangeability, but deployed systems are judged by more than coverage alone. For a fixed calibrated rule reused over a finite operational window, stakeholders also…

Methodology · Statistics 2026-03-12 Petrus H. Zwart

Split conformal prediction (CP) is arguably the most popular CP method for uncertainty quantification, enjoying both academic interest and widespread deployment. However, the original theoretical analysis of split CP makes the crucial…

Statistics Theory · Mathematics 2024-08-26 Roberto I. Oliveira , Paulo Orenstein , Thiago Ramos , João Vitor Romano

Conformal prediction is a technique for constructing prediction intervals that attain valid coverage in finite samples, without making distributional assumptions. Despite this appeal, existing conformal methods can be unnecessarily…

Methodology · Statistics 2019-05-09 Yaniv Romano , Evan Patterson , Emmanuel J. Candès

Conformal Prediction (CP) has emerged as a powerful statistical framework for high-stakes classification applications. Instead of predicting a single class, CP generates a prediction set, guaranteed to include the true label with a…

Machine Learning · Computer Science 2025-11-25 Ariel Fargion , Lahav Dabah , Tom Tirer

Unlike traditional statistical methods, Conformal Prediction (CP) allows for the determination of valid and accurate confidence levels associated with individual predictions based only on exchangeability of the data. We here introduce a new…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Marcos López-De-Castro , Alberto García-Galindo , Rubén Armañanzas

Autoregressive pre-trained models combined with decoding methods have achieved impressive performance on complex reasoning tasks. While mainstream decoding strategies such as beam search can generate plausible candidate sets, they often…

Machine Learning · Computer Science 2025-09-08 Yuzhu Chen , Yingjie Wang , Shunyu Liu , Yongcheng Jing , Dacheng Tao

Conformal prediction offers a distribution-free framework for constructing prediction sets with finite-sample coverage. Yet, efficiently leveraging multiple conformity scores to reduce prediction set size remains a major open challenge.…

Methodology · Statistics 2025-11-18 Congbin Xu , Yue Yu , Haojie Ren , Zhaojun Wang , Changliang Zou