English
Related papers

Related papers: Kandinsky Conformal Prediction: Beyond Class- and …

200 papers

Conformal prediction is often calibrated with a single pooled threshold, but this can hide cross-group heterogeneity in score distributions and distort group-wise coverage. We study this phenomenon through the population score distributions…

Machine Learning · Statistics 2026-05-18 Ziang Gao , Pengqi Liu , Archer Yi Yang , Mouloud Belbahri , Jesse C. Cresswell , Masoud Asgharian

We give a simple, generic conformal prediction method for sequential prediction that achieves target empirical coverage guarantees against adversarially chosen data. It is computationally lightweight -- comparable to split conformal…

Machine Learning · Computer Science 2022-06-03 Osbert Bastani , Varun Gupta , Christopher Jung , Georgy Noarov , Ramya Ramalingam , Aaron Roth

In statistics, forecast uncertainty is often quantified using a specified statistical model, though such approaches may be vulnerable to model misspecification, selection bias, and limited finite-sample validity. While bootstrapping can…

Methodology · Statistics 2026-03-12 Han Lin Shang

Conformal prediction is a statistically rigorous method for quantifying uncertainty in models by having them output sets of predictions, with larger sets indicating more uncertainty. However, prediction sets are not inherently actionable;…

Machine Learning · Computer Science 2025-02-17 Jesse C. Cresswell , Bhargava Kumar , Yi Sui , Mouloud Belbahri

Conformal prediction (CP) provides distribution-free, finite-sample coverage guarantees but critically relies on exchangeability, a condition often violated under distribution shift. We study the robustness of split conformal prediction…

Machine Learning · Statistics 2025-12-23 Xunlei Qian , Yue Xing

Conformal Prediction offers a powerful framework for quantifying uncertainty in machine learning models, enabling the construction of prediction sets with finite-sample validity guarantees. While easily adaptable to non-probabilistic…

Machine Learning · Statistics 2024-11-27 Eshant English , Christoph Lippert

Contrastive learning produces coherent semantic feature embeddings by encouraging positive samples to cluster closely while separating negative samples. However, existing contrastive learning methods lack principled guarantees on coverage…

Machine Learning · Computer Science 2026-03-30 Yahya Alkhatib , Wee Peng Tay

We study conformal prediction in the one-shot federated learning setting. The main goal is to compute marginally and training-conditionally valid prediction sets, at the server-level, in only one round of communication between the agents…

Statistics Theory · Mathematics 2024-05-22 Pierre Humbert , Batiste Le Bars , Aurélien Bellet , Sylvain Arlot

Conformal prediction is a distribution-free uncertainty quantification method that has gained popularity in the machine learning community due to its finite-sample guarantees and ease of use. Its most common variant, dubbed split conformal…

Machine Learning · Computer Science 2025-10-27 Alvaro H. C. Correia , Christos Louizos

A typical desideratum for quantifying the uncertainty from a classification model as a prediction set is class-conditional singleton set calibration. That is, such sets should map to the output of well-calibrated selective classifiers,…

Machine Learning · Computer Science 2022-12-02 Allen Schmaltz , Danielle Rasooly

Predictive inference is a fundamental task in statistics, traditionally addressed using parametric assumptions about the data distribution and detailed analyses of how models learn from data. In recent years, conformal prediction has…

Methodology · Statistics 2026-03-26 Matteo Sesia , Stefano Favaro

Conformal Prediction (CP) is a distribution-free method for constructing prediction sets with marginal finite-sample coverage guarantees, making it a suitable framework for reliable uncertainty quantification in safety-critical object…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Christopher Ries , Moussa Kassem Sbeyti , Nicolas Bianco , Nadja Klein

Conformal prediction (CP) offers distribution-free marginal coverage guarantees under an exchangeability assumption, but these guarantees can fail if the data distribution shifts. We analyze the use of pseudo-calibration as a tool to…

Machine Learning · Computer Science 2026-02-17 Farbod Siahkali , Ashwin Verma , Vijay Gupta

Conformal Prediction methods have finite-sample distribution-free marginal coverage guarantees. However, they generally do not offer conditional coverage guarantees, which can be important for high-stakes decisions. In this paper, we…

Machine Learning · Statistics 2024-09-27 Ruijiang Gao , Mingzhang Yin , James McInerney , Nathan Kallus

The field of distribution-free predictive inference provides tools for provably valid prediction without any assumptions on the distribution of the data, which can be paired with any regression algorithm to provide accurate and reliable…

Statistics Theory · Mathematics 2023-01-19 Michael Bian , Rina Foygel Barber

Conformal prediction is an uncertainty quantification method that constructs a prediction set for a previously unseen datum, ensuring the true label is included with a predetermined coverage probability. Adaptive conformal prediction has…

Machine Learning · Computer Science 2024-11-07 Erfan Hajihashemi , Yanning Shen

We propose a new method called localized conformal prediction, where we can perform conformal inference using only a local region around a new test sample to construct its confidence interval. Localized conformal inference is a natural…

Statistics Theory · Mathematics 2020-07-08 Leying Guan

We propose a conformal prediction method for constructing tight simultaneous prediction intervals for multiple, potentially related, numerical outputs given a single input. This method can be combined with any multi-target regression model…

Methodology · Statistics 2025-12-18 Yunjie Fan , Matteo Sesia

Conformal prediction methods are statistical tools designed to quantify uncertainty and generate predictive sets with guaranteed coverage probabilities. This work introduces an innovative refinement to these methods for classification…

Machine Learning · Statistics 2025-12-04 Jean-Baptiste Fermanian , Mohamed Hebiri , Joseph Salmon

A reliable representation of uncertainty is essential for the application of modern machine learning methods in safety-critical settings. In this regard, the use of credal sets (i.e., convex sets of probability distributions) has recently…

Machine Learning · Computer Science 2026-03-10 Paul Hofman , Timo Löhr , Maximilian Muschalik , Yusuf Sale , Eyke Hüllermeier