English
Related papers

Related papers: Kandinsky Conformal Prediction: Beyond Class- and …

200 papers

Conformal prediction is a learning framework controlling prediction coverage of prediction sets, which can be built on any learning algorithm for point prediction. This work proposes a learning framework named conformal loss-controlling…

Machine Learning · Computer Science 2024-01-24 Di Wang , Ping Wang , Zhong Ji , Xiaojun Yang , Hongyue Li

Conformal Prediction is a widely studied technique to construct prediction sets of future observations. Most conformal prediction methods focus on achieving the necessary coverage guarantees, but do not provide formal guarantees on the size…

Machine Learning · Computer Science 2025-02-25 Chao Gao , Liren Shan , Vaidehi Srinivas , Aravindan Vijayaraghavan

We revisit the problem of constructing predictive confidence sets for which we wish to obtain some type of conditional validity. We provide new arguments showing how ``split conformal'' methods achieve near desired coverage levels with high…

Statistics Theory · Mathematics 2025-03-04 John C. Duchi

In this work we provide a review of basic ideas and novel developments about Conformal Prediction -- an innovative distribution-free, non-parametric forecasting method, based on minimal assumptions -- that is able to yield in a very…

Machine Learning · Computer Science 2024-02-01 Matteo Fontana , Gianluca Zeni , Simone Vantini

Conformal prediction is widely used to equip black-box machine learning models with uncertainty quantification, offering formal coverage guarantees under exchangeable data. However, these guarantees fail when faced with subpopulation…

Machine Learning · Computer Science 2025-11-10 Nien-Shao Wang , Duygu Nur Yaldiz , Yavuz Faruk Bakman , Sai Praneeth Karimireddy

Conformal prediction provides a distribution-free framework for uncertainty quantification. This study explores the application of conformal prediction in scenarios where covariates are missing, which introduces significant challenges for…

Methodology · Statistics 2025-09-09 Jingsen Kong , YIming Liu , Guangren Yang

Conformal prediction is an assumption-lean approach to generating distribution-free prediction intervals or sets, for nearly arbitrary predictive models, with guaranteed finite-sample coverage. Conformal methods are an active research topic…

Methodology · Statistics 2024-01-19 Jerzy Wieczorek

Conformal prediction methods provide statistically rigorous marginal coverage guarantees for machine learning models, but such guarantees fail to account for algorithmic biases, thereby undermining fairness and trust. This paper introduces…

Machine Learning · Computer Science 2026-05-13 Senrong Xu , Yanke Zhou , Yuhao Tan , Zenan Li , Yuan Yao , Taolue Chen , Feng Xu , Xiaoxing Ma

We develop a new approach to multi-label conformal prediction in which we aim to output a precise set of promising prediction candidates with a bounded number of incorrect answers. Standard conformal prediction provides the ability to adapt…

Machine Learning · Computer Science 2022-02-16 Adam Fisch , Tal Schuster , Tommi Jaakkola , Regina Barzilay

Conformal Prediction (CP) is a popular method for uncertainty quantification with machine learning models. While conformal prediction provides probabilistic guarantees regarding the coverage of the true label, these guarantees are agnostic…

Machine Learning · Computer Science 2025-10-21 Aditya T. Vadlamani , Anutam Srinivasan , Pranav Maneriker , Ali Payani , Srinivasan Parthasarathy

Conformal prediction uses past experience to determine precise levels of confidence in new predictions. Given an error probability $\epsilon$, together with a method that makes a prediction $\hat{y}$ of a label $y$, it produces a set of…

Machine Learning · Computer Science 2019-04-23 Glenn Shafer , Vladimir Vovk

Uncertainty quantification is essential in decision-making, especially when joint distributions of random variables are involved. While conformal prediction provides distribution-free prediction sets with valid coverage guarantees, it…

Machine Learning · Computer Science 2025-01-03 Rui Luo , Zhixin Zhou

Conformal prediction is a statistical framework that generates prediction sets containing ground-truth labels with a desired coverage guarantee. The predicted probabilities produced by machine learning models are generally miscalibrated,…

Machine Learning · Computer Science 2024-06-07 Jianguo Huang , Huajun Xi , Linjun Zhang , Huaxiu Yao , Yue Qiu , Hongxin Wei

We develop fast distribution-free conformal prediction algorithms for obtaining multivalid coverage on exchangeable data in the batch setting. Multivalid coverage guarantees are stronger than marginal coverage guarantees in two ways: (1)…

Machine Learning · Computer Science 2022-10-03 Christopher Jung , Georgy Noarov , Ramya Ramalingam , Aaron Roth

We introduce $\textit{Backward Conformal Prediction}$, a method that guarantees conformal coverage while providing flexible control over the size of prediction sets. Unlike standard conformal prediction, which fixes the coverage level and…

Machine Learning · Statistics 2026-02-13 Etienne Gauthier , Francis Bach , Michael I. Jordan

Uncertainty is critical to reliable decision-making with machine learning. Conformal prediction (CP) handles uncertainty by predicting a set on a test input, hoping the set to cover the true label with at least $(1-\alpha)$ confidence. This…

Machine Learning · Computer Science 2024-03-25 Rui Xu , Yue Sun , Chao Chen , Parv Venkitasubramaniam , Sihong Xie

Conformal prediction constructs a confidence set for an unobserved response of a feature vector based on previous identically distributed and exchangeable observations of responses and features. It has a coverage guarantee at any nominal…

Machine Learning · Statistics 2022-12-08 Eugene Ndiaye , Ichiro Takeuchi

Distribution-free uncertainty estimation for ensemble methods is increasingly desirable due to the widening deployment of multi-modal black-box predictive models. Conformal prediction is one approach that avoids such distributional…

Methodology · Statistics 2025-05-26 Eduardo Ochoa Rivera , Yash Patel , Ambuj Tewari

We develop a method to generate prediction sets with a guaranteed coverage rate that is robust to corruptions in the training data, such as missing or noisy variables. Our approach builds on conformal prediction, a powerful framework to…

Machine Learning · Computer Science 2025-01-10 Shai Feldman , Yaniv Romano

Conformal predictive systems allow forecasters to issue predictive distributions for real-valued future outcomes that have out-of-sample calibration guarantees. On a more abstract level, conformal prediction makes use of in-sample…

Methodology · Statistics 2025-03-07 Sam Allen , Georgios Gavrilopoulos , Alexander Henzi , Gian-Reto Kleger , Johanna Ziegel