English
Related papers

Related papers: Robust Yet Efficient Conformal Prediction Sets

200 papers

Conformal prediction (CP) converts any model's output to prediction sets with a guarantee to cover the true label with (adjustable) high probability. Robust CP extends this guarantee to worst-case (adversarial) inputs. Existing baselines…

Machine Learning · Computer Science 2025-03-10 Soroush H. Zargarbashi , Aleksandar Bojchevski

Conformal prediction provides model-agnostic and distribution-free uncertainty quantification through prediction sets that are guaranteed to include the ground truth with any user-specified probability. Yet, conformal prediction is not…

Machine Learning · Computer Science 2025-03-18 Yan Scholten , Stephan Günnemann

In this paper, we present a novel approach for conformal prediction (CP), in which we aim to identify a set of promising prediction candidates -- in place of a single prediction. This set is guaranteed to contain a correct answer with high…

Machine Learning · Computer Science 2021-02-03 Adam Fisch , Tal Schuster , Tommi Jaakkola , Regina Barzilay

Conformal prediction is a powerful tool to generate uncertainty sets with guaranteed coverage using any predictive model, under the assumption that the training and test data are i.i.d.. Recently, it has been shown that adversarial examples…

Machine Learning · Computer Science 2024-05-01 Ge Yan , Yaniv Romano , Tsui-Wei Weng

When one observes a sequence of variables $(x_1, y_1), \ldots, (x_n, y_n)$, Conformal Prediction (CP) is a methodology that allows to estimate a confidence set for $y_{n+1}$ given $x_{n+1}$ by merely assuming that the distribution of the…

Machine Learning · Statistics 2022-12-08 Eugene Ndiaye

Conformal prediction (CP) for regression can be challenging, especially when the output distribution is heteroscedastic, multimodal, or skewed. Some of the issues can be addressed by estimating a distribution over the output, but in…

Machine Learning · Computer Science 2024-04-15 Etash Guha , Shlok Natarajan , Thomas Möllenhoff , Mohammad Emtiyaz Khan , Eugene Ndiaye

For any black-box model, conformal prediction (CP) returns prediction sets guaranteed to include the true label with high adjustable probability. Robust CP (RCP) extends the guarantee to the worst case noise up to a pre-defined magnitude.…

Machine Learning · Computer Science 2025-12-09 Soroush H. Zargarbashi , Mohammad Sadegh Akhondzadeh , Aleksandar Bojchevski

Conformal Prediction (CP) is a popular uncertainty quantification method that provides distribution-free, statistically valid prediction sets, assuming that training and test data are exchangeable. In such a case, CP's prediction sets are…

Logic in Computer Science · Computer Science 2024-11-19 Linus Jeary , Tom Kuipers , Mehran Hosseini , Nicola Paoletti

Conformal prediction (CP) transforms any model's output into prediction sets guaranteed to include (cover) the true label. CP requires exchangeability, a relaxation of the i.i.d. assumption, to obtain a valid distribution-free coverage…

Machine Learning · Computer Science 2024-07-15 Soroush H. Zargarbashi , Aleksandar Bojchevski

We introduce a framework for robust uncertainty quantification in situations where labeled training data are corrupted, through noisy or missing labels. We build on conformal prediction, a statistical tool for generating prediction sets…

Machine Learning · Computer Science 2026-02-27 Shai Feldman , Stephen Bates , Yaniv Romano

Conformal Prediction (CP) quantifies network uncertainty by building a small prediction set with a pre-defined probability that the correct class is within this set. In this study we tackle the problem of CP calibration based on a…

Machine Learning · Computer Science 2024-05-22 Coby Penso , Jacob Goldberger

Conformal Prediction (CP) stands out as a robust framework for uncertainty quantification, which is crucial for ensuring the reliability of predictions. However, common CP methods heavily rely on data exchangeability, a condition often…

Conformal prediction (CP) is a framework to quantify uncertainty of machine learning classifiers including deep neural networks. Given a testing example and a trained classifier, CP produces a prediction set of candidate labels with a…

Machine Learning · Computer Science 2023-08-01 Subhankar Ghosh , Yuanjie Shi , Taha Belkhouja , Yan Yan , Jana Doppa , Brian Jones

We develop a method to generate prediction sets with a guaranteed coverage rate that is robust to corruptions in the training data, such as missing or noisy variables. Our approach builds on conformal prediction, a powerful framework to…

Machine Learning · Computer Science 2025-01-10 Shai Feldman , Yaniv Romano

In high-stakes scenarios, such as medical imaging applications, it is critical to equip the predictions of a regression model with reliable confidence intervals. Recently, Conformal Prediction (CP) has emerged as a powerful statistical…

Machine Learning · Computer Science 2025-09-19 Yahav Cohen , Jacob Goldberger , Tom Tirer

Conformal Prediction (CP) is a popular method for uncertainty quantification with machine learning models. While conformal prediction provides probabilistic guarantees regarding the coverage of the true label, these guarantees are agnostic…

Machine Learning · Computer Science 2025-10-21 Aditya T. Vadlamani , Anutam Srinivasan , Pranav Maneriker , Ali Payani , Srinivasan Parthasarathy

Conformal Prediction (CP) is a powerful framework for constructing prediction sets with guaranteed coverage. However, recent studies have shown that integrating confidence calibration with CP can lead to a degradation in efficiency. In this…

Machine Learning · Computer Science 2024-07-25 Rui Luo , Nicolo Colombo

This paper proposes probabilistic conformal prediction (PCP), a predictive inference algorithm that estimates a target variable by a discontinuous predictive set. Given inputs, PCP construct the predictive set based on random samples from…

Machine Learning · Statistics 2022-06-22 Zhendong Wang , Ruijiang Gao , Mingzhang Yin , Mingyuan Zhou , David M. Blei

Conformal prediction (CP), a distribution-free uncertainty quantification (UQ) framework, reliably provides valid predictive inference for black-box models. CP constructs prediction sets that contain the true output with a specified…

Machine Learning · Computer Science 2025-03-12 Xiaofan Zhou , Baiting Chen , Yu Gui , Lu Cheng

Conformal prediction has recently emerged as a promising strategy for quantifying the uncertainty of a predictive model; these algorithms modify the model to output sets of labels that are guaranteed to contain the true label with high…

Machine Learning · Computer Science 2025-03-11 Botong Zhang , Shuo Li , Osbert Bastani
‹ Prev 1 2 3 10 Next ›