English
Related papers

Related papers: Stable Conformal Prediction Sets

200 papers

Conformal prediction (CP) transforms any model's output into prediction sets guaranteed to include (cover) the true label. CP requires exchangeability, a relaxation of the i.i.d. assumption, to obtain a valid distribution-free coverage…

Machine Learning · Computer Science 2024-07-15 Soroush H. Zargarbashi , Aleksandar Bojchevski

Conformal prediction (CP) is a general framework to quantify the predictive uncertainty of machine learning models that uses a set prediction to include the true label with a valid probability. To align the uncertainty measured by CP,…

Machine Learning · Computer Science 2025-11-25 Xuesong Jia , Yuanjie Shi , Ziquan Liu , Yi Xu , Yan Yan

Conformal prediction is a statistically rigorous method for quantifying uncertainty in models by having them output sets of predictions, with larger sets indicating more uncertainty. However, prediction sets are not inherently actionable;…

Machine Learning · Computer Science 2025-02-17 Jesse C. Cresswell , Bhargava Kumar , Yi Sui , Mouloud Belbahri

Conformal prediction (CP) is a powerful framework for quantifying uncertainty in machine learning models, offering reliable predictions with finite-sample coverage guarantees. When applied to classification, CP produces a prediction set of…

Machine Learning · Computer Science 2025-08-20 Floris den Hengst , Inès Blin , Majid Mohammadi , Syed Ihtesham Hussain Shah , Taraneh Younesian

Conformal Prediction (CP) has emerged as a powerful statistical framework for high-stakes classification applications. Instead of predicting a single class, CP generates a prediction set, guaranteed to include the true label with a…

Machine Learning · Computer Science 2025-11-25 Ariel Fargion , Lahav Dabah , Tom Tirer

Conformal Prediction (CP) is a popular method for uncertainty quantification that converts a pretrained model's point prediction into a prediction set, with the set size reflecting the model's confidence. Although existing CP methods are…

Machine Learning · Computer Science 2025-08-18 Shuqi Liu , Jianguo Huang , Luke Ong

Ordinal classification has been widely applied in many high-stakes applications, e.g., medical imaging and diagnosis, where reliable uncertainty quantification (UQ) is essential for decision making. Conformal prediction (CP) is a general UQ…

Machine Learning · Computer Science 2025-11-24 Zijian Zhang , Xinyu Chen , Yuanjie Shi , Liyuan Lillian Ma , Zifan Xu , Yan Yan

Conformal prediction (CP) constructs uncertainty sets for model outputs with finite-sample coverage guarantees. A candidate output is included in the prediction set if its non-conformity score is not considered extreme relative to the…

Machine Learning · Statistics 2025-11-20 Eugene Ndiaye

Conformal Prediction (CP) controls the prediction uncertainty of classification systems by producing a small prediction set, ensuring a predetermined probability that the true class lies within this set. This is commonly done by defining a…

Machine Learning · Computer Science 2025-08-14 Coby Penso , Jacob Goldberger , Ethan Fetaya

Out-of-distribution (OOD) generalization has attracted increasing research attention in recent years, due to its promising experimental results in real-world applications. In this paper,we study the confidence set prediction problem in the…

Machine Learning · Computer Science 2024-04-01 Xin Zou , Weiwei Liu

Conformal prediction (CP) is an important tool for distribution-free predictive uncertainty quantification. Yet, a major challenge is to balance computational efficiency and prediction accuracy, particularly for multiple predictions. We…

Machine Learning · Statistics 2025-04-17 Kiljae Lee , Yuan Zhang

Safe deployment of deep neural networks in high-stake real-world applications requires theoretically sound uncertainty quantification. Conformal prediction (CP) is a principled framework for uncertainty quantification of deep models in the…

Machine Learning · Computer Science 2023-03-21 Subhankar Ghosh , Taha Belkhouja , Yan Yan , Janardhan Rao Doppa

Conformal prediction (CP) provides a comprehensive framework to produce statistically rigorous uncertainty sets for black-box machine learning models. To further improve the efficiency of CP, conformal correction is proposed to fine-tune or…

Machine Learning · Computer Science 2025-12-03 Senrong Xu , Tianyu Wang , Zenan Li , Yuan Yao , Taolue Chen , Feng Xu , Xiaoxing Ma

While Conformal Prediction (CP) has proven to be a powerful framework for uncertainty quantification, guaranteeing conditional coverage remains a central challenge. Although finite-sample, distribution-free conditional validity is known to…

Methodology · Statistics 2026-05-27 Félix Laplante

Conformal Prediction (CP) quantifies network uncertainty by building a small prediction set with a pre-defined probability that the correct class is within this set. In this study we tackle the problem of CP calibration based on a…

Machine Learning · Computer Science 2024-05-22 Coby Penso , Jacob Goldberger

Conformal prediction yields a prediction set with guaranteed $1-\alpha$ coverage of the true target under the i.i.d. assumption, which may not hold and lead to a gap between $1-\alpha$ and the actual coverage. Prior studies bound the gap…

Machine Learning · Computer Science 2025-03-07 Rui Xu , Chao Chen , Yue Sun , Parvathinathan Venkitasubramaniam , Sihong Xie

Constraint Programming (CP) has proved an effective paradigm to model and solve difficult combinatorial satisfaction and optimisation problems from disparate domains. Many such problems arising from the commercial world are permeated by…

Artificial Intelligence · Computer Science 2018-08-08 Neil Yorke-Smith , Carmen Gervet

We develop a new method for generating prediction sets that combines the flexibility of conformal methods with an estimate of the conditional distribution $P_{Y \mid X}$. Existing methods, such as conformalized quantile regression and…

Machine Learning · Statistics 2024-10-10 Vincent Plassier , Alexander Fishkov , Mohsen Guizani , Maxim Panov , Eric Moulines

Conformal prediction (CP) produces prediction regions with finite-sample, distribution free coverage guarantees, but its interpretation as a quantitative uncertainty tool is often left implicit. We develop a category-theoretic approach that…

Machine Learning · Statistics 2026-05-05 Michele Caprio

Conformal prediction is widely used to equip black-box machine learning models with uncertainty quantification, offering formal coverage guarantees under exchangeable data. However, these guarantees fail when faced with subpopulation…

Machine Learning · Computer Science 2025-11-10 Nien-Shao Wang , Duygu Nur Yaldiz , Yavuz Faruk Bakman , Sai Praneeth Karimireddy