English
Related papers

Related papers: Conformal Prediction: A Data Perspective

200 papers

Uncertainty quantification (UQ) for open-ended language generation remains a critical yet underexplored challenge, especially under black-box constraints where internal model signals are inaccessible. In this paper, we introduce…

Computation and Language · Computer Science 2025-09-08 Beining Xu , Yongming Lu

Conformal prediction is a powerful post-hoc framework for uncertainty quantification that provides distribution-free coverage guarantees. However, these guarantees crucially rely on the assumption of exchangeability. This assumption is…

Methodology · Statistics 2025-11-18 M. Stocker , W. Małgorzewicz , M. Fontana , S. Ben Taieb

Split conformal prediction (CP) is arguably the most popular CP method for uncertainty quantification, enjoying both academic interest and widespread deployment. However, the original theoretical analysis of split CP makes the crucial…

Statistics Theory · Mathematics 2024-08-26 Roberto I. Oliveira , Paulo Orenstein , Thiago Ramos , João Vitor Romano

Uncertainty quantification is essential for deploying machine learning models in high-stakes domains such as scientific discovery and healthcare. Conformal Prediction (CP) provides finite-sample coverage guarantees under exchangeability, an…

Machine Learning · Computer Science 2026-03-30 Siddhartha Laghuvarapu , Rohan Deb , Jimeng Sun

Conformal prediction (CP) offers distribution-free uncertainty quantification for machine learning models, yet its interplay with fairness in downstream decision-making remains underexplored. Moving beyond CP as a standalone operation…

Machine Learning · Statistics 2026-02-20 Pengqi Liu , Zijun Yu , Mouloud Belbahri , Arthur Charpentier , Masoud Asgharian , Jesse C. Cresswell

Safe deployment of deep neural networks in high-stake real-world applications requires theoretically sound uncertainty quantification. Conformal prediction (CP) is a principled framework for uncertainty quantification of deep models in the…

Machine Learning · Computer Science 2023-03-21 Subhankar Ghosh , Taha Belkhouja , Yan Yan , Janardhan Rao Doppa

Conformal prediction (CP) provides a framework for constructing prediction sets with guaranteed coverage, assuming exchangeable data. However, real-world scenarios often involve distribution shifts that violate exchangeability, leading to…

Machine Learning · Computer Science 2025-05-27 Shadi Alijani , Homayoun Najjaran

Conformal prediction (CP) generates a set of predictions for a given test sample such that the prediction set almost always contains the true label (e.g., 99.5\% of the time). CP provides comprehensive predictions on possible labels of a…

Machine Learning · Computer Science 2023-09-12 Yizhe Zhang , Shuo Wang , Yejia Zhang , Danny Z. Chen

Successful application of machine learning models to real-world prediction problems, e.g. financial forecasting and personalized medicine, has proved to be challenging, because such settings require limiting and quantifying the uncertainty…

Machine Learning · Computer Science 2020-09-15 Yao Zhang , William Zame , Mihaela van der Schaar

Conformal prediction offers a distribution-free framework for constructing prediction sets with coverage guarantees. In practice, multiple valid conformal prediction sets may be available, arising from different models or methodologies.…

Machine Learning · Statistics 2025-06-26 Mahmoud Hegazy , Liviu Aolaritei , Michael I. Jordan , Aymeric Dieuleveut

In this work, we consider the problem of building distribution-free prediction intervals with finite-sample conditional coverage guarantees. Conformal prediction (CP) is an increasingly popular framework for building such intervals with…

Methodology · Statistics 2024-10-29 Rohan Hore , Rina Foygel Barber

For any black-box model, conformal prediction (CP) returns prediction sets guaranteed to include the true label with high adjustable probability. Robust CP (RCP) extends the guarantee to the worst case noise up to a pre-defined magnitude.…

Machine Learning · Computer Science 2025-12-09 Soroush H. Zargarbashi , Mohammad Sadegh Akhondzadeh , Aleksandar Bojchevski

Deep learning models in robotics often output point estimates with poorly calibrated confidences, offering no native mechanism to quantify predictive reliability under novel, noisy, or out-of-distribution inputs. Conformal prediction (CP)…

Robotics · Computer Science 2025-09-29 Divake Kumar , Sina Tayebati , Francesco Migliarba , Ranganath Krishnan , Amit Ranjan Trivedi

Conformal prediction is a statistically rigorous method for quantifying uncertainty in models by having them output sets of predictions, with larger sets indicating more uncertainty. However, prediction sets are not inherently actionable;…

Machine Learning · Computer Science 2025-02-17 Jesse C. Cresswell , Bhargava Kumar , Yi Sui , Mouloud Belbahri

Large Reasoning Models (LRMs) have recently demonstrated significant improvements in complex reasoning. While quantifying generation uncertainty in LRMs is crucial, traditional methods are often insufficient because they do not provide…

Artificial Intelligence · Computer Science 2026-04-16 Yangyi Li , Chenxu Zhao , Mengdi Huai

Weighted conformal prediction (WCP) has been commonly used to quantify prediction uncertainty under covariate shift. However, the effectiveness of WCP relies heavily on the degree of overlap between the training and test covariate…

Methodology · Statistics 2026-04-02 Mufang Ying , Wenge Guo , Koulik Khamaru , Ying Hung

We investigate the integration of Conformal Prediction (CP) with supervised learning on deterministically encrypted data, aiming to bridge the gap between rigorous uncertainty quantification and privacy-preserving machine learning. Using…

Machine Learning · Computer Science 2025-07-15 Alexander David Balinsky , Dominik Krzeminski , Alexander Balinsky

The conformalClassification package implements Transductive Conformal Prediction (TCP) and Inductive Conformal Prediction (ICP) for classification problems. Conformal Prediction (CP) is a framework that complements the predictions of…

Machine Learning · Statistics 2018-04-17 Niharika Gauraha , Ola Spjuth

Conformal Prediction (CP) has emerged as a powerful statistical framework for high-stakes classification applications. Instead of predicting a single class, CP generates a prediction set, guaranteed to include the true label with a…

Machine Learning · Computer Science 2025-11-25 Ariel Fargion , Lahav Dabah , Tom Tirer

Conformal prediction (CP) converts any model's output to prediction sets with a guarantee to cover the true label with (adjustable) high probability. Robust CP extends this guarantee to worst-case (adversarial) inputs. Existing baselines…

Machine Learning · Computer Science 2025-03-10 Soroush H. Zargarbashi , Aleksandar Bojchevski
‹ Prev 1 4 5 6 7 8 10 Next ›