English
Related papers

Related papers: Conditional Coverage Diagnostics for Conformal Pre…

200 papers

Class-conditional generative models hold promise to overcome the shortcomings of their discriminative counterparts. They are a natural choice to solve discriminative tasks in a robust manner as they jointly optimize for predictive…

Machine Learning · Computer Science 2020-02-18 Ethan Fetaya , Jörn-Henrik Jacobsen , Will Grathwohl , Richard Zemel

We develop a novel approach to conformal prediction when the target task has limited data available for training. Conformal prediction identifies a small set of promising output candidates in place of a single prediction, with guarantees…

Machine Learning · Computer Science 2021-07-21 Adam Fisch , Tal Schuster , Tommi Jaakkola , Regina Barzilay

Conformal Prediction (CP) is a popular method for uncertainty quantification that converts a pretrained model's point prediction into a prediction set, with the set size reflecting the model's confidence. Although existing CP methods are…

Machine Learning · Computer Science 2025-08-18 Shuqi Liu , Jianguo Huang , Luke Ong

This work considers the problem of binary classification: given training data $x_1, \dots, x_n$ from a certain population, together with associated labels $y_1,\dots, y_n \in \left\{0,1 \right\}$, determine the best label for an element $x$…

Statistics Theory · Mathematics 2016-07-04 Nicolas Garcia Trillos , Ryan Murray

Predictive models make mistakes. Hence, there is a need to quantify the uncertainty associated with their predictions. Conformal inference has emerged as a powerful tool to create statistically valid prediction regions around point…

Machine Learning · Statistics 2024-02-14 Luben M. C. Cabezas , Mateus P. Otto , Rafael Izbicki , Rafael B. Stern

An open question in \emph{Imprecise Probabilistic Machine Learning} is how to empirically derive a credal region (i.e., a closed and convex family of probabilities on the output space) from the available data, without any prior knowledge or…

Machine Learning · Statistics 2025-01-29 Michele Caprio , David Stutz , Shuo Li , Arnaud Doucet

We propose a novel method for selective classification (SC), a problem which allows a classifier to abstain from predicting some instances, thus trading off accuracy against coverage (the fraction of instances predicted). In contrast to…

Machine Learning · Computer Science 2021-10-26 Aditya Gangrade , Anil Kag , Venkatesh Saligrama

Conformal prediction (CP) constructs uncertainty sets for model outputs with finite-sample coverage guarantees. A candidate output is included in the prediction set if its non-conformity score is not considered extreme relative to the…

Machine Learning · Statistics 2025-11-20 Eugene Ndiaye

When making treatment selection decisions, it is essential to include a causal effect estimation analysis to compare potential outcomes under different treatments or controls, assisting in optimal selection. However, merely estimating…

Machine Learning · Statistics 2024-10-08 Sherly Alfonso-Sánchez , Kristina P. Sendova , Cristián Bravo

Conformal Prediction (CP) stands out as a robust framework for uncertainty quantification, which is crucial for ensuring the reliability of predictions. However, common CP methods heavily rely on data exchangeability, a condition often…

In many real applications of statistical learning, collecting sufficiently many training data is often expensive, time-consuming, or even unrealistic. In this case, a transfer learning approach, which aims to leverage knowledge from a…

Machine Learning · Statistics 2025-02-26 Baozhen Wang , Xingye Qiao

In this paper, we introduce a novel method to generate interpretable regression function estimators. The idea is based on called data-dependent coverings. The aim is to extract from the data a covering of the feature space instead of a…

Statistics Theory · Mathematics 2021-01-27 Vincent Margot , Jean-Patrick Baudry , Frédéric Guilloux , Olivier Wintenberger

Conformal prediction (CP) for regression can be challenging, especially when the output distribution is heteroscedastic, multimodal, or skewed. Some of the issues can be addressed by estimating a distribution over the output, but in…

Machine Learning · Computer Science 2024-04-15 Etash Guha , Shlok Natarajan , Thomas Möllenhoff , Mohammad Emtiyaz Khan , Eugene Ndiaye

While counterfactual fairness of point predictors is well studied, its extension to prediction sets--central to fair decision-making under uncertainty--remains underexplored. On the other hand, conformal prediction (CP) provides efficient,…

Machine Learning · Computer Science 2026-03-13 Ozgur Guldogan , Neeraj Sarna , Yuanyuan Li , Michael Berger

Conformal inference is a popular tool for constructing prediction intervals (PI). We consider here the scenario of post-selection/selective conformal inference, that is PIs are reported only for individuals selected from an unlabeled test…

Methodology · Statistics 2024-03-13 Yajie Bao , Yuyang Huo , Haojie Ren , Changliang Zou

Estimating conditional means using only the marginal means available from aggregate data is commonly known as the ecological inference problem (EI). We provide a reassessment of EI, including a new formalization of identification conditions…

Applications · Statistics 2026-01-13 Shiro Kuriwaki , Cory McCartan

Reliable uncertainty quantification is essential for deploying machine learning systems in high-stakes domains. Conformal prediction provides distribution-free coverage guarantees but often produces overly large prediction sets, limiting…

Machine Learning · Computer Science 2026-04-28 Yunpeng Xu , Wenge Guo , Zhi Wei

Split conformal prediction (CP) is arguably the most popular CP method for uncertainty quantification, enjoying both academic interest and widespread deployment. However, the original theoretical analysis of split CP makes the crucial…

Statistics Theory · Mathematics 2024-08-26 Roberto I. Oliveira , Paulo Orenstein , Thiago Ramos , João Vitor Romano

Conformal Prediction (CP) provides distribution-free uncertainty quantification by constructing prediction sets that guarantee coverage of the true labels. This reliability makes CP valuable for high-stakes federated learning scenarios such…

Machine Learning · Computer Science 2025-10-21 Rui Xu , Xingyuan Chen , Wenxing Huang , Minxuan Huang , Yun Xie , Weiyan Chen , Sihong Xie

Conformal prediction (CP) is a method for constructing a prediction interval around the output of a fitted model, whose validity does not rely on the model being correct--the CP interval offers a coverage guarantee that is…

Methodology · Statistics 2025-04-17 Aabesh Bhattacharyya , Rina Foygel Barber