English
Related papers

Related papers: One-Shot Federated Conformal Prediction

200 papers

We introduce $\textit{Backward Conformal Prediction}$, a method that guarantees conformal coverage while providing flexible control over the size of prediction sets. Unlike standard conformal prediction, which fixes the coverage level and…

Machine Learning · Statistics 2026-02-13 Etienne Gauthier , Francis Bach , Michael I. Jordan

We propose a new inference framework called localized conformal prediction. It generalizes the framework of conformal prediction by offering a single-test-sample adaptive construction that emphasizes a local region around this test sample,…

Statistics Theory · Mathematics 2022-03-02 Leying Guan

We develop a method to generate prediction sets with a guaranteed coverage rate that is robust to corruptions in the training data, such as missing or noisy variables. Our approach builds on conformal prediction, a powerful framework to…

Machine Learning · Computer Science 2025-01-10 Shai Feldman , Yaniv Romano

Conformal prediction is emerging as a popular paradigm for providing rigorous uncertainty quantification in machine learning since it can be easily applied as a post-processing step to already trained models. In this paper, we extend…

Machine Learning · Computer Science 2023-06-02 Charles Lu , Yaodong Yu , Sai Praneeth Karimireddy , Michael I. Jordan , Ramesh Raskar

If you are predicting the label $y$ of a new object with $\hat y$, how confident are you that $y = \hat y$? Conformal prediction methods provide an elegant framework for answering such question by building a $100 (1 - \alpha)\%$ confidence…

Machine Learning · Statistics 2019-11-11 Eugene Ndiaye , Ichiro Takeuchi

Conformal prediction is a non-parametric technique for constructing prediction intervals or sets from arbitrary predictive models under the assumption that the data is exchangeable. It is popular as it comes with theoretical guarantees on…

Machine Learning · Statistics 2025-12-01 Jase Clarkson , Wenkai Xu , Mihai Cucuringu , Yvik Swan , Gesine Reinert

We propose a new method called localized conformal prediction, where we can perform conformal inference using only a local region around a new test sample to construct its confidence interval. Localized conformal inference is a natural…

Statistics Theory · Mathematics 2020-07-08 Leying Guan

Quantifying the data uncertainty in learning tasks is often done by learning a prediction interval or prediction set of the label given the input. Two commonly desired properties for learned prediction sets are \emph{valid coverage} and…

Machine Learning · Computer Science 2022-05-31 Yu Bai , Song Mei , Huan Wang , Yingbo Zhou , Caiming Xiong

Conformal prediction quantifies the uncertainty of machine learning models by augmenting point predictions with valid prediction sets. For complex scenarios involving multiple trials, models, or data sources, conformal prediction sets can…

Machine Learning · Computer Science 2025-12-25 Gina Wong , Drew Prinster , Suchi Saria , Rama Chellappa , Anqi Liu

Conformal prediction equips machine learning models with a reasonable notion of uncertainty quantification without making strong distributional assumptions. It wraps around any prediction model and converts point predictions into set…

Machine Learning · Statistics 2025-10-21 Matteo Gasparin , Aaditya Ramdas

Conformal Prediction is a widely studied technique to construct prediction sets of future observations. Most conformal prediction methods focus on achieving the necessary coverage guarantees, but do not provide formal guarantees on the size…

Machine Learning · Computer Science 2025-02-25 Chao Gao , Liren Shan , Vaidehi Srinivas , Aravindan Vijayaraghavan

Conformal prediction is a statistically rigorous method for quantifying uncertainty in models by having them output sets of predictions, with larger sets indicating more uncertainty. However, prediction sets are not inherently actionable;…

Machine Learning · Computer Science 2025-02-17 Jesse C. Cresswell , Bhargava Kumar , Yi Sui , Mouloud Belbahri

Machine-learning techniques are essential in modern collider research, yet their probabilistic outputs often lack calibrated uncertainty estimates and finite-sample guarantees, limiting their direct use in statistical inference and…

High Energy Physics - Phenomenology · Physics 2025-12-22 Jack Y. Araz , Michael Spannowsky

In this paper, we present a novel approach for conformal prediction (CP), in which we aim to identify a set of promising prediction candidates -- in place of a single prediction. This set is guaranteed to contain a correct answer with high…

Machine Learning · Computer Science 2021-02-03 Adam Fisch , Tal Schuster , Tommi Jaakkola , Regina Barzilay

Conformal prediction (CP) produces prediction regions with finite-sample, distribution free coverage guarantees, but its interpretation as a quantitative uncertainty tool is often left implicit. We develop a category-theoretic approach that…

Machine Learning · Statistics 2026-05-05 Michele Caprio

The recent advancement of foundation models (FMs) has increased the demand for fine-tuning these models on large-scale cross-domain datasets. To address this, federated fine-tuning has emerged, allowing FMs to be fine-tuned on distributed…

Machine Learning · Computer Science 2025-11-07 Ziyao Wang , Bowei Tian , Yexiao He , Zheyu Shen , Guoheng Sun , Yuhan Liu , Luyang Liu , Meng Liu , Ang Li

Conformal prediction methods provide statistically rigorous marginal coverage guarantees for machine learning models, but such guarantees fail to account for algorithmic biases, thereby undermining fairness and trust. This paper introduces…

Machine Learning · Computer Science 2026-05-13 Senrong Xu , Yanke Zhou , Yuhao Tan , Zenan Li , Yuan Yao , Taolue Chen , Feng Xu , Xiaoxing Ma

We propose conformal hyperrectangular prediction regions for multi-target regression. We propose split conformal prediction algorithms for both point and quantile regression to form hyperrectangular prediction regions, which allow for easy…

Methodology · Statistics 2024-06-10 Max Sampson , Kung-Sik Chan

AI tools can be useful to address model deficits in the design of communication systems. However, conventional learning-based AI algorithms yield poorly calibrated decisions, unabling to quantify their outputs uncertainty. While Bayesian…

Signal Processing · Electrical Eng. & Systems 2024-05-02 Kfir M. Cohen , Sangwoo Park , Osvaldo Simeone , Shlomo Shamai

Traditional conformal prediction methods construct prediction sets such that the true label falls within the set with a user-specified coverage level. However, poorly chosen coverage levels can result in uninformative predictions, either…

Machine Learning · Statistics 2026-04-03 Etienne Gauthier , Francis Bach , Michael I. Jordan