English
Related papers

Related papers: Weighted Aggregation of Conformity Scores for Clas…

200 papers

Prior proposals for cumulative statistics suggest making tiny random perturbations to the scores (independent variables in a regression) in order to ensure the scores' uniqueness. Uniqueness means that no score for any member of the…

Methodology · Statistics 2022-08-23 Mark Tygert

Conformal prediction is a framework for providing prediction intervals with distribution-free validity, guaranteeing predictive coverage for data drawn from any distribution. Its two main variants are full conformal prediction and split…

Methodology · Statistics 2026-05-29 Aabesh Bhattacharyya , Boxuan Zhang , Rina Foygel Barber

Conformal prediction (CP) is a method for constructing a prediction interval around the output of a fitted model, whose validity does not rely on the model being correct--the CP interval offers a coverage guarantee that is…

Methodology · Statistics 2025-04-17 Aabesh Bhattacharyya , Rina Foygel Barber

Being able to assess the confidence of individual predictions in machine learning models is crucial for decision making scenarios. Specially, in critical applications such as medical diagnosis, security, and unmanned vehicles, to name a…

Machine Learning · Computer Science 2024-02-20 Enrique Garcia-Ceja

Conformal prediction provides prediction sets with finite-sample marginal coverage, but many applications require coverage guarantees that adapt to individual test points, a subpopulation, or a structural component of the data. Existing…

Methodology · Statistics 2026-05-27 Yinjie Min , Liuhua Peng , Changliang Zou

Conformal prediction (CP) is a wrapper around traditional machine learning models, giving coverage guarantees under the sole assumption of exchangeability; in classification problems, for a chosen significance level $\varepsilon$, CP…

Machine Learning · Computer Science 2023-02-23 Javier Abad , Umang Bhatt , Adrian Weller , Giovanni Cherubin

Conformal prediction offers a distribution-free framework for constructing prediction sets with finite-sample coverage. Yet, efficiently leveraging multiple conformity scores to reduce prediction set size remains a major open challenge.…

Methodology · Statistics 2025-11-18 Congbin Xu , Yue Yu , Haojie Ren , Zhaojun Wang , Changliang Zou

Averaging predictions of a deep ensemble of networks is apopular and effective method to improve predictive performance andcalibration in various benchmarks and Kaggle competitions. However, theruntime and training cost of deep ensembles…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Timo Sämann , Ahmed Mostafa Hammam , Andrei Bursuc , Christoph Stiller , Horst-Michael Groß

The deployment of safe and trustworthy machine learning systems, and particularly complex black box neural networks, in real-world applications requires reliable and certified guarantees on their performance. The conformal prediction…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Paul Melki , Lionel Bombrun , Boubacar Diallo , Jérôme Dias , Jean-Pierre da Costa

Conformal prediction is a powerful distribution-free tool for uncertainty quantification, establishing valid prediction intervals with finite-sample guarantees. To produce valid intervals which are also adaptive to the difficulty of each…

Machine Learning · Computer Science 2023-02-24 Nabeel Seedat , Alan Jeffares , Fergus Imrie , Mihaela van der Schaar

Many real-world classification problems, such as plant identification, have extremely long-tailed class distributions. In order for prediction sets to be useful in such settings, they should (i) provide good class-conditional coverage,…

Machine Learning · Statistics 2026-03-02 Tiffany Ding , Jean-Baptiste Fermanian , Joseph Salmon

In this work we provide a review of basic ideas and novel developments about Conformal Prediction -- an innovative distribution-free, non-parametric forecasting method, based on minimal assumptions -- that is able to yield in a very…

Machine Learning · Computer Science 2024-02-01 Matteo Fontana , Gianluca Zeni , Simone Vantini

Conformal prediction is a method of producing prediction sets that can be applied on top of a wide range of prediction algorithms. The method has a guaranteed coverage probability under the standard IID assumption regardless of whether the…

Machine Learning · Computer Science 2014-04-09 Evgeny Burnaev , Vladimir Vovk

Conformal prediction has emerged as a cutting-edge methodology in statistics and machine learning, providing prediction intervals with finite-sample frequentist coverage guarantees. Yet, its interplay with Bayesian statistics, often…

Methodology · Statistics 2026-03-27 Nina Deliu , Brunero Liseo

We consider the problem of testing the equality of conditional distributions of a response variable given a vector of covariates between two populations. Such a hypothesis testing problem can be motivated from various machine learning and…

Methodology · Statistics 2023-02-24 Xiaoyu Hu , Jing Lei

Conformal prediction can be used to construct prediction sets that cover the true outcome with a desired probability, but can sometimes lead to large prediction sets that are costly in practice. The most useful outcome is a singleton…

Machine Learning · Statistics 2026-02-05 Tao Wang , Yan Sun , Edgar Dobriban

Conformal prediction is a popular uncertainty quantification method that augments a base predictor to return sets of predictions with statistically valid coverage guarantees. However, current methods are often computationally expensive and…

Machine Learning · Computer Science 2026-03-05 Laura Lützow , Michael Eichelbeck , Mykel J. Kochenderfer , Matthias Althoff

In this paper, we propose a Network-Weighted Functional Regression (NWFR) model, an extension of Spatially Weighted Functional Regression (SWFR) to functional data defined on network-structured settings. To asses predictive uncertainity, we…

Methodology · Statistics 2025-06-02 Elvira Romano , Antonio Irpino , Claire Miller

Conformal prediction is a powerful framework for distribution-free uncertainty quantification. The standard approach to conformal prediction relies on comparing the ranks of prediction scores: under exchangeability, the rank of a future…

Machine Learning · Statistics 2025-05-07 Etienne Gauthier , Francis Bach , Michael I. Jordan

Conformal predictive systems are a recent modification of conformal predictors that output, in regression problems, probability distributions for labels of test observations rather than set predictions. The extra information provided by…

Machine Learning · Computer Science 2019-11-05 Vladimir Vovk , Ivan Petej , Ilia Nouretdinov , Valery Manokhin , Alex Gammerman