English
Related papers

Related papers: Root-finding Approaches for Computing Conformal Pr…

200 papers

When a machine learning model is deployed, its predictions can alter its environment, as better informed agents strategize to suit their own interests. With such alterations in mind, existing approaches to uncertainty quantification break.…

Machine Learning · Statistics 2024-11-05 Daniel Csillag , Claudio José Struchiner , Guilherme Tegoni Goedert

We extend conformal prediction methodology beyond the case of exchangeable data. In particular, we show that a weighted version of conformal prediction can be used to compute distribution-free prediction intervals for problems in which the…

Methodology · Statistics 2020-07-08 Ryan J. Tibshirani , Rina Foygel Barber , Emmanuel J. Candes , Aaditya Ramdas

Regression problems with bounded continuous outcomes frequently arise in real-world statistical and machine learning applications, such as the analysis of rates and proportions. A central challenge in this setting is predicting a response…

Machine Learning · Statistics 2025-07-21 Zhanli Wu , Fabrizio Leisen , F. Javier Rubio

Motivated by the pressing request of methods able to create prediction sets in a general regression framework for a multivariate functional response and pushed by new methodological advancements in non-parametric prediction for functional…

Methodology · Statistics 2021-06-04 Jacopo Diquigiovanni , Matteo Fontana , Simone Vantini

Given a family of pretrained models and a hold-out set, how can we construct a valid conformal prediction set while selecting a model that minimizes the width of the set? If we use the same hold-out data set both to select a model (the…

Methodology · Statistics 2026-04-20 Ruiting Liang , Wanrong Zhu , Rina Foygel Barber

Conformal prediction (CP) has been a popular method for uncertainty quantification because it is distribution-free, model-agnostic, and theoretically sound. For forecasting problems in supervised learning, most CP methods focus on building…

Machine Learning · Statistics 2024-05-24 Chen Xu , Hanyang Jiang , Yao Xie

Full conformal prediction is a framework that implicitly formulates distribution-free confidence prediction regions for a wide range of estimators. However, a classical limitation of the full conformal framework is the computation of the…

Machine Learning · Statistics 2026-01-27 Davidson Lova Razafindrakoto , Alain Celisse , Jérôme Lacaille

Conformal prediction methods are statistical tools designed to quantify uncertainty and generate predictive sets with guaranteed coverage probabilities. This work introduces an innovative refinement to these methods for classification…

Machine Learning · Statistics 2025-12-04 Jean-Baptiste Fermanian , Mohamed Hebiri , Joseph Salmon

Uncertainty estimates must be calibrated (i.e., accurate) and sharp (i.e., informative) in order to be useful. This has motivated a variety of methods for recalibration, which use held-out data to turn an uncalibrated model into a…

Machine Learning · Computer Science 2022-07-06 Charles Marx , Shengjia Zhao , Willie Neiswanger , Stefano Ermon

Distribution-free uncertainty estimation for ensemble methods is increasingly desirable due to the widening deployment of multi-modal black-box predictive models. Conformal prediction is one approach that avoids such distributional…

Methodology · Statistics 2025-05-26 Eduardo Ochoa Rivera , Yash Patel , Ambuj Tewari

When building either prediction intervals for regression (with real-valued response) or prediction sets for classification (with categorical responses), uncertainty quantification is essential to studying complex machine learning methods.…

Machine Learning · Statistics 2022-06-17 Chen Xu , Yao Xie

Predicting sets of outcomes -- instead of unique outcomes -- is a promising solution to uncertainty quantification in statistical learning. Despite a rich literature on constructing prediction sets with statistical guarantees, adapting to…

Methodology · Statistics 2023-06-21 Hongxiang Qiu , Edgar Dobriban , Eric Tchetgen Tchetgen

Conformal prediction is a statistical tool for producing prediction regions of machine learning models that are valid with high probability. However, applying conformal prediction to time series data leads to conservative prediction…

Systems and Control · Electrical Eng. & Systems 2024-01-10 Matthew Cleaveland , Insup Lee , George J. Pappas , Lars Lindemann

Conformal prediction (CP) is a wrapper around traditional machine learning models, giving coverage guarantees under the sole assumption of exchangeability; in classification problems, for a chosen significance level $\varepsilon$, CP…

Machine Learning · Computer Science 2023-02-23 Javier Abad , Umang Bhatt , Adrian Weller , Giovanni Cherubin

Reliable uncertainty quantification is of critical importance in time series forecasting, yet traditional methods often rely on restrictive distributional assumptions. Conformal prediction (CP) has emerged as a promising distribution-free…

Machine Learning · Computer Science 2026-02-02 Andro Sabashvili

Reliable uncertainty quantification is essential in survival prediction, particularly in clinical settings where erroneous decisions carry high risk. Conformal prediction has attracted substantial attention as it offers a model-agnostic…

Methodology · Statistics 2025-12-04 Jaeyoung Shin , Chi Hyun Lee , Sangwook Kang

Zero-inflated outcomes, where responses are zero with positive probability and otherwise continuous, are common in biomedical, environmental, and social science studies. We propose a conformal prediction based framework that provides…

Predicting the response at an unobserved location is a fundamental problem in spatial statistics. Given the difficulty in modeling spatial dependence, especially in non-stationary cases, model-based prediction intervals are at risk of…

Methodology · Statistics 2025-07-09 Huiying Mao , Ryan Martin , Brian Reich

Conformal prediction (CP) converts any model's output to prediction sets with a guarantee to cover the true label with (adjustable) high probability. Robust CP extends this guarantee to worst-case (adversarial) inputs. Existing baselines…

Machine Learning · Computer Science 2025-03-10 Soroush H. Zargarbashi , Aleksandar Bojchevski

Conformal Prediction (CP) is a powerful framework for constructing prediction sets with guaranteed coverage. However, recent studies have shown that integrating confidence calibration with CP can lead to a degradation in efficiency. In this…

Machine Learning · Computer Science 2024-07-25 Rui Luo , Nicolo Colombo