English
Related papers

Related papers: AdaptiveConformal: An R Package for Adaptive Confo…

200 papers

The conformalClassification package implements Transductive Conformal Prediction (TCP) and Inductive Conformal Prediction (ICP) for classification problems. Conformal Prediction (CP) is a framework that complements the predictions of…

Machine Learning · Statistics 2018-04-17 Niharika Gauraha , Ola Spjuth

Conformal prediction is a valuable tool for quantifying predictive uncertainty of machine learning models. However, its applicability relies on the assumption of data exchangeability, a condition which is often not met in real-world…

Machine Learning · Statistics 2024-12-30 Aleksandr Podkopaev , Darren Xu , Kuang-Chih Lee

We develop a general framework for constructing distribution-free prediction intervals for time series. Theoretically, we establish explicit bounds on conditional and marginal coverage gaps of estimated prediction intervals, which…

Methodology · Statistics 2023-02-20 Chen Xu , Yao Xie

Conformal prediction is a method of producing prediction sets that can be applied on top of a wide range of prediction algorithms. The method has a guaranteed coverage probability under the standard IID assumption regardless of whether the…

Machine Learning · Computer Science 2014-04-09 Evgeny Burnaev , Vladimir Vovk

Regulatory guidance notes the need for caution in the interpretation of confidence intervals (CIs) constructed during and after an adaptive clinical trial. Conventional CIs of the treatment effects are prone to undercoverage (as well as…

Over the last few decades, various methods have been proposed for estimating prediction intervals in regression settings, including Bayesian methods, ensemble methods, direct interval estimation methods and conformal prediction methods. An…

Machine Learning · Statistics 2024-04-02 Nicolas Dewolf , Bernard De Baets , Willem Waegeman

We adapt split conformal prediction and adaptive conformal inference (ACI) to continuous AI agent evaluation, providing distribution-free coverage guarantees for forecasted quality scores. Conformal intervals achieve calibration error below…

Artificial Intelligence · Computer Science 2026-05-20 Yuxuan Gao , Megan Wang , Yi Ling Yu

Seasonal influenza infects between 10 and 50 million people in the United States every year, overburdening hospitals during weeks of peak incidence. Named by the CDC as an important tool to fight the damaging effects of these epidemics,…

Applications · Statistics 2020-05-19 Thomas McAndrew , Nicholas G. Reich

Conformal predictive systems are sets of predictive distributions with theoretical out-of-sample calibration guarantees. The calibration guarantees are typically that the set of predictions contains a forecast distribution whose prediction…

Methodology · Statistics 2025-11-03 Sam Allen , Enrico Pescara , Johanna Ziegel

We address the problem of conformal selection, where an agent must select a minimal subset of options to ensure that at least one ``success'' is identified with a pre-specified target probability $\phi$. While traditional online conformal…

Machine Learning · Computer Science 2026-05-15 Sreenivas Gollapudi , Kostas Kollias , Kamesh Munagala , Ali Sinop

Conformal prediction is a popular technique for constructing prediction intervals with distribution-free coverage guarantees. The coverage is marginal, meaning it only holds on average over the entire population but not necessarily for any…

Methodology · Statistics 2026-05-28 Yao Zhang , Emmanuel J. Candès

This paper proposes probabilistic conformal prediction (PCP), a predictive inference algorithm that estimates a target variable by a discontinuous predictive set. Given inputs, PCP construct the predictive set based on random samples from…

Machine Learning · Statistics 2022-06-22 Zhendong Wang , Ruijiang Gao , Mingzhang Yin , Mingyuan Zhou , David M. Blei

Causal inference is fundamental across scientific disciplines, yet existing methods struggle to capture instantaneous, time-evolving causal relationships in complex, high-dimensional systems. In this paper, assimilative causal inference…

Machine Learning · Computer Science 2026-02-23 Marios Andreou , Nan Chen , Erik Bollt

Unmeasured confounding is one of the major concerns in causal inference from observational data. Proximal causal inference (PCI) is an emerging methodological framework to detect and potentially account for confounding bias by carefully…

Methodology · Statistics 2025-04-24 Kendrick Li , George C. Linderman , Xu Shi , Eric J. Tchetgen Tchetgen

Given that machine learning algorithms are increasingly being deployed to aid in high stakes decision-making, uncertainty quantification methods that wrap around these black box models such as conformal prediction have received much…

Machine Learning · Statistics 2026-02-09 Kayla E. Scharfstein , Arun Kumar Kuchibhotla

The problem of individualized prediction can be addressed using variants of conformal prediction, obtaining the intervals to which the actual values of the variables of interest belong. Here we present a method based on detecting the…

Methodology · Statistics 2023-04-12 Fernando Delbianco , Fernando Tohmé

Causal inference methods for observational data are highly regarded due to their wide applicability. While there are already numerous methods available for de-confounding bias, these methods generally assume that covariates consist solely…

Methodology · Statistics 2024-04-30 Yonghe Zhao , Huiyan Sun

We introduce a neural network conformal prediction method for time series that enhances adaptivity in non-stationary environments. Our approach acts as a neural controller designed to achieve desired target coverage, leveraging auxiliary…

Machine Learning · Computer Science 2024-12-25 Ruipu Li , Alexander Rodríguez

Conformal predictors are machine learning algorithms developed in the 1990's by Gammerman, Vovk, and their research team, to provide set predictions with guaranteed confidence level. Over recent years, they have grown in popularity and have…

Machine Learning · Computer Science 2025-08-12 Anthony Bellotti , Xindi Zhao

This paper presents adaptive conformal selection (ACS), an interactive framework for model-free selection with guaranteed error control. Building on conformal selection (Jin and Cand\`es, 2023b), ACS generalizes the approach to support…

Methodology · Statistics 2025-07-22 Yu Gui , Ying Jin , Yash Nair , Zhimei Ren