中文
相关论文

相关论文: A Unified Theory of Conditional Coverage in Confor…

200 篇论文

We investigate generically applicable and intuitively appealing prediction intervals based on $k$-fold cross validation. We focus on the conditional coverage probability of the proposed intervals, given the observations in the training…

统计理论 · 数学 2022-05-13 Lukas Steinberger , Hannes Leeb

We give a finite-sample analysis of predictive inference procedures after model selection in regression with random design. The analysis is focused on a statistically challenging scenario where the number of potentially important…

统计理论 · 数学 2009-08-26 Hannes Leeb

Given data on a random variable \(Y\), a prediction set with miscoverage level \(\alpha \in (0,1)\) is a set that contains a new draw of \(Y\) with probability \(1-\alpha\). Among all prediction sets satisfying this coverage property, the…

计量经济学 · 经济学 2026-02-24 Weiguang Liu , Áureo de Paula , Elie Tamer

Counterfactual explanations (CFXs) provide human-understandable justifications for model predictions, enabling actionable recourse and enhancing interpretability. To be reliable, CFXs must avoid regions of high predictive uncertainty, where…

机器学习 · 计算机科学 2025-10-24 Aman Bilkhoo , Mehran Hosseini , Milad Kazemi , Nicola Paoletti

Uncertainty quantification for neural operators remains an open problem in the infinite-dimensional setting due to the lack of finite-sample coverage guarantees over functional outputs. While conformal prediction offers finite-sample…

机器学习 · 计算机科学 2025-09-08 David Millard , Lars Lindemann , Ali Baheri

We introduce new inference procedures for counterfactual and synthetic control methods for policy evaluation. We recast the causal inference problem as a counterfactual prediction and a structural breaks testing problem. This allows us to…

计量经济学 · 经济学 2022-01-26 Victor Chernozhukov , Kaspar Wüthrich , Yinchu Zhu

Distribution-free uncertainty estimation for ensemble methods is increasingly desirable due to the widening deployment of multi-modal black-box predictive models. Conformal prediction is one approach that avoids such distributional…

统计方法学 · 统计学 2025-05-26 Eduardo Ochoa Rivera , Yash Patel , Ambuj Tewari

Conformal prediction is often calibrated with a single pooled threshold, but this can hide cross-group heterogeneity in score distributions and distort group-wise coverage. We study this phenomenon through the population score distributions…

Conformal prediction is a powerful framework for constructing prediction sets with valid coverage guarantees in multi-class classification. However, existing methods often rely on a single score function, which can limit their efficiency…

机器学习 · 统计学 2025-03-05 Rui Luo , Zhixin Zhou

Conformal prediction is a general distribution-free approach for constructing prediction sets combined with any machine learning algorithm that achieve valid marginal or conditional coverage in finite samples. Ordinal classification is…

统计方法学 · 统计学 2024-11-05 Subhrasish Chakraborty , Chhavi Tyagi , Haiyan Qiao , Wenge Guo

Conformal Prediction offers a powerful framework for quantifying uncertainty in machine learning models, enabling the construction of prediction sets with finite-sample validity guarantees. While easily adaptable to non-probabilistic…

机器学习 · 统计学 2024-11-27 Eshant English , Christoph Lippert

Conformal Prediction (CP) provides a statistical framework for uncertainty quantification that constructs prediction sets with coverage guarantees. While CP yields uncontrolled prediction set sizes, Backward Conformal Prediction (BCP)…

机器学习 · 统计学 2026-05-19 Junxian Liu , Hao Zeng , Hongxin Wei

Achieving valid conditional coverage in conformal prediction is challenging due to the theoretical difficulty of satisfying pointwise constraints in finite samples. Building upon the characterization of conditional coverage through marginal…

统计方法学 · 统计学 2026-05-13 Yajie Bao , Chuchen Zhang , Zhaojun Wang , Haojie Ren , Changliang Zou

As large language models (LLMs) gain popularity in conducting prediction tasks in-context, understanding the sources of uncertainty in in-context learning becomes essential to ensuring reliability. The recent hypothesis of in-context…

Typically, machine learning models are trained and evaluated without making any distinction between users (e.g, using traditional hold-out and cross-validation). However, this produces inaccurate performance metrics estimates in multi-user…

机器学习 · 计算机科学 2023-12-11 Enrique Garcia-Ceja , Luciano Garcia-Banuelos , Nicolas Jourdan

We propose conformal hyperrectangular prediction regions for multi-target regression. We propose split conformal prediction algorithms for both point and quantile regression to form hyperrectangular prediction regions, which allow for easy…

统计方法学 · 统计学 2024-06-10 Max Sampson , Kung-Sik Chan

We develop fast distribution-free conformal prediction algorithms for obtaining multivalid coverage on exchangeable data in the batch setting. Multivalid coverage guarantees are stronger than marginal coverage guarantees in two ways: (1)…

机器学习 · 计算机科学 2022-10-03 Christopher Jung , Georgy Noarov , Ramya Ramalingam , Aaron Roth

Conformal prediction (CP) constructs prediction sets with marginal coverage guarantees under the assumption that the calibration and test distributions are identical. However, under distribution shift, existing approaches primarily align…

机器学习 · 计算机科学 2026-05-05 Rui Xu , Xingyuan Chen , Wenxing Huang , Minxuan Huang , Weiyan Chen , Sihong Xie , Hui Xiong

Conformal prediction is a distribution-free uncertainty quantification method that has gained popularity in the machine learning community due to its finite-sample guarantees and ease of use. Its most common variant, dubbed split conformal…

机器学习 · 计算机科学 2025-10-27 Alvaro H. C. Correia , Christos Louizos

Reliable uncertainty quantification is critical for trustworthy AI. Conformal Prediction (CP) provides prediction sets with distribution-free coverage guarantees, but its two main variants face complementary limitations. Split CP (SCP)…

机器学习 · 计算机科学 2025-11-20 Weicao Deng , Sangwoo Park , Min Li , Osvaldo Simeone