English
Related papers

Related papers: Prediction Sets and Conformal Inference with Inter…

200 papers

We propose several prediction intervals procedures for the individual treatment effect with either finite-sample or asymptotic coverage guarantee in a non-parametric regression setting, where non-linear regression functions,…

Methodology · Statistics 2020-06-03 Danijel Kivaranovic , Robin Ristl , Martin Posch , Hannes Leeb

Medical imaging classifiers can achieve high predictive accuracy, but quantifying their uncertainty remains an unresolved challenge, which prevents their deployment in medical clinics. We present an algorithm that can modify any classifier…

Machine Learning · Computer Science 2024-08-12 Roy Hirsch , Jacob Goldberger

Given that machine learning algorithms are increasingly being deployed to aid in high stakes decision-making, uncertainty quantification methods that wrap around these black box models such as conformal prediction have received much…

Machine Learning · Statistics 2026-02-09 Kayla E. Scharfstein , Arun Kumar Kuchibhotla

As machine learning models are increasingly deployed in dynamic environments, it becomes paramount to assess and quantify uncertainties associated with distribution shifts. A distribution shift occurs when the underlying data-generating…

Methodology · Statistics 2024-10-08 Jiawei Ge , Debarghya Mukherjee , Jianqing Fan

Selective conformal prediction can yield substantially tighter uncertainty sets when we can identify calibration examples that are exchangeable with the test example. In interventional settings, such as perturbation experiments in genomics,…

Machine Learning · Computer Science 2026-03-03 Amir Asiaee , Kavey Aryan , James P. Long

Conformal inference is a statistical method used to construct prediction sets for point predictors, providing reliable uncertainty quantification with probability guarantees. This method utilizes historical labeled data to estimate the…

Machine Learning · Computer Science 2024-11-05 Xiaoyi Su , Zhixin Zhou , Rui Luo

We present a new method for generating confidence sets within the split conformal prediction framework. Our method performs a trainable transformation of any given conformity score to improve conditional coverage while ensuring exact…

Conformal prediction is a generic methodology for finite-sample valid distribution-free prediction. This technique has garnered a lot of attention in the literature partly because it can be applied with any machine learning algorithm that…

Methodology · Statistics 2024-04-12 Yachong Yang , Arun Kumar Kuchibhotla

Uncertainty estimation has been extensively studied in recent literature, which can usually be classified as aleatoric uncertainty and epistemic uncertainty. In current aleatoric uncertainty estimation frameworks, it is often neglected that…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Jing Zhang , Yuchao Dai , Mehrtash Harandi , Yiran Zhong , Nick Barnes , Richard Hartley

Predictive algorithms inform consequential decisions in settings with selective labels: outcomes are observed only for units selected by past decision makers. This creates an identification problem under unobserved confounding -- when…

Econometrics · Economics 2025-11-07 Ashesh Rambachan , Amanda Coston , Edward Kennedy

A subvector of predictor that satisfies the ignorability assumption, whose index set is called a sufficient adjustment set, is crucial for conducting reliable causal inference based on observational data. In this paper, we propose a general…

Methodology · Statistics 2024-08-20 Wei Luo , Fei Qin , Lixing Zhu

Confidence sets play a fundamental role in statistical inference. In this paper, we consider confidence intervals for high dimensional linear regression with random design. We first establish the convergence rates of the minimax expected…

Statistics Theory · Mathematics 2015-11-30 T. Tony Cai , Zijian Guo

Under adaptive progressive Type-II censoring schemes, order restricted inference based on competing risks data is discussed in this article. The latent failure lifetimes for the competing causes are assumed to follow Weibull distributions,…

Methodology · Statistics 2022-05-10 Ayon Ganguly , Debanjan Mitra , Debasis Kundu

Conformal prediction provides a distribution-free framework for uncertainty quantification via prediction sets with exact finite-sample coverage. In low dimensions these sets are easy to interpret, but in high-dimensional or structured…

Machine Learning · Statistics 2026-05-08 Trevor Harris

We study prediction-powered conditional inference in the setting where labeled data are scarce, unlabeled covariates are abundant, and a black-box machine-learning predictor is available. The goal is to perform statistical inference on…

Machine Learning · Statistics 2026-03-09 Yang Sui , Jin Zhou , Hua Zhou , Xiaowu Dai

Confidence interval procedures used in low dimensional settings are often inappropriate for high dimensional applications. When a large number of parameters are estimated, marginal confidence intervals associated with the most significant…

Methodology · Statistics 2017-02-24 Jean Morrison , Noah Simon

Evaluating conditional coverage remains one of the most persistent challenges in assessing the reliability of predictive systems. Although conformal methods can give guarantees on marginal coverage, no method can guarantee to produce sets…

Machine Learning · Statistics 2025-12-15 Sacha Braun , David Holzmüller , Michael I. Jordan , Francis Bach

This paper proposes an extension to conventional regression Neural Networks (NNs) for replacing the point predictions they produce with prediction intervals that satisfy a required level of confidence. Our approach follows a novel machine…

Machine Learning · Computer Science 2023-12-18 Harris Papadopoulos , Haris Haralambous

When a machine learning model is deployed, its predictions can alter its environment, as better informed agents strategize to suit their own interests. With such alterations in mind, existing approaches to uncertainty quantification break.…

Machine Learning · Statistics 2024-11-05 Daniel Csillag , Claudio José Struchiner , Guilherme Tegoni Goedert

Conformal Prediction (CP) is a popular method for uncertainty quantification with machine learning models. While conformal prediction provides probabilistic guarantees regarding the coverage of the true label, these guarantees are agnostic…

Machine Learning · Computer Science 2025-10-21 Aditya T. Vadlamani , Anutam Srinivasan , Pranav Maneriker , Ali Payani , Srinivasan Parthasarathy