English
Related papers

Related papers: KMM-CP: Practical Conformal Prediction under Covar…

200 papers

Conformal prediction (CP) has become a cornerstone of distribution-free uncertainty quantification, conventionally evaluated by its coverage and interval length. This work critically examines the sufficiency of these standard metrics. We…

Machine Learning · Statistics 2026-01-30 Yizhou Min , Yizhou Lu , Lanqi Li , Zhen Zhang , Jiaye Teng

Conformal prediction has received tremendous attention in recent years and has offered new solutions to problems in missing data and causal inference; yet these advances have not leveraged modern semiparametric efficiency theory for more…

Methodology · Statistics 2022-12-14 Yachong Yang , Arun Kumar Kuchibhotla , Eric Tchetgen Tchetgen

Uncertainty quantification is essential for scientific analysis, as it allows for the evaluation and interpretation of variability and reliability in complex systems and datasets. In their original form, multivariate statistical regression…

Conformal prediction (CP) is a powerful framework for quantifying uncertainty in machine learning models, offering reliable predictions with finite-sample coverage guarantees. When applied to classification, CP produces a prediction set of…

Machine Learning · Computer Science 2025-08-20 Floris den Hengst , Inès Blin , Majid Mohammadi , Syed Ihtesham Hussain Shah , Taraneh Younesian

Conformal prediction is a simple and powerful tool that can quantify uncertainty without any distributional assumptions. Many existing methods only address the average coverage guarantee, which is not ideal compared to the stronger…

Machine Learning · Statistics 2023-02-21 Xing Han , Ziyang Tang , Joydeep Ghosh , Qiang Liu

Large Language Models (LLMs) have shown remarkable progress in multiple-choice question answering (MCQA), but their inherent unreliability, such as hallucination and overconfidence, limits their application in high-risk domains. To address…

Computation and Language · Computer Science 2025-08-08 Guang Yang , Xinyang Liu

We present Distribution-aware Conformal Prediction (DCP), a unified framework integrating probabilistic predictors like Monte Carlo dropout, deep ensembles, and quantile regression with score-agnostic conformal calibration to produce valid…

Machine Learning · Computer Science 2026-05-27 Daniel Schweizer , Peter Kuhn , Jayant Sharma , Shivali Dubey , Malte von Ramin , Christoph Brockt-Haßauer

This research leverages Conformal Prediction (CP) in the form of Conformal Predictive Systems (CPS) to accurately estimate uncertainty in a suite of machine learning (ML)-based radio metric models [1] as well as in a 2-D map-based ML path…

Machine Learning · Computer Science 2025-01-14 Alexis Bose , Jonathan Ethier , Ryan G. Dempsey , Yifeng Qiu

Irradiation-induced void swelling is a critical degradation mechanism for structural materials in nuclear reactors, dictating component operational lifespan and safety. While recent machine learning (ML) approaches have improved the…

Applications · Statistics 2026-03-03 Minhee Kim , Yong Yang

Recent advances in uncertainty quantification for time series forecasting show that conformal prediction can provide reliable prediction intervals, yet standard conformal methods are often inefficient under temporal dependence, drift, and…

Machine Learning · Computer Science 2026-05-12 Manuel Heurich , Maximilian Granz , Tim Landgraf

We introduce a method based on Conformal Prediction (CP) to quantify the uncertainty of full ranking algorithms. We focus on a specific scenario where $n+m$ items are to be ranked by some ``black box'' algorithm. It is assumed that the…

Machine Learning · Computer Science 2025-12-04 Jean-Baptiste Fermanian , Pierre Humbert , Gilles Blanchard

Conformal prediction (CP) is widely presented as distribution-free predictive inference with finite-sample marginal coverage under exchangeability. We argue that CP is best understood as a rank-calibrated descendant of the…

Statistics Theory · Mathematics 2025-12-30 Jyotishka Datta , Nicholas G. Polson , Vadim Sokolov , Daniel Zantedeschi

Conformal prediction (CP) provides distribution-free, finite-sample coverage guarantees but critically relies on exchangeability, a condition often violated under distribution shift. We study the robustness of split conformal prediction…

Machine Learning · Statistics 2025-12-23 Xunlei Qian , Yue Xing

When a machine learning model is deployed, its predictions can alter its environment, as better informed agents strategize to suit their own interests. With such alterations in mind, existing approaches to uncertainty quantification break.…

Machine Learning · Statistics 2024-11-05 Daniel Csillag , Claudio José Struchiner , Guilherme Tegoni Goedert

We study the problem of conditional predictive inference on multiple outcomes missing at random (MAR) -- or equivalently, under covariate shift. While the weighted conformal prediction offers a tool for inference under covariate shift with…

Methodology · Statistics 2025-08-01 Yonghoon Lee , Edgar Dobriban , Eric Tchetgen Tchetgen

Conformal prediction is a framework that provides valid uncertainty quantification for general models with exchangeable data. However, in the online learning and time-series settings, exchangeability is not satisfied. Existing online…

Machine Learning · Computer Science 2026-05-11 Yuheng Lai , Garvesh Raskutti

Conformal Prediction (CP) is a distribution-free framework for constructing statistically rigorous prediction sets. While popular variants such as CD-split improve CP's efficiency, they often yield prediction sets composed of multiple…

Machine Learning · Statistics 2025-09-29 Mingyi Zheng , Hongyu Jiang , Yizhou Lu , Jiaye Teng

In this work, we aim at augmenting the decisions output by quantum models with "error bars" that provide finite-sample coverage guarantees. Quantum models implement implicit probabilistic predictors that produce multiple random decisions…

Quantum Physics · Physics 2023-10-24 Sangwoo Park , Osvaldo Simeone

This paper studies the use of conformal prediction (CP), an emerging probabilistic forecasting method, for day-ahead photovoltaic power predictions to enhance participation in electricity markets. First, machine learning models are used to…

Machine Learning · Computer Science 2024-04-01 Yvet Renkema , Nico Brinkel , Tarek Alskaif

Conformal prediction (CP) produces prediction regions with finite-sample, distribution free coverage guarantees, but its interpretation as a quantitative uncertainty tool is often left implicit. We develop a category-theoretic approach that…

Machine Learning · Statistics 2026-05-05 Michele Caprio