English
Related papers

Related papers: Split Conformal Prediction and Non-Exchangeable Da…

200 papers

Existing evaluations of conformal prediction, such as prediction efficiency and test-conditional coverage, are defined in expectation over the calibration data. In practice, when only one calibration set of limited size is available,…

Methodology · Statistics 2026-05-05 Yinjie Min , Liuhua Peng , Changliang Zou

Safe deployment of deep neural networks in high-stake real-world applications requires theoretically sound uncertainty quantification. Conformal prediction (CP) is a principled framework for uncertainty quantification of deep models in the…

Machine Learning · Computer Science 2023-03-21 Subhankar Ghosh , Taha Belkhouja , Yan Yan , Janardhan Rao Doppa

Conformal prediction is widely used to equip black-box machine learning models with uncertainty quantification, offering formal coverage guarantees under exchangeable data. However, these guarantees fail when faced with subpopulation…

Machine Learning · Computer Science 2025-11-10 Nien-Shao Wang , Duygu Nur Yaldiz , Yavuz Faruk Bakman , Sai Praneeth Karimireddy

Weighted conformal prediction (WCP) has been commonly used to quantify prediction uncertainty under covariate shift. However, the effectiveness of WCP relies heavily on the degree of overlap between the training and test covariate…

Methodology · Statistics 2026-04-02 Mufang Ying , Wenge Guo , Koulik Khamaru , Ying Hung

Conformal prediction provides a distribution-free framework for uncertainty quantification. This study explores the application of conformal prediction in scenarios where covariates are missing, which introduces significant challenges for…

Methodology · Statistics 2025-09-09 Jingsen Kong , YIming Liu , Guangren Yang

Uncertainty quantification has received considerable interest in recent works in Machine Learning. In particular, Conformal Prediction (CP) gains ground in this field. For the case of time series, Online Conformal Prediction (OCP) becomes…

Machine Learning · Computer Science 2025-11-03 Théo Dupuy , Binbin Xu , Stéphane Perrey , Jacky Montmain , Abdelhak Imoussaten

Accurate uncertainty measurement is a key step to building robust and reliable machine learning systems. Conformal prediction is a distribution-free uncertainty quantification algorithm popular for its ease of implementation, statistical…

Machine Learning · Computer Science 2024-03-20 Sophia Sun , Rose Yu

Conformal Prediction (CP) is a principled framework for quantifying uncertainty in blackbox learning models, by constructing prediction sets with finite-sample coverage guarantees. Traditional approaches rely on scalar nonconformity scores,…

Machine Learning · Statistics 2025-05-07 Gauthier Thurin , Kimia Nadjahi , Claire Boyer

Precise estimation of predictive uncertainty in deep neural networks is a critical requirement for reliable decision-making in machine learning and statistical modeling, particularly in the context of medical AI. Conformal Prediction (CP)…

Machine Learning · Computer Science 2024-01-05 Hamed Karimi , Reza Samavi

The Gaussian process (GP) is a Bayesian nonparametric paradigm that is widely adopted for uncertainty quantification (UQ) in a number of safety-critical applications, including robotics, healthcare, as well as surveillance. The consistency…

Machine Learning · Computer Science 2024-10-10 Jinwen Xu , Qin Lu , Georgios B. Giannakis

Statistical change point (CP) detection methods typically rely on likelihood-based inference and ignore contextual information about plausible CP locations beyond the observed sequence. Although informative priors provide a natural way to…

Methodology · Statistics 2026-05-05 Jonathon Jacobs , Shanshan Chen

Machine-learning techniques are essential in modern collider research, yet their probabilistic outputs often lack calibrated uncertainty estimates and finite-sample guarantees, limiting their direct use in statistical inference and…

High Energy Physics - Phenomenology · Physics 2025-12-22 Jack Y. Araz , Michael Spannowsky

Conformal Prediction (CP) allows to perform rigorous uncertainty quantification by constructing a prediction set $C(X)$ satisfying $\mathbb{P}(Y \in C(X))\geq 1-\alpha$ for a user-chosen $\alpha \in [0,1]$ by relying on calibration data…

Machine Learning · Computer Science 2023-10-25 David Stutz , Abhijit Guha Roy , Tatiana Matejovicova , Patricia Strachan , Ali Taylan Cemgil , Arnaud Doucet

The rapid growth of AI applications is dramatically increasing data center energy demand, exacerbating carbon emissions, and necessitating a shift towards 24/7 carbon-free energy (CFE). Unlike traditional annual energy matching, 24/7 CFE…

Systems and Control · Electrical Eng. & Systems 2025-10-07 Yijie Yang , Jian Shi , Dan Wang , Chenye Wu , Zhu Han

Conformal prediction is a powerful tool to generate uncertainty sets with guaranteed coverage using any predictive model, under the assumption that the training and test data are i.i.d.. Recently, it has been shown that adversarial examples…

Machine Learning · Computer Science 2024-05-01 Ge Yan , Yaniv Romano , Tsui-Wei Weng

We present a new method for generating confidence sets within the split conformal prediction framework. Our method performs a trainable transformation of any given conformity score to improve conditional coverage while ensuring exact…

Surrogate models (including deep neural networks and other machine learning algorithms in supervised learning) are capable of approximating arbitrarily complex, high-dimensional input-output problems in science and engineering, but require…

Machine Learning · Computer Science 2025-12-17 Miguel Sánchez-Domínguez , Lucas Lacasa , Javier de Vicente , Gonzalo Rubio , Eusebio Valero

Clustering attempts to partition data instances into several distinctive groups, while the similarities among data belonging to the common partition can be principally reserved. Furthermore, incomplete data frequently occurs in many…

Machine Learning · Computer Science 2022-08-30 Miao Cheng , Xinge You

Recently there has been a surge of interest to deploy confidence set predictions rather than point predictions in machine learning. Unfortunately, the effectiveness of such prediction sets is frequently impaired by distribution shifts in…

Machine Learning · Computer Science 2025-08-14 Kevin Kasa , Zhiyu Zhang , Heng Yang , Graham W. Taylor

In online selective conformal inference, data arrives sequentially, and prediction intervals are constructed only when an online selection rule is met. Since online selections may break the exchangeability between the selected test datum…

Machine Learning · Statistics 2025-03-24 Yusuf Sale , Aaditya Ramdas