English
Related papers

Related papers: Enhancing Conformal Prediction Using E-Test Statis…

200 papers

Modern deep learning based classifiers show very high accuracy on test data but this does not provide sufficient guarantees for safe deployment, especially in high-stake AI applications such as medical diagnosis. Usually, predictions are…

Machine Learning · Computer Science 2022-05-09 David Stutz , Krishnamurthy , Dvijotham , Ali Taylan Cemgil , Arnaud Doucet

Unlike the typical classification setting where each instance is associated with a single class, in multi-label learning each instance is associated with multiple classes simultaneously. Therefore the learning task in this setting is to…

Machine Learning · Computer Science 2022-11-30 Harris Papadopoulos

Conventional frequentist learning is known to yield poorly calibrated models that fail to reliably quantify the uncertainty of their decisions. Bayesian learning can improve calibration, but formal guarantees apply only under restrictive…

Machine Learning · Statistics 2022-10-07 Sangwoo Park , Kfir M. Cohen , Osvaldo Simeone

Conformal Prediction (CP) provides a statistical framework for uncertainty quantification that constructs prediction sets with coverage guarantees. While CP yields uncontrolled prediction set sizes, Backward Conformal Prediction (BCP)…

Machine Learning · Statistics 2026-05-19 Junxian Liu , Hao Zeng , Hongxin Wei

Conformal prediction (CP) has been a popular method for uncertainty quantification because it is distribution-free, model-agnostic, and theoretically sound. For forecasting problems in supervised learning, most CP methods focus on building…

Machine Learning · Statistics 2024-05-24 Chen Xu , Hanyang Jiang , Yao Xie

This paper discusses a counterpart of conformal prediction for e-values, conformal e-prediction. Conformal e-prediction is conceptually simpler and had been developed in the 1990s as a precursor of conformal prediction. When conformal…

Machine Learning · Computer Science 2025-05-20 Vladimir Vovk

Conformal Prediction (CP) algorithms estimate the uncertainty of a prediction model by calibrating its outputs on labeled data. The same calibration scheme usually applies to any model and data without modifications. The obtained prediction…

Machine Learning · Computer Science 2024-06-27 Nicolo Colombo

The Super Learner (SL) is a widely used ensemble method that combines predictions from a library of learners based on their predictive performance. Interval predictions are of considerable practical interest because they allow uncertainty…

Machine Learning · Statistics 2026-04-27 Zhanli Wu , Fabrizio Leisen , Miguel-Angel Luque-Fernandez , F. Javier Rubio

Conformal prediction (CP) has become a cornerstone of distribution-free uncertainty quantification, conventionally evaluated by its coverage and interval length. This work critically examines the sufficiency of these standard metrics. We…

Machine Learning · Statistics 2026-01-30 Yizhou Min , Yizhou Lu , Lanqi Li , Zhen Zhang , Jiaye Teng

This paper proposes an extension to conventional regression Neural Networks (NNs) for replacing the point predictions they produce with prediction intervals that satisfy a required level of confidence. Our approach follows a novel machine…

Machine Learning · Computer Science 2023-12-18 Harris Papadopoulos , Haris Haralambous

Conformal prediction (CP) is a powerful framework for quantifying uncertainty in machine learning models, offering reliable predictions with finite-sample coverage guarantees. When applied to classification, CP produces a prediction set of…

Machine Learning · Computer Science 2025-08-20 Floris den Hengst , Inès Blin , Majid Mohammadi , Syed Ihtesham Hussain Shah , Taraneh Younesian

Conformal prediction (CP) produces prediction regions with finite-sample, distribution free coverage guarantees, but its interpretation as a quantitative uncertainty tool is often left implicit. We develop a category-theoretic approach that…

Machine Learning · Statistics 2026-05-05 Michele Caprio

Conformal prediction is a distribution-free technique for establishing valid prediction intervals. Although conventionally people conduct conformal prediction in the output space, this is not the only possibility. In this paper, we propose…

Machine Learning · Computer Science 2023-04-11 Jiaye Teng , Chuan Wen , Dinghuai Zhang , Yoshua Bengio , Yang Gao , Yang Yuan

In this paper, we present a novel approach for conformal prediction (CP), in which we aim to identify a set of promising prediction candidates -- in place of a single prediction. This set is guaranteed to contain a correct answer with high…

Machine Learning · Computer Science 2021-02-03 Adam Fisch , Tal Schuster , Tommi Jaakkola , Regina Barzilay

Conformal prediction (CP) is a framework to quantify uncertainty of machine learning classifiers including deep neural networks. Given a testing example and a trained classifier, CP produces a prediction set of candidate labels with a…

Machine Learning · Computer Science 2023-08-01 Subhankar Ghosh , Yuanjie Shi , Taha Belkhouja , Yan Yan , Jana Doppa , Brian Jones

The integration of renewable energy into electricity markets poses significant challenges to price stability and increases the complexity of market operations. Accurate and reliable electricity price forecasting is crucial for effective…

Machine Learning · Computer Science 2025-02-10 Ciaran O'Connor , Mohamed Bahloul , Roberto Rossi , Steven Prestwich , Andrea Visentin

Conformal Prediction (CP) allows to perform rigorous uncertainty quantification by constructing a prediction set $C(X)$ satisfying $\mathbb{P}(Y \in C(X))\geq 1-\alpha$ for a user-chosen $\alpha \in [0,1]$ by relying on calibration data…

Machine Learning · Computer Science 2023-10-25 David Stutz , Abhijit Guha Roy , Tatiana Matejovicova , Patricia Strachan , Ali Taylan Cemgil , Arnaud Doucet

Conformal Prediction (CP) is a principled framework for quantifying uncertainty in blackbox learning models, by constructing prediction sets with finite-sample coverage guarantees. Traditional approaches rely on scalar nonconformity scores,…

Machine Learning · Statistics 2025-05-07 Gauthier Thurin , Kimia Nadjahi , Claire Boyer

There is a useful counterpart of conformal prediction for e-values, called conformal e-prediction. Conformal prediction can serve as basis for testing the assumption of exchangeability, leading to conformal testing. Similarly, conformal…

Statistics Theory · Mathematics 2024-11-05 Vladimir Vovk , Ilia Nouretdinov , Alex Gammerman

While counterfactual fairness of point predictors is well studied, its extension to prediction sets--central to fair decision-making under uncertainty--remains underexplored. On the other hand, conformal prediction (CP) provides efficient,…

Machine Learning · Computer Science 2026-03-13 Ozgur Guldogan , Neeraj Sarna , Yuanyuan Li , Michael Berger