English
Related papers

Related papers: AutoCP: Automated Pipelines for Accurate Predictio…

200 papers

Before delegating a task to an autonomous system, a human operator may want a guarantee about the behavior of the system. This paper extends previous work on conformal prediction for functional data and conformalized quantile regression to…

Machine Learning · Computer Science 2022-06-23 Thomas G. Dietterich , Jesse Hostetler

Conformal Prediction (CP) is a popular method for uncertainty quantification with machine learning models. While conformal prediction provides probabilistic guarantees regarding the coverage of the true label, these guarantees are agnostic…

Machine Learning · Computer Science 2025-10-21 Aditya T. Vadlamani , Anutam Srinivasan , Pranav Maneriker , Ali Payani , Srinivasan Parthasarathy

Uncertainty quantification is essential in decision-making, especially when joint distributions of random variables are involved. While conformal prediction provides distribution-free prediction sets with valid coverage guarantees, it…

Machine Learning · Computer Science 2025-01-03 Rui Luo , Zhixin Zhou

Reliable confidence measures of metrics derived from medical imaging reconstruction pipelines would improve the standard of decision-making in many clinical workflows. Conformal Prediction (CP) provides a robust framework for producing…

Conformal prediction is a framework for uncertainty quantification that constructs prediction sets for previously unseen data, guaranteeing coverage of the true label with a specified probability. However, the efficiency of these prediction…

Machine Learning · Computer Science 2026-01-06 Erfan Hajihashemi , Yanning Shen

We discuss a concept denoted as Conformal Prediction (CP) in this paper. While initially stemming from the world of machine learning, it was never applied or analyzed in the context of short-term electricity price forecasting. Therefore, we…

Econometrics · Economics 2020-11-17 Christopher Kath , Florian Ziel

Conformal prediction (CP), a distribution-free uncertainty quantification (UQ) framework, reliably provides valid predictive inference for black-box models. CP constructs prediction sets that contain the true output with a specified…

Machine Learning · Computer Science 2025-03-12 Xiaofan Zhou , Baiting Chen , Yu Gui , Lu Cheng

Conformal prediction (CP) generates a set of predictions for a given test sample such that the prediction set almost always contains the true label (e.g., 99.5\% of the time). CP provides comprehensive predictions on possible labels of a…

Machine Learning · Computer Science 2023-09-12 Yizhe Zhang , Shuo Wang , Yejia Zhang , Danny Z. Chen

Conformal prediction offers a powerful framework for building distribution-free prediction intervals for exchangeable data. Existing methods that extend conformal prediction to sequential data rely on fitting a relatively complex model to…

Machine Learning · Computer Science 2026-03-03 Roberto Neglia , Andrea Cini , Michael M. Bronstein , Filippo Maria Bianchi

Conformal prediction methodologies have significantly advanced the quantification of uncertainties in predictive models. Yet, the construction of confidence regions for model parameters presents a notable challenge, often necessitating…

Machine Learning · Statistics 2024-05-30 Charles Guille-Escuret , Eugene Ndiaye

Automated machine learning (AutoML) streamlines the creation of ML models. While most methods select the "best" model based on predictive quality, it's crucial to acknowledge other aspects, such as interpretability and resource consumption.…

Machine Learning · Computer Science 2023-12-21 Raphael Fischer , Amal Saadallah

Conformal prediction (CP) has been a popular method for uncertainty quantification because it is distribution-free, model-agnostic, and theoretically sound. For forecasting problems in supervised learning, most CP methods focus on building…

Machine Learning · Statistics 2024-05-24 Chen Xu , Hanyang Jiang , Yao Xie

Conformal Prediction (CP) algorithms estimate the uncertainty of a prediction model by calibrating its outputs on labeled data. The same calibration scheme usually applies to any model and data without modifications. The obtained prediction…

Machine Learning · Computer Science 2024-06-27 Nicolo Colombo

Deep learning models in robotics often output point estimates with poorly calibrated confidences, offering no native mechanism to quantify predictive reliability under novel, noisy, or out-of-distribution inputs. Conformal prediction (CP)…

Robotics · Computer Science 2025-09-29 Divake Kumar , Sina Tayebati , Francesco Migliarba , Ranganath Krishnan , Amit Ranjan Trivedi

Conformal prediction (CP) is a method for constructing a prediction interval around the output of a fitted model, whose validity does not rely on the model being correct--the CP interval offers a coverage guarantee that is…

Methodology · Statistics 2025-04-17 Aabesh Bhattacharyya , Rina Foygel Barber

Machine-learning techniques are essential in modern collider research, yet their probabilistic outputs often lack calibrated uncertainty estimates and finite-sample guarantees, limiting their direct use in statistical inference and…

High Energy Physics - Phenomenology · Physics 2025-12-22 Jack Y. Araz , Michael Spannowsky

Conformal prediction (CP) is a wrapper around traditional machine learning models, giving coverage guarantees under the sole assumption of exchangeability; in classification problems, for a chosen significance level $\varepsilon$, CP…

Machine Learning · Computer Science 2023-02-23 Javier Abad , Umang Bhatt , Adrian Weller , Giovanni Cherubin

Conformal Prediction (CP) is a powerful statistical machine learning tool to construct uncertainty sets with coverage guarantees, which has fueled its extensive adoption in generating prediction regions for decision-making tasks, e.g.,…

Optimization and Control · Mathematics 2025-10-21 Han Wang , Chao Ning

Deploying trustworthy AI systems requires principled uncertainty quantification. Conformal prediction (CP) is a widely used framework for constructing prediction sets with distribution-free coverage guarantees. In many practical settings,…

Machine Learning · Computer Science 2026-03-18 Haifeng Wen , Osvaldo Simeone , Hong Xing

Conformal prediction (CP) for regression can be challenging, especially when the output distribution is heteroscedastic, multimodal, or skewed. Some of the issues can be addressed by estimating a distribution over the output, but in…

Machine Learning · Computer Science 2024-04-15 Etash Guha , Shlok Natarajan , Thomas Möllenhoff , Mohammad Emtiyaz Khan , Eugene Ndiaye