English
Related papers

Related papers: Selecting informative conformal prediction sets wi…

200 papers

Classical machine learning classifiers tend to be overconfident can be unreliable outside of the laboratory benchmarks. Properly assessing the reliability of the output of the model per sample is instrumental for real-life scenarios where…

Artificial Intelligence · Computer Science 2025-11-07 Javier Fumanal-Idocin , Javier Andreu-Perez

Standard conformal prediction methods provide a marginal coverage guarantee, which means that for a random test point, the conformal prediction set contains the true label with a user-specified probability. In many classification problems,…

Informed learning is an emerging field in machine learning that aims to compensate for insufficient data with prior knowledge. Shape knowledge covers many types of prior knowledge concerning the relationship of a function's output with…

Optimization and Control · Mathematics 2024-09-26 Miltiadis Poursanidis , Patrick Link , Jochen Schmid , Uwe Teicher

Given data on a random variable \(Y\), a prediction set with miscoverage level \(\alpha \in (0,1)\) is a set that contains a new draw of \(Y\) with probability \(1-\alpha\). Among all prediction sets satisfying this coverage property, the…

Econometrics · Economics 2026-02-24 Weiguang Liu , Áureo de Paula , Elie Tamer

Reliable semantic segmentation is essential for clinical decision making, yet deep models rarely provide explicit statistical guarantees on their errors. We introduce a simple post-hoc framework that constructs confidence masks with…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Luca Mossina , Corentin Friedrich

Conformal prediction has emerged as an effective strategy for uncertainty quantification by modifying a model to output sets of labels instead of a single label. These prediction sets come with the guarantee that they contain the true label…

Machine Learning · Computer Science 2025-05-28 Haosen Ge , Hamsa Bastani , Osbert Bastani

Zero-inflated outcomes, where responses are zero with positive probability and otherwise continuous, are common in biomedical, environmental, and social science studies. We propose a conformal prediction based framework that provides…

In statistics, forecast uncertainty is often quantified using a specified statistical model, though such approaches may be vulnerable to model misspecification, selection bias, and limited finite-sample validity. While bootstrapping can…

Methodology · Statistics 2026-03-12 Han Lin Shang

Conformal Prediction (CP) is a powerful framework for constructing prediction sets with guaranteed coverage. However, recent studies have shown that integrating confidence calibration with CP can lead to a degradation in efficiency. In this…

Machine Learning · Computer Science 2024-07-25 Rui Luo , Nicolo Colombo

Conformal Prediction (CP) is a principled framework for quantifying uncertainty in blackbox learning models, by constructing prediction sets with finite-sample coverage guarantees. Traditional approaches rely on scalar nonconformity scores,…

Machine Learning · Statistics 2025-05-07 Gauthier Thurin , Kimia Nadjahi , Claire Boyer

Conformal prediction uses past experience to determine precise levels of confidence in new predictions. Given an error probability $\epsilon$, together with a method that makes a prediction $\hat{y}$ of a label $y$, it produces a set of…

Machine Learning · Computer Science 2019-04-23 Glenn Shafer , Vladimir Vovk

Conformal Prediction (CP) is a widely used technique for quantifying uncertainty in machine learning models. In its standard form, CP offers probabilistic guarantees on the coverage of the true label, but it is agnostic to sensitive…

Machine Learning · Computer Science 2025-09-30 Anutam Srinivasan , Aditya T. Vadlamani , Amin Meghrazi , Srinivasan Parthasarathy

We consider the problem of constructing distribution-free prediction sets for data from two-layer hierarchical distributions. For iid data, prediction sets can be constructed using the method of conformal prediction. The validity of…

Methodology · Statistics 2022-02-25 Robin Dunn , Larry Wasserman , Aaditya Ramdas

Conformal Prediction (CP) provides distribution-free uncertainty quantification by constructing prediction sets that guarantee coverage of the true labels. This reliability makes CP valuable for high-stakes federated learning scenarios such…

Machine Learning · Computer Science 2025-10-21 Rui Xu , Xingyuan Chen , Wenxing Huang , Minxuan Huang , Yun Xie , Weiyan Chen , Sihong Xie

When one observes a sequence of variables $(x_1, y_1), \ldots, (x_n, y_n)$, Conformal Prediction (CP) is a methodology that allows to estimate a confidence set for $y_{n+1}$ given $x_{n+1}$ by merely assuming that the distribution of the…

Machine Learning · Statistics 2022-12-08 Eugene Ndiaye

In real-world settings involving consequential decision-making, the deployment of machine learning systems generally requires both reliable uncertainty quantification and protection of individuals' privacy. We present a framework that…

Machine Learning · Computer Science 2024-03-05 Anastasios N. Angelopoulos , Stephen Bates , Tijana Zrnic , Michael I. Jordan

The conformalClassification package implements Transductive Conformal Prediction (TCP) and Inductive Conformal Prediction (ICP) for classification problems. Conformal Prediction (CP) is a framework that complements the predictions of…

Machine Learning · Statistics 2018-04-17 Niharika Gauraha , Ola Spjuth

Recent advances in object detectors have led to their adoption for industrial uses. However, their deployment in safety-critical applications is hindered by the inherent lack of reliability of neural networks and the complex structure of…

Machine Learning · Statistics 2025-11-03 Léo andéol , Luca Mossina , Adrien Mazoyer , Sébastien Gerchinovitz

Forecasting surgical instrument trajectories and predicting the next surgical action recently started to attract attention from the research community. Both these tasks are crucial for automation and assistance in endoscopy surgery. Given…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Sara Sangalli , Gary Sarwin , Ertunc Erdil , Alessandro Carretta , Victor Staartjes , Carlo Serra , Ender Konukoglu

Robust optimization safeguards decisions against uncertainty by optimizing against worst-case scenarios, yet their effectiveness hinges on a prespecified robustness level that is often chosen ad hoc, leading to either insufficient…

Machine Learning · Statistics 2026-02-02 Wenbin Zhou , Shixiang Zhu