English
Related papers

Related papers: A Post-Processing Conformal Prediction Approach fo…

200 papers

Conformal Prediction (CP) allows to perform rigorous uncertainty quantification by constructing a prediction set $C(X)$ satisfying $\mathbb{P}(Y \in C(X))\geq 1-\alpha$ for a user-chosen $\alpha \in [0,1]$ by relying on calibration data…

Machine Learning · Computer Science 2023-10-25 David Stutz , Abhijit Guha Roy , Tatiana Matejovicova , Patricia Strachan , Ali Taylan Cemgil , Arnaud Doucet

This paper presents a comprehensive empirical analysis of conformal prediction methods on a challenging aerial image dataset featuring diverse events in unconstrained environments. Conformal prediction is a powerful post-hoc technique that…

Machine Learning · Computer Science 2025-04-25 Farhad Pourkamali-Anaraki

While existing depression prediction methods based on deep learning show promise, their practical application is hindered by the lack of trustworthiness, as these deep models are often deployed as black box models, leaving us uncertain on…

Machine Learning · Computer Science 2024-08-28 Yonghong Li , Xiuzhuang Zhou

Conformal prediction is a distribution-free uncertainty quantification method that has gained popularity in the machine learning community due to its finite-sample guarantees and ease of use. Its most common variant, dubbed split conformal…

Machine Learning · Computer Science 2025-10-27 Alvaro H. C. Correia , Christos Louizos

In clinical applications, the utility of segmentation models is often based on the accuracy of derived downstream metrics such as organ size, rather than by the pixel-level accuracy of the segmentation masks themselves. Thus, uncertainty…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Matt Y. Cheung , Ashok Veeraraghavan , Guha Balakrishnan

In large-scale prediction problems, exhaustively following up on all test units is often impractical and inefficient, motivating a selective reporting strategy that fulfills the dual requirements of informativeness and trustworthiness.…

Statistics Theory · Mathematics 2026-05-27 Wangcheng Li , Guanlan Zhao , Xu Guo , Wenguang Sun

We study the problem of quantifying epistemic predictive uncertainty (EPU) -- that is, uncertainty faced at prediction time due to the existence of multiple plausible predictive models -- within the framework of conformal prediction (CP).…

Machine Learning · Computer Science 2026-02-03 Siu Lun Chau , Soroush H. Zargarbashi , Yusuf Sale , Michele Caprio

This paper introduces a conformal inference method to evaluate uncertainty in classification by generating prediction sets with valid coverage conditional on adaptively chosen features. These features are carefully selected to reflect…

Machine Learning · Statistics 2024-10-31 Yanfei Zhou , Matteo Sesia

Conformal prediction (CP) provides a distribution-free approach to uncertainty quantification with finite-sample guarantees. However, applying CP to graph neural networks (GNNs) remains challenging as the combinatorial nature of graphs…

Machine Learning · Computer Science 2026-05-11 Peyman Baghershahi , Fangxin Wang , Debmalya Mandal , Sourav Medya

Conformal prediction (CP) is a general framework to quantify the predictive uncertainty of machine learning models that uses a set prediction to include the true label with a valid probability. To align the uncertainty measured by CP,…

Machine Learning · Computer Science 2025-11-25 Xuesong Jia , Yuanjie Shi , Ziquan Liu , Yi Xu , Yan Yan

Uncertainty quantification in Knowledge Graph Embedding (KGE) methods is crucial for ensuring the reliability of downstream applications. A recent work applies conformal prediction to KGE methods, providing uncertainty estimates by…

Artificial Intelligence · Computer Science 2025-05-23 Yuqicheng Zhu , Daniel Hernández , Yuan He , Zifeng Ding , Bo Xiong , Evgeny Kharlamov , Steffen Staab

This paper develops a conformal method to compute prediction intervals for non-parametric regression that can automatically adapt to skewed data. Leveraging black-box machine learning algorithms to estimate the conditional distribution of…

Methodology · Statistics 2021-10-26 Matteo Sesia , Yaniv Romano

We develop a new approach to multi-label conformal prediction in which we aim to output a precise set of promising prediction candidates with a bounded number of incorrect answers. Standard conformal prediction provides the ability to adapt…

Machine Learning · Computer Science 2022-02-16 Adam Fisch , Tal Schuster , Tommi Jaakkola , Regina Barzilay

We investigate the integration of Conformal Prediction (CP) with supervised learning on deterministically encrypted data, aiming to bridge the gap between rigorous uncertainty quantification and privacy-preserving machine learning. Using…

Machine Learning · Computer Science 2025-07-15 Alexander David Balinsky , Dominik Krzeminski , Alexander Balinsky

Conformal prediction is a distribution-free framework for uncertainty quantification that replaces point predictions with sets, offering marginal coverage guarantees (i.e., ensuring that the prediction sets contain the true label with a…

Machine Learning · Computer Science 2025-02-25 Margarida M. Campos , João Calém , Sophia Sklaviadis , Mário A. T. Figueiredo , André F. T. Martins

Large language models (LLMs) need reliable test-time control of hallucinations. Existing conformal methods for LLMs typically provide only \emph{marginal} guarantees and rely on a single global threshold, which can under-cover hard prompts,…

Machine Learning · Computer Science 2026-03-31 Kai Ye , Qingtao Pan , Shuo Li

In supervised learning, including regression and classification, conformal methods provide prediction sets for the outcome/label with finite sample coverage for any machine learning predictor. We consider here the case where such prediction…

Statistics Theory · Mathematics 2025-03-19 Ulysse Gazin , Ruth Heller , Ariane Marandon , Etienne Roquain

Conformal prediction offers a powerful framework for building distribution-free prediction intervals for exchangeable data. Existing methods that extend conformal prediction to sequential data rely on fitting a relatively complex model to…

Machine Learning · Computer Science 2026-03-03 Roberto Neglia , Andrea Cini , Michael M. Bronstein , Filippo Maria Bianchi

Coherent Point Drift (CPD) is a representative probabilistic framework for unsupervised non-rigid point set registration. Its standard non-rigid M-step, however, relies on a point-indexed Gaussian-kernel system whose size grows with the…

Machine Learning · Computer Science 2026-05-18 Wei Feng , Haiyong Zheng

Surrogate models (including deep neural networks and other machine learning algorithms in supervised learning) are capable of approximating arbitrarily complex, high-dimensional input-output problems in science and engineering, but require…

Machine Learning · Computer Science 2025-12-17 Miguel Sánchez-Domínguez , Lucas Lacasa , Javier de Vicente , Gonzalo Rubio , Eusebio Valero