English
Related papers

Related papers: Post-selection Inference for Conformal Prediction:…

200 papers

Modern artificial intelligence systems require calibrated uncertainty estimates that remain reliable in sequential and non-stationary environments. Online conformal prediction (OCP) addresses this challenge through adaptively updated…

Machine Learning · Computer Science 2026-05-21 Bowen Wang , Matteo Zecchin , Osvaldo Simeone

In this work we provide a review of basic ideas and novel developments about Conformal Prediction -- an innovative distribution-free, non-parametric forecasting method, based on minimal assumptions -- that is able to yield in a very…

Machine Learning · Computer Science 2024-02-01 Matteo Fontana , Gianluca Zeni , Simone Vantini

Calibration is a well-studied property of predictors which guarantees meaningful uncertainty estimates. Multicalibration is a related notion -- originating in algorithmic fairness -- which requires predictors to be simultaneously calibrated…

Machine Learning · Computer Science 2024-11-06 Dutch Hansen , Siddartha Devic , Preetum Nakkiran , Vatsal Sharan

Conformal inference is a popular tool for constructing prediction intervals (PI). We consider here the scenario of post-selection/selective conformal inference, that is PIs are reported only for individuals selected from an unlabeled test…

Methodology · Statistics 2024-03-13 Yajie Bao , Yuyang Huo , Haojie Ren , Changliang Zou

Conformal inference is a fundamental and versatile tool that provides distribution-free guarantees for many machine learning tasks. We consider the transductive setting, where decisions are made on a test sample of $m$ new points, giving…

Methodology · Statistics 2024-03-20 Ulysse Gazin , Gilles Blanchard , Etienne Roquain

We develop a novel approach to tackle the common but challenging problem of conformal inference for missing data in machine learning, focusing on Missing at Random (MAR) data. We propose a new procedure Conformal prediction for Missing data…

Methodology · Statistics 2025-10-22 Wenlu Tang , Hongni Wang , Xingcai Zhou , Bei Jiang , Linglong Kong

Conformal prediction has become increasingly popular for quantifying the uncertainty associated with machine learning models. Recent work in graph uncertainty quantification has built upon this approach for conformal graph prediction. The…

Machine Learning · Computer Science 2025-05-21 Pranav Maneriker , Aditya T. Vadlamani , Anutam Srinivasan , Yuntian He , Ali Payani , Srinivasan Parthasarathy

In this work, we study some novel applications of conformal inference techniques to the problem of providing machine learning procedures with more transparent, accurate, and practical performance guarantees. We provide a natural extension…

Machine Learning · Statistics 2020-07-10 Matthew J. Holland

In statistical inference, it is rarely realistic that the hypothesized statistical model is well-specified, and consequently it is important to understand the effects of misspecification on inferential procedures. When the hypothesized…

Methodology · Statistics 2025-09-01 Beomjo Park , Sivaraman Balakrishnan , Larry Wasserman

Quantifying uncertainty in automatically generated text is important for letting humans check potential hallucinations and making systems more reliable. Conformal prediction is an attractive framework to provide predictions imbued with…

Computation and Language · Computer Science 2024-02-02 Dennis Ulmer , Chrysoula Zerva , André F. T. Martins

Transductive conformal prediction addresses the simultaneous prediction for multiple data points. Given a desired confidence level, the objective is to construct a prediction set that includes the true outcomes with the prescribed…

Machine Learning · Computer Science 2025-09-08 Arash Behboodi , Alvaro H. C. Correia , Fabio Valerio Massoli , Christos Louizos

Recent advances in object detectors have led to their adoption for industrial uses. However, their deployment in safety-critical applications is hindered by the inherent lack of reliability of neural networks and the complex structure of…

Machine Learning · Statistics 2025-11-03 Léo andéol , Luca Mossina , Adrien Mazoyer , Sébastien Gerchinovitz

Deep neural networks exhibit remarkable performance, yet their black-box nature limits their utility in fields like healthcare where interpretability is crucial. Existing explainability approaches often sacrifice accuracy and lack…

Machine Learning · Computer Science 2025-04-08 Linhui Huang , Sayeri Lala , Niraj K. Jha

Evaluating conditional coverage remains one of the most persistent challenges in assessing the reliability of predictive systems. Although conformal methods can give guarantees on marginal coverage, no method can guarantee to produce sets…

Machine Learning · Statistics 2025-12-15 Sacha Braun , David Holzmüller , Michael I. Jordan , Francis Bach

Many applications of machine learning methods involve an iterative protocol in which data are collected, a model is trained, and then outputs of that model are used to choose what data to consider next. For example, one data-driven approach…

Machine Learning · Computer Science 2025-04-07 Clara Fannjiang , Stephen Bates , Anastasios N. Angelopoulos , Jennifer Listgarten , Michael I. Jordan

Conformal prediction offers a practical framework for distribution-free uncertainty quantification, providing finite-sample coverage guarantees under relatively mild assumptions on data exchangeability. However, these assumptions cease to…

Machine Learning · Statistics 2024-06-25 Derck W. E. Prinzhorn , Thijmen Nijdam , Putri A. van der Linden , Alexander Timans

Conformal prediction is often calibrated with a single pooled threshold, but this can hide cross-group heterogeneity in score distributions and distort group-wise coverage. We study this phenomenon through the population score distributions…

Machine Learning · Statistics 2026-05-18 Ziang Gao , Pengqi Liu , Archer Yi Yang , Mouloud Belbahri , Jesse C. Cresswell , Masoud Asgharian

Reliable uncertainty quantification is essential for deploying machine learning systems in high-stakes domains. Conformal prediction provides distribution-free coverage guarantees but often produces overly large prediction sets, limiting…

Machine Learning · Computer Science 2026-04-28 Yunpeng Xu , Wenge Guo , Zhi Wei

Should prediction models always deliver a prediction? In the pursuit of maximum predictive performance, critical considerations of reliability and fairness are often overshadowed, particularly when it comes to the role of uncertainty.…

Machine Learning · Computer Science 2024-10-29 Anna Sokol , Nuno Moniz , Nitesh Chawla

Unlike the typical classification setting where each instance is associated with a single class, in multi-label learning each instance is associated with multiple classes simultaneously. Therefore the learning task in this setting is to…

Machine Learning · Computer Science 2022-11-30 Harris Papadopoulos