English
Related papers

Related papers: Empirical Bayes Conformal Prediction for Vision an…

200 papers

Conformal methods provide prediction sets for outcomes with confidence guarantees. We study their use in a selective inference setting, where inference is performed only when the prediction set is informative. The analyst may consider as…

Methodology · Statistics 2026-05-22 Israela Solomon , Etienne Roquain , Saharon Rosset , Ruth Heller

We study the problem of conditional predictive inference on multiple outcomes missing at random (MAR) -- or equivalently, under covariate shift. While the weighted conformal prediction offers a tool for inference under covariate shift with…

Methodology · Statistics 2025-08-01 Yonghoon Lee , Edgar Dobriban , Eric Tchetgen Tchetgen

In this paper, we propose Evidential Conformal Prediction (ECP) method for image classifiers to generate the conformal prediction sets. Our method is designed based on a non-conformity score function that has its roots in Evidential Deep…

Machine Learning · Computer Science 2024-07-31 Hamed Karimi , Reza Samavi

Non-parametric machine learning models, such as random forests and gradient boosted trees, are frequently used to estimate house prices due to their predictive accuracy, but a main drawback of such methods is their limited ability to…

Machine Learning · Statistics 2025-01-31 Anders Hjort , Gudmund Horn Hermansen , Johan Pensar , Jonathan P. Williams

Deep Learning predictions with measurable confidence are increasingly desirable for real-world problems, especially in high-risk settings. The Conformal Prediction (CP) framework is a versatile solution that guarantees a maximum error rate…

Machine Learning · Computer Science 2023-08-08 Julia A. Meister , Khuong An Nguyen , Stelios Kapetanakis , Zhiyuan Luo

Online Conformal Prediction (CP) struggles to balance temporal adaptability and structural stability. Feedback-driven methods (e.g., Adaptive Conformal Inference (ACI)) suffer from systemic marginal under-coverage and high interval variance…

Machine Learning · Computer Science 2026-05-04 Yu-Hsueh Fang , Chia-Yen Lee

Conformal prediction is a technique for constructing prediction intervals that attain valid coverage in finite samples, without making distributional assumptions. Despite this appeal, existing conformal methods can be unnecessarily…

Methodology · Statistics 2019-05-09 Yaniv Romano , Evan Patterson , Emmanuel J. Candès

Modern software-defined networks, such as Open Radio Access Network (O-RAN) systems, rely on artificial intelligence (AI)-powered applications running on controllers interfaced with the radio access network. To ensure that these AI…

Signal Processing · Electrical Eng. & Systems 2025-02-06 Seonghoon Yoo , Sangwoo Park , Petar Popovski , Joonhyuk Kang , Osvaldo Simeone

Selective conformal prediction can yield substantially tighter uncertainty sets when we can identify calibration examples that are exchangeable with the test example. In interventional settings, such as perturbation experiments in genomics,…

Machine Learning · Computer Science 2026-03-03 Amir Asiaee , Kavey Aryan , James P. Long

We introduce two new extensions to the beam search algorithm based on conformal predictions (CP) to produce sets of sequences with theoretical coverage guarantees. The first method is very simple and proposes dynamically-sized subsets of…

Machine Learning · Computer Science 2023-09-08 Nicolas Deutschmann , Marvin Alberts , María Rodríguez Martínez

This study addresses the critical challenge of hallucination mitigation in Large Vision-Language Models (LVLMs) for Visual Question Answering (VQA) tasks through a Split Conformal Prediction (SCP) framework. While LVLMs excel in multi-modal…

Computation and Language · Computer Science 2025-05-16 Yuanchang Ye , Weiyan Wen

Conformal prediction is a framework that provides valid uncertainty quantification for general models with exchangeable data. However, in the online learning and time-series settings, exchangeability is not satisfied. Existing online…

Machine Learning · Computer Science 2026-05-11 Yuheng Lai , Garvesh Raskutti

We propose Probabilistic Warp Consistency, a weakly-supervised learning objective for semantic matching. Our approach directly supervises the dense matching scores predicted by the network, encoded as a conditional probability distribution.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Prune Truong , Martin Danelljan , Fisher Yu , Luc Van Gool

Classical Bayesian persuasion assumes that senders fully understand how receivers form beliefs and make decisions--an assumption that rarely holds when receivers possess private information or exhibit non-Bayesian behavior. In this paper,…

Systems and Control · Electrical Eng. & Systems 2025-11-11 Heeseung Bang , Andreas A. Malikopoulos

Uncertainty quantification (UQ) is essential for safe deployment of generative AI models such as large language models (LLMs), especially in high stakes applications. Conformal prediction (CP) offers a principled uncertainty quantification…

Machine Learning · Computer Science 2025-06-09 Sima Noorani , Shayan Kiyani , George Pappas , Hamed Hassani

Conformal prediction methods create prediction bands with distribution-free guarantees but do not explicitly capture epistemic uncertainty, which can lead to overconfident predictions in data-sparse regions. Although recent conformal scores…

Machine Learning · Statistics 2025-06-11 Luben M. C. Cabezas , Vagner S. Santos , Thiago R. Ramos , Rafael Izbicki

Invariant prediction [Peters et al., 2016] analyzes feature/outcome data from multiple environments to identify invariant features - those with a stable predictive relationship to the outcome. Such features support generalization to new…

Machine Learning · Statistics 2025-07-10 Luhuan Wu , Mingzhang Yin , Yixin Wang , John P. Cunningham , David M. Blei

We develop a new method for generating prediction sets that combines the flexibility of conformal methods with an estimate of the conditional distribution $P_{Y \mid X}$. Existing methods, such as conformalized quantile regression and…

Machine Learning · Statistics 2024-10-10 Vincent Plassier , Alexander Fishkov , Mohsen Guizani , Maxim Panov , Eric Moulines

Conformal prediction provides prediction sets with finite-sample marginal coverage, but many applications require coverage guarantees that adapt to individual test points, a subpopulation, or a structural component of the data. Existing…

Methodology · Statistics 2026-05-27 Yinjie Min , Liuhua Peng , Changliang Zou

Post-hoc calibration of pre-trained models is critical for ensuring reliable inference, especially in safety-critical domains such as healthcare. Conformal Prediction (CP) offers a robust post-hoc calibration framework, providing…

Machine Learning · Computer Science 2025-05-22 Haifeng Wen , Hong Xing , Osvaldo Simeone