English
Related papers

Related papers: CAP: A General Algorithm for Online Selective Conf…

200 papers

Online sparse linear regression is an online problem where an algorithm repeatedly chooses a subset of coordinates to observe in an adversarially chosen feature vector, makes a real-valued prediction, receives the true label, and incurs the…

Machine Learning · Computer Science 2020-07-27 Satyen Kale , Zohar Karnin , Tengyuan Liang , Dávid Pál

Ordinal classification has been widely applied in many high-stakes applications, e.g., medical imaging and diagnosis, where reliable uncertainty quantification (UQ) is essential for decision making. Conformal prediction (CP) is a general UQ…

Machine Learning · Computer Science 2025-11-24 Zijian Zhang , Xinyu Chen , Yuanjie Shi , Liyuan Lillian Ma , Zifan Xu , Yan Yan

This paper studies the online stochastic resource allocation problem (RAP) with chance constraints. The online RAP is a 0-1 integer linear programming problem where the resource consumption coefficients are revealed column by column along…

Optimization and Control · Mathematics 2023-03-07 Yuwei Chen , Zengde Deng , Yinzhi Zhou , Zaiyi Chen , Yujie Chen , Haoyuan Hu

Conformal Prediction (CP) is a principled framework for quantifying uncertainty in blackbox learning models, by constructing prediction sets with finite-sample coverage guarantees. Traditional approaches rely on scalar nonconformity scores,…

Machine Learning · Statistics 2025-05-07 Gauthier Thurin , Kimia Nadjahi , Claire Boyer

Conformal prediction is a framework for providing prediction intervals with distribution-free validity, guaranteeing predictive coverage for data drawn from any distribution. Its two main variants are full conformal prediction and split…

Methodology · Statistics 2026-05-29 Aabesh Bhattacharyya , Boxuan Zhang , Rina Foygel Barber

This paper presents a comprehensive empirical analysis of conformal prediction methods on a challenging aerial image dataset featuring diverse events in unconstrained environments. Conformal prediction is a powerful post-hoc technique that…

Machine Learning · Computer Science 2025-04-25 Farhad Pourkamali-Anaraki

Understanding the vulnerability of large-scale pre-trained vision-language models like CLIP against adversarial attacks is key to ensuring zero-shot generalization capacity on various downstream tasks. State-of-the-art defense mechanisms…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Fan Yang , Mingxuan Xia , Sangzhou Xia , Chicheng Ma , Hui Hui

Reliable uncertainty quantification is essential for deploying machine learning systems in high-stakes domains. Conformal prediction provides distribution-free coverage guarantees but often produces overly large prediction sets, limiting…

Machine Learning · Computer Science 2026-04-28 Yunpeng Xu , Wenge Guo , Zhi Wei

Conformal prediction (CP) gives distribution-free coverage for modern vision and language models, but it is often forced to make a ranking decision from a single unstable nonconformity score. Standard CP uses one realization, while…

Machine Learning · Computer Science 2026-05-25 Jiapeng Zeng , Yogesh Prabhu , Zhanpeng Zeng , Michael A. Newton , Vikas Singh

Conformal Prediction (CP) stands out as a robust framework for uncertainty quantification, which is crucial for ensuring the reliability of predictions. However, common CP methods heavily rely on data exchangeability, a condition often…

Early time classification algorithms aim to label a stream of features without processing the full input stream, while maintaining accuracy comparable to that achieved by applying the classifier to the entire input. In this paper, we…

Machine Learning · Computer Science 2024-02-02 Liran Ringel , Regev Cohen , Daniel Freedman , Michael Elad , Yaniv Romano

Uncertainty quantification is an important prerequisite for the deployment of deep learning models in safety-critical areas. Yet, this hinges on the uncertainty estimates being useful to the extent the prediction intervals are…

Machine Learning · Computer Science 2025-07-29 Dharmesh Tailor , Alvaro H. C. Correia , Eric Nalisnick , Christos Louizos

Conformal prediction is a learning framework controlling prediction coverage of prediction sets, which can be built on any learning algorithm for point prediction. This work proposes a learning framework named conformal loss-controlling…

Machine Learning · Computer Science 2024-01-24 Di Wang , Ping Wang , Zhong Ji , Xiaojun Yang , Hongyue Li

Forecasting armed conflicts is a critical area of research with the potential to save lives and mitigate suffering. While existing forecasting models offer valuable point predictions, they often lack individual-level uncertainty estimates,…

Methodology · Statistics 2026-01-14 David Randahl , Jonathan P. Williams , Håvard Hegre

Existing conformal prediction algorithms estimate prediction intervals at target confidence levels to characterize the performance of a regression model on new test samples. However, considering an autonomous system consisting of multiple…

Machine Learning · Computer Science 2023-09-25 Yunye Gong , Yi Yao , Xiao Lin , Ajay Divakaran , Melinda Gervasio

Conformal prediction (CP) is a framework to quantify uncertainty of machine learning classifiers including deep neural networks. Given a testing example and a trained classifier, CP produces a prediction set of candidate labels with a…

Machine Learning · Computer Science 2023-08-01 Subhankar Ghosh , Yuanjie Shi , Taha Belkhouja , Yan Yan , Jana Doppa , Brian Jones

Trustworthy decision making in networked, dynamic environments calls for innovative uncertainty quantification substrates in predictive models for graph time series. Existing conformal prediction (CP) methods have been applied separately to…

Machine Learning · Computer Science 2025-10-14 Sonakshi Dua , Gonzalo Mateos , Sundeep Prabhakar Chepuri

This paper presents adaptive conformal selection (ACS), an interactive framework for model-free selection with guaranteed error control. Building on conformal selection (Jin and Cand\`es, 2023b), ACS generalizes the approach to support…

Methodology · Statistics 2025-07-22 Yu Gui , Ying Jin , Yash Nair , Zhimei Ren

Conformal prediction (CP) has been a popular method for uncertainty quantification because it is distribution-free, model-agnostic, and theoretically sound. For forecasting problems in supervised learning, most CP methods focus on building…

Machine Learning · Statistics 2024-05-24 Chen Xu , Hanyang Jiang , Yao Xie

Split conformal prediction (CP) is arguably the most popular CP method for uncertainty quantification, enjoying both academic interest and widespread deployment. However, the original theoretical analysis of split CP makes the crucial…

Statistics Theory · Mathematics 2024-08-26 Roberto I. Oliveira , Paulo Orenstein , Thiago Ramos , João Vitor Romano