English
Related papers

Related papers: Cost-Sensitive Conformal Training with Provably Co…

200 papers

Graph Neural Networks (GNNs) excel in diverse tasks, yet their applications in high-stakes domains are often hampered by unreliable predictions. Although numerous uncertainty quantification methods have been proposed to address this…

Machine Learning · Computer Science 2024-07-22 Tianyi Zhao , Jian Kang , Lu Cheng

Conformal prediction, a post-hoc, distribution-free, finite-sample method of uncertainty quantification that offers formal coverage guarantees under the assumption of data exchangeability. Unfortunately, the resulting uncertainty regions…

Machine Learning · Computer Science 2026-04-21 Nikolaos Bousias , Lars Lindemann , George Pappas

This paper presents a conformal prediction method for classification in highly imbalanced and open-set settings, where there are many possible classes and not all may be represented in the data. Existing approaches require a finite, known…

Machine Learning · Statistics 2025-10-16 Tianmin Xie , Yanfei Zhou , Ziyi Liang , Stefano Favaro , Matteo Sesia

Continual Learning (CL) is essential for enabling self-evolving large language models (LLMs) to adapt and remain effective amid rapid knowledge growth. Yet, despite its importance, little attention has been given to establishing statistical…

Machine Learning · Computer Science 2025-10-29 Xiaofan Zhou , Lu Cheng

Successful application of machine learning models to real-world prediction problems, e.g. financial forecasting and personalized medicine, has proved to be challenging, because such settings require limiting and quantifying the uncertainty…

Machine Learning · Computer Science 2020-09-15 Yao Zhang , William Zame , Mihaela van der Schaar

Conformal Prediction is a widely studied technique to construct prediction sets of future observations. Most conformal prediction methods focus on achieving the necessary coverage guarantees, but do not provide formal guarantees on the size…

Machine Learning · Computer Science 2025-02-25 Chao Gao , Liren Shan , Vaidehi Srinivas , Aravindan Vijayaraghavan

Reachability analysis has been a prominent way to provide safety guarantees for neurally controlled autonomous systems, but its direct application to neural perception components is infeasible due to imperfect or intractable perception…

Systems and Control · Electrical Eng. & Systems 2026-04-27 Yuang Geng , Thomas Waite , Trevor Turnquist , Radoslav Ivanov , Ivan Ruchkin

Reliable uncertainty quantification is essential for deploying machine learning systems in high-stakes domains. Conformal prediction provides distribution-free coverage guarantees but often produces overly large prediction sets, limiting…

Machine Learning · Computer Science 2026-04-28 Yunpeng Xu , Wenge Guo , Zhi Wei

While counterfactual fairness of point predictors is well studied, its extension to prediction sets--central to fair decision-making under uncertainty--remains underexplored. On the other hand, conformal prediction (CP) provides efficient,…

Machine Learning · Computer Science 2026-03-13 Ozgur Guldogan , Neeraj Sarna , Yuanyuan Li , Michael Berger

Conformal prediction can be used to construct prediction sets that cover the true outcome with a desired probability, but can sometimes lead to large prediction sets that are costly in practice. The most useful outcome is a singleton…

Machine Learning · Statistics 2026-02-05 Tao Wang , Yan Sun , Edgar Dobriban

Black-box machine learning models are now routinely used in high-risk settings, like medical diagnostics, which demand uncertainty quantification to avoid consequential model failures. Conformal prediction is a user-friendly paradigm for…

Machine Learning · Computer Science 2022-12-08 Anastasios N. Angelopoulos , Stephen Bates

This paper presents a unified framework for understanding the methodology and theory behind several different methods in the conformal prediction literature, which includes standard conformal prediction (CP), weighted conformal prediction…

Statistics Theory · Mathematics 2025-12-23 Rina Foygel Barber , Ryan J. Tibshirani

Conformal prediction (CP) provides a distribution-free approach to uncertainty quantification with finite-sample guarantees. However, applying CP to graph neural networks (GNNs) remains challenging as the combinatorial nature of graphs…

Machine Learning · Computer Science 2026-05-11 Peyman Baghershahi , Fangxin Wang , Debmalya Mandal , Sourav Medya

Language models generate text based on successively sampling the next word. A decoding procedure based on nucleus (top-$p$) sampling chooses from the smallest possible set of words whose cumulative probability exceeds the probability $p$.…

Computation and Language · Computer Science 2023-05-05 Shauli Ravfogel , Yoav Goldberg , Jacob Goldberger

Conformal prediction is a distribution-free framework for uncertainty quantification that replaces point predictions with sets, offering marginal coverage guarantees (i.e., ensuring that the prediction sets contain the true label with a…

Machine Learning · Computer Science 2025-02-25 Margarida M. Campos , João Calém , Sophia Sklaviadis , Mário A. T. Figueiredo , André F. T. Martins

Safety is a critical concern in learning-enabled autonomous systems especially when deploying these systems in real-world scenarios. An important challenge is accurately quantifying the uncertainty of unknown models to generate provably…

Robotics · Computer Science 2025-03-25 Hao Zhou , Yanze Zhang , Wenhao Luo

Cost-sensitive learning is a common type of machine learning problem where different errors of prediction incur different costs. In this paper, we design a generic nonparametric active learning algorithm for cost-sensitive classification.…

Machine Learning · Computer Science 2023-10-03 Boris Ndjia Njike , Xavier Siebert

Conformal prediction is an uncertainty quantification method that constructs a prediction set for a previously unseen datum, ensuring the true label is included with a predetermined coverage probability. Adaptive conformal prediction has…

Machine Learning · Computer Science 2024-11-07 Erfan Hajihashemi , Yanning Shen

Conformal prediction is a theoretically grounded framework for constructing predictive intervals. We study conformal prediction with missing values in the covariates -- a setting that brings new challenges to uncertainty quantification. We…

Machine Learning · Statistics 2023-06-06 Margaux Zaffran , Aymeric Dieuleveut , Julie Josse , Yaniv Romano

Model predictive control (MPC) is widely used in industries but implementing it poses challenges due to hardware or time constraints. A promising solution is to approximate the MPC policy using function approximators like neural networks.…

Optimization and Control · Mathematics 2026-05-08 Chenchen Zhou , Yi Cao , Shuang-hua Yang