English
Related papers

Related papers: On training locally adaptive CP

200 papers

A centralized model predictive controller (MPC), which is unaware of local uncertainties, for an affine discrete time nonlinear system is presented. The local uncertainties are assumed to be matched, bounded and structured. In order to…

Optimization and Control · Mathematics 2020-09-15 Prabhat K. Mishra , Tixian Wang , Mattia Gazzola , Girish Chowdhary

Transformers have become a standard architecture in machine learning, demonstrating strong in-context learning (ICL) abilities that allow them to learn from the prompt at inference time. However, uncertainty quantification for ICL remains…

Machine Learning · Statistics 2025-04-23 Zhe Huang , Simone Rossi , Rui Yuan , Thomas Hannagan

Achieving valid conditional coverage in conformal prediction is challenging due to the theoretical difficulty of satisfying pointwise constraints in finite samples. Building upon the characterization of conditional coverage through marginal…

Methodology · Statistics 2026-05-13 Yajie Bao , Chuchen Zhang , Zhaojun Wang , Haojie Ren , Changliang Zou

We study prediction-powered conditional inference in the setting where labeled data are scarce, unlabeled covariates are abundant, and a black-box machine-learning predictor is available. The goal is to perform statistical inference on…

Machine Learning · Statistics 2026-03-09 Yang Sui , Jin Zhou , Hua Zhou , Xiaowu Dai

In this paper, we address conditional testing problems through the conformal inference framework. We define the localized conformal p-values by inverting prediction intervals and prove their theoretical properties. These defined p-values…

Methodology · Statistics 2024-09-26 Xiaoyang Wu , Lin Lu , Zhaojun Wang , Changliang Zou

We propose a learning framework for calibrating predictive models to make loss-controlling prediction for exchangeable data, which extends our recently proposed conformal loss-controlling prediction for more general cases. By comparison,…

Machine Learning · Computer Science 2024-01-24 Di Wang , Junzhi Shi , Pingping Wang , Shuo Zhuang , Hongyue Li

Uncertainty quantification is an important prerequisite for the deployment of deep learning models in safety-critical areas. Yet, this hinges on the uncertainty estimates being useful to the extent the prediction intervals are…

Machine Learning · Computer Science 2025-07-29 Dharmesh Tailor , Alvaro H. C. Correia , Eric Nalisnick , Christos Louizos

We propose a robust method for constructing conditionally valid prediction intervals based on models for conditional distributions such as quantile and distribution regression. Our approach can be applied to important prediction problems…

Econometrics · Economics 2022-01-26 Victor Chernozhukov , Kaspar Wüthrich , Yinchu Zhu

Future trajectories play an important role across domains such as autonomous driving, hurricane forecasting, and epidemic modeling, where practitioners commonly generate ensemble paths by sampling probabilistic models or leveraging multiple…

Machine Learning · Computer Science 2025-08-20 Ruipu Li , Daniel Menacho , Alexander Rodríguez

We study the problem of structured prediction under test-time budget constraints. We propose a novel approach applicable to a wide range of structured prediction problems in computer vision and natural language processing. Our approach…

Machine Learning · Statistics 2016-06-09 Tolga Bolukbasi , Kai-Wei Chang , Joseph Wang , Venkatesh Saligrama

Conformal prediction, and split conformal prediction as a specific implementation, offer a distribution-free approach to estimating prediction intervals with statistical guarantees. Recent work has shown that split conformal prediction can…

Machine Learning · Statistics 2024-05-01 Nicolas Dewolf , Bernard De Baets , Willem Waegeman

Conformal prediction is a powerful tool to generate uncertainty sets with guaranteed coverage using any predictive model, under the assumption that the training and test data are i.i.d.. Recently, it has been shown that adversarial examples…

Machine Learning · Computer Science 2024-05-01 Ge Yan , Yaniv Romano , Tsui-Wei Weng

Post-hoc calibration of pre-trained models is critical for ensuring reliable inference, especially in safety-critical domains such as healthcare. Conformal Prediction (CP) offers a robust post-hoc calibration framework, providing…

Machine Learning · Computer Science 2025-05-22 Haifeng Wen , Hong Xing , Osvaldo Simeone

Traditional conformal prediction methods construct prediction sets such that the true label falls within the set with a user-specified coverage level. However, poorly chosen coverage levels can result in uninformative predictions, either…

Machine Learning · Statistics 2026-04-03 Etienne Gauthier , Francis Bach , Michael I. Jordan

Existing evaluations of conformal prediction, such as prediction efficiency and test-conditional coverage, are defined in expectation over the calibration data. In practice, when only one calibration set of limited size is available,…

Methodology · Statistics 2026-05-05 Yinjie Min , Liuhua Peng , Changliang Zou

Conformal prediction has been explored as a general and efficient way to provide uncertainty quantification for time series. However, current methods struggle to handle time series data with change points - sudden shifts in the underlying…

Machine Learning · Computer Science 2025-12-02 Sophia Sun , Rose Yu

The local regularity of functional time series is studied under $L^p-m-$appro\-ximability assumptions. The sample paths are observed with error at possibly random design points. Non-asymptotic concentration bounds of the regularity…

Statistics Theory · Mathematics 2024-03-21 Hassan Maissoro , Valentin Patilea , Myriam Vimond

Precise estimation of predictive uncertainty in deep neural networks is a critical requirement for reliable decision-making in machine learning and statistical modeling, particularly in the context of medical AI. Conformal Prediction (CP)…

Machine Learning · Computer Science 2024-01-05 Hamed Karimi , Reza Samavi

This paper introduces Target Strangeness, a novel difficulty estimator for conformal prediction (CP) that offers an alternative approach for normalizing prediction intervals (PIs). By assessing how atypical a prediction is within the…

Machine Learning · Computer Science 2024-10-28 Alexis Bose , Jonathan Ethier , Paul Guinand

We propose a novel adaptive approximation approach for test-time resource-constrained prediction. Given an input instance at test-time, a gating function identifies a prediction model for the input among a collection of models. Our…

Machine Learning · Statistics 2017-05-30 Feng Nan , Venkatesh Saligrama