English
Related papers

Related papers: Adjusting Regression Models for Conditional Uncert…

200 papers

We study the coverage properties of full conformal regression in the proportional asymptotic regime where the ratio of the dimension and the sample size converges to a constant. In this setting, existing theory tells us only that full…

Statistics Theory · Mathematics 2025-03-03 Isaac Gibbs , Emmanuel J. Candès

Uncertainty quantification is essential in decision-making, especially when joint distributions of random variables are involved. While conformal prediction provides distribution-free prediction sets with valid coverage guarantees, it…

Machine Learning · Computer Science 2025-01-03 Rui Luo , Zhixin Zhou

Modern artificial intelligence systems require calibrated uncertainty estimates that remain reliable in sequential and non-stationary environments. Online conformal prediction (OCP) addresses this challenge through adaptively updated…

Machine Learning · Computer Science 2026-05-21 Bowen Wang , Matteo Zecchin , Osvaldo Simeone

When split conformal prediction operates in batch mode with exchangeable data, we determine the exact distribution of the empirical coverage of prediction sets produced for a finite batch of future observables, as well as the exact…

Statistics Theory · Mathematics 2025-01-23 Paulo C. Marques F

Conformal prediction is a learning framework controlling prediction coverage of prediction sets, which can be built on any learning algorithm for point prediction. This work proposes a learning framework named conformal loss-controlling…

Machine Learning · Computer Science 2024-01-24 Di Wang , Ping Wang , Zhong Ji , Xiaojun Yang , Hongyue Li

Efficient methods to provide sub-optimal solutions to non-convex optimization problems with knowledge of the solution's sub-optimality would facilitate the widespread application of nonlinear optimal control algorithms. To that end,…

Optimization and Control · Mathematics 2023-04-10 Prithvi Akella , Aaron D. Ames

Many risk-sensitive applications require well-calibrated prediction sets over multiple, potentially correlated target variables, for which the prediction algorithm may report correlated errors. In this work, we aim to construct the…

Machine Learning · Computer Science 2025-03-12 Ji Won Park , Robert Tibshirani , Kyunghyun Cho

In demographic literature, forecast uncertainty is often quantified with a statistical model. This model-based approach may potentially suffer from drawbacks, namely model misspecification, selection effect, and lack of finite-sample…

Applications · Statistics 2026-05-29 Han Lin Shang

Machine learning can significantly improve performance for decision-making under uncertainty across a wide range of domains. However, ensuring robustness guarantees requires well-calibrated uncertainty estimates, which can be difficult to…

Machine Learning · Computer Science 2026-02-03 Christopher Yeh , Nicolas Christianson , Alan Wu , Adam Wierman , Yisong Yue

Methods to quantify uncertainty in predictions from arbitrary models are in demand in high-stakes domains like medicine and finance. Conformal prediction has emerged as a popular method for producing a set of predictions with specified…

Machine Learning · Computer Science 2025-03-19 Jessica Hullman , Yifan Wu , Dawei Xie , Ziyang Guo , Andrew Gelman

Machine learning classification tasks often benefit from predicting a set of possible labels with confidence scores to capture uncertainty. However, existing methods struggle with the high-dimensional nature of the data and the lack of…

Machine Learning · Computer Science 2024-07-08 Rui Luo , Zhixin Zhou

Although conformal prediction provides robust marginal coverage guarantees, achieving reliable conditional coverage for specific inputs remains challenging. While exact distribution-free conditional coverage is impossible with finite…

Machine Learning · Computer Science 2026-05-20 Qianyi Chen , Bo Li

Accurate quantification of uncertainty is crucial for real-world applications of machine learning. However, modern deep neural networks still produce unreliable predictive uncertainty, often yielding over-confident predictions. In this…

Machine Learning · Computer Science 2020-10-29 Peng Cui , Wenbo Hu , Jun Zhu

The ultimate goal of regression analysis is to obtain information about the conditional distribution of a response given a set of explanatory variables. This goal is, however, seldom achieved because most established regression models only…

Methodology · Statistics 2017-12-13 Torsten Hothorn , Thomas Kneib , Peter Bühlmann

Convolutional image classifiers can achieve high predictive accuracy, but quantifying their uncertainty remains an unresolved challenge, hindering their deployment in consequential settings. Existing uncertainty quantification techniques,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Anastasios Angelopoulos , Stephen Bates , Jitendra Malik , Michael I. Jordan

Conformal prediction (CP) provides finite-sample, distribution-free marginal coverage, but standard conformal regression intervals can be inefficient under heteroscedasticity and skewness. In particular, popular constructions such as…

Machine Learning · Statistics 2026-03-03 Xiaoyi Su , Zhixin Zhou , Rui Luo

Conformal prediction, a post-hoc, distribution-free, finite-sample method of uncertainty quantification that offers formal coverage guarantees under the assumption of data exchangeability. Unfortunately, the resulting uncertainty regions…

Machine Learning · Computer Science 2026-04-21 Nikolaos Bousias , Lars Lindemann , George Pappas

Estimating treatment effects from observational data requires choosing an adjustment set, but valid adjustment depends on an unknown causal graph. Graph misspecification can cause under-coverage, while graph-agnostic conformal wrappers may…

Medical imaging classifiers can achieve high predictive accuracy, but quantifying their uncertainty remains an unresolved challenge, which prevents their deployment in medical clinics. We present an algorithm that can modify any classifier…

Machine Learning · Computer Science 2024-08-12 Roy Hirsch , Jacob Goldberger

This paper introduces a framework for uncertainty quantification in regression models defined in metric spaces. Leveraging a newly defined notion of homoscedasticity, we develop a conformal prediction algorithm that offers finite-sample…

Machine Learning · Statistics 2025-07-22 Gábor Lugosi , Marcos Matabuena