English
Related papers

Related papers: Mirror Online Conformal Prediction with Intermitte…

200 papers

Conformal prediction is a statistical tool for producing prediction regions of machine learning models that are valid with high probability. However, applying conformal prediction to time series data leads to conservative prediction…

Systems and Control · Electrical Eng. & Systems 2024-01-10 Matthew Cleaveland , Insup Lee , George J. Pappas , Lars Lindemann

Traditional face alignment based on machine learning usually tracks the localizations of facial landmarks employing a static model trained offline where all of the training data is available in advance. When new training samples arrive, the…

Computer Vision and Pattern Recognition · Computer Science 2019-05-13 Lin Feng , Caifeng Liu , Shenglan Liu , Huibing Wang

Current instance segmentation models achieve high performance on average predictions, but lack principled uncertainty quantification: their outputs are not calibrated, and there is no guarantee that a predicted mask is close to the ground…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Kerri Lu , Dan M. Kluger , Stephen Bates , Sherrie Wang

In machine learning, model calibration and predictive inference are essential for producing reliable predictions and quantifying uncertainty to support decision-making. Recognizing the complementary roles of point and interval predictions,…

Machine Learning · Statistics 2024-11-01 Lars van der Laan , Ahmed M. Alaa

Uncertainty quantification is essential in decision-making, especially when joint distributions of random variables are involved. While conformal prediction provides distribution-free prediction sets with valid coverage guarantees, it…

Machine Learning · Computer Science 2025-01-03 Rui Luo , Zhixin Zhou

Making calibrated online predictions is a central challenge in modern AI systems. Much of the existing literature focuses on fully adversarial environments where outcomes may be arbitrary, leading to conservative algorithms that can perform…

Machine Learning · Computer Science 2026-05-25 Junyan Liu , Haipeng Luo , Lillian J. Ratliff

Future trajectories play an important role across domains such as autonomous driving, hurricane forecasting, and epidemic modeling, where practitioners commonly generate ensemble paths by sampling probabilistic models or leveraging multiple…

Machine Learning · Computer Science 2025-08-20 Ruipu Li , Daniel Menacho , Alexander Rodríguez

Projection operations are a typical computation bottleneck in online learning. In this paper, we enable projection-free online learning within the framework of Online Convex Optimization with Memory (OCO-M) -- OCO-M captures how the history…

Machine Learning · Computer Science 2023-04-03 Hongyu Zhou , Zirui Xu , Vasileios Tzoumas

Conformal predictors are machine learning algorithms developed in the 1990's by Gammerman, Vovk, and their research team, to provide set predictions with guaranteed confidence level. Over recent years, they have grown in popularity and have…

Machine Learning · Computer Science 2025-08-12 Anthony Bellotti , Xindi Zhao

Reliable uncertainty quantification at unobserved spatial locations, especially in the presence of complex and heterogeneous datasets, remains a core challenge in spatial statistics. Traditional approaches like Kriging rely heavily on…

Machine Learning · Statistics 2025-02-18 Hanyang Jiang , Yao Xie

Conformal prediction (CP), a distribution-free uncertainty quantification (UQ) framework, reliably provides valid predictive inference for black-box models. CP constructs prediction sets that contain the true output with a specified…

Machine Learning · Computer Science 2025-03-12 Xiaofan Zhou , Baiting Chen , Yu Gui , Lu Cheng

We present Distribution-aware Conformal Prediction (DCP), a unified framework integrating probabilistic predictors like Monte Carlo dropout, deep ensembles, and quantile regression with score-agnostic conformal calibration to produce valid…

Machine Learning · Computer Science 2026-05-27 Daniel Schweizer , Peter Kuhn , Jayant Sharma , Shivali Dubey , Malte von Ramin , Christoph Brockt-Haßauer

Before delegating a task to an autonomous system, a human operator may want a guarantee about the behavior of the system. This paper extends previous work on conformal prediction for functional data and conformalized quantile regression to…

Machine Learning · Computer Science 2022-06-23 Thomas G. Dietterich , Jesse Hostetler

Conformal Prediction (CP) is a popular uncertainty quantification method that provides distribution-free, statistically valid prediction sets, assuming that training and test data are exchangeable. In such a case, CP's prediction sets are…

Logic in Computer Science · Computer Science 2024-11-19 Linus Jeary , Tom Kuipers , Mehran Hosseini , Nicola Paoletti

We consider online reinforcement learning in episodic Markov decision process (MDP) with unknown transition function and stochastic rewards drawn from some fixed but unknown distribution. The learner aims to learn the optimal policy and…

Machine Learning · Computer Science 2024-03-12 Vincent Leon , S. Rasoul Etesami

It is common in machine learning to estimate a response $y$ given covariate information $x$. However, these predictions alone do not quantify any uncertainty associated with said predictions. One way to overcome this deficiency is with…

Machine Learning · Statistics 2024-06-25 Chancellor Johnstone , Eugene Ndiaye

Conformal prediction is a popular, modern technique for providing valid predictive inference for arbitrary machine learning models. Its validity relies on the assumptions of exchangeability of the data, and symmetry of the given model…

Methodology · Statistics 2023-03-20 Rina Foygel Barber , Emmanuel J. Candes , Aaditya Ramdas , Ryan J. Tibshirani

Conformal prediction is a technique for constructing prediction intervals that attain valid coverage in finite samples, without making distributional assumptions. Despite this appeal, existing conformal methods can be unnecessarily…

Methodology · Statistics 2019-05-09 Yaniv Romano , Evan Patterson , Emmanuel J. Candès

While existing depression prediction methods based on deep learning show promise, their practical application is hindered by the lack of trustworthiness, as these deep models are often deployed as black box models, leaving us uncertain on…

Machine Learning · Computer Science 2024-08-28 Yonghong Li , Xiuzhuang Zhou

Online learning from a stream of data is a defining feature of intelligence, yet modern machine learning systems often struggle in this setting, especially under distributional shift. To understand its basic properties, we study the…

Machine Learning · Statistics 2026-05-11 Ziyan Li , Naoki Hiratani