English
Related papers

Related papers: Conformal Prediction Under Distribution Shift: A C…

200 papers

When a machine learning model is deployed, its predictions can alter its environment, as better informed agents strategize to suit their own interests. With such alterations in mind, existing approaches to uncertainty quantification break.…

Machine Learning · Statistics 2024-11-05 Daniel Csillag , Claudio José Struchiner , Guilherme Tegoni Goedert

In many real applications of statistical learning, collecting sufficiently many training data is often expensive, time-consuming, or even unrealistic. In this case, a transfer learning approach, which aims to leverage knowledge from a…

Machine Learning · Statistics 2025-02-26 Baozhen Wang , Xingye Qiao

The rapid growth of AI applications is dramatically increasing data center energy demand, exacerbating carbon emissions, and necessitating a shift towards 24/7 carbon-free energy (CFE). Unlike traditional annual energy matching, 24/7 CFE…

Systems and Control · Electrical Eng. & Systems 2025-10-07 Yijie Yang , Jian Shi , Dan Wang , Chenye Wu , Zhu Han

Conformal prediction provides finite-sample, distribution-free coverage under exchangeability, but standard constructions may lack robustness in the presence of outliers or heavy tails. We propose a robust conformal method based on a…

Statistics Theory · Mathematics 2026-04-21 Alejandro Cholaquidis , Emilien Joly , Leonardo Moreno

Deep Learning predictions with measurable confidence are increasingly desirable for real-world problems, especially in high-risk settings. The Conformal Prediction (CP) framework is a versatile solution that guarantees a maximum error rate…

Machine Learning · Computer Science 2023-08-08 Julia A. Meister , Khuong An Nguyen , Stelios Kapetanakis , Zhiyuan Luo

Predictive models are often required to produce reliable predictions under statistical conditions that are not matched to the training data. A common type of training-testing mismatch is covariate shift, where the conditional distribution…

Machine Learning · Computer Science 2025-01-22 Matteo Zecchin , Fredrik Hellström , Sangwoo Park , Shlomo Shamai , Osvaldo Simeone

Reliable navigation in safety-critical environments requires both accurate hazard perception and principled uncertainty handling to strengthen downstream safety handling. Despite the effectiveness of existing approaches, they assume perfect…

Machine Learning · Computer Science 2025-10-22 Daniel Bethell , Simos Gerasimou , Radu Calinescu , Calum Imrie

In a supervised learning problem, given a predicted value that is the output of some trained model, how can we quantify our uncertainty around this prediction? Distribution-free predictive inference aims to construct prediction intervals…

Statistics Theory · Mathematics 2025-07-01 Ruiting Liang , Rina Foygel Barber

Conformal prediction is a popular, modern technique for providing valid predictive inference for arbitrary machine learning models. Its validity relies on the assumptions of exchangeability of the data, and symmetry of the given model…

Methodology · Statistics 2023-03-20 Rina Foygel Barber , Emmanuel J. Candes , Aaditya Ramdas , Ryan J. Tibshirani

We propose Conformal Seasonal Pools (CSP), a training-free probabilistic time-series forecaster that mixes same-season empirical draws with signed residual draws around a seasonal naive forecast. In an audited rolling-origin benchmark on…

Machine Learning · Statistics 2026-05-06 Valery Manokhin

Learning from weak, proxy, or relative supervision is common when ground-truth labels are unavailable, but robustness under distribution shift remains poorly understood because the supervision mechanism itself may change across…

Machine Learning · Computer Science 2026-05-20 Mehrdad Shoeibi , Elias Hossain , Ivan Garibay , Niloofar Yousefi

The safe application of reinforcement learning (RL) requires generalization from limited training data to unseen scenarios. Yet, fulfilling tasks under changing circumstances is a key challenge in RL. Current state-of-the-art approaches for…

Machine Learning · Computer Science 2023-12-06 Philipp Altmann , Fabian Ritz , Leonard Feuchtinger , Jonas Nüßlein , Claudia Linnhoff-Popien , Thomy Phan

In statistics, forecast uncertainty is often quantified using a specified statistical model, though such approaches may be vulnerable to model misspecification, selection bias, and limited finite-sample validity. While bootstrapping can…

Methodology · Statistics 2026-03-12 Han Lin Shang

Conformal prediction gives exact finite-sample coverage guarantees under exchangeability, but deployed systems are judged by more than coverage alone. For a fixed calibrated rule reused over a finite operational window, stakeholders also…

Methodology · Statistics 2026-03-12 Petrus H. Zwart

Quantifying uncertainty in clinical predictions is critical for high-stakes diagnosis tasks. Conformal prediction offers a principled approach by providing prediction sets with theoretical coverage guarantees. However, in practice, patient…

Machine Learning · Computer Science 2026-05-01 Arjun Chatterjee , Sayeed Sajjad Razin , John Wu , Siddhartha Laghuvarapu , Jathurshan Pradeepkumar , Jimeng Sun

While the traditional viewpoint in machine learning and statistics assumes training and testing samples come from the same population, practice belies this fiction. One strategy -- coming from robust statistics and optimization -- is thus…

Machine Learning · Statistics 2024-07-08 Maxime Cauchois , Suyash Gupta , Alnur Ali , John C. Duchi

Conformal prediction delivers prediction intervals with distribution-free coverage, but its intervals can look overconfident in regions where the model is extrapolating, because standard conformal scores do not explicitly represent…

Machine Learning · Statistics 2026-03-10 Luben M. C. Cabezas , Sabina J. Sloman , Bruno M. Resende , Fanyi Wu , Michele Caprio , Rafael Izbicki

Rigorous uncertainty quantification is essential for the safe deployment of autonomous systems in unconstrained environments. Conformal Prediction (CP) provides a distribution-free framework for this task, yet its standard formulations rely…

Machine Learning · Computer Science 2026-05-14 Renukanandan Tumu , Aditya Singh , Rahul Mangharam

Discrimination and calibration represent two important properties of survival analysis, with the former assessing the model's ability to accurately rank subjects and the latter evaluating the alignment of predicted outcomes with actual…

Machine Learning · Computer Science 2024-06-04 Shi-ang Qi , Yakun Yu , Russell Greiner

We introduce $\textit{Backward Conformal Prediction}$, a method that guarantees conformal coverage while providing flexible control over the size of prediction sets. Unlike standard conformal prediction, which fixes the coverage level and…

Machine Learning · Statistics 2026-02-13 Etienne Gauthier , Francis Bach , Michael I. Jordan