English
Related papers

Related papers: MD-split+: Practical Local Conformal Inference in …

200 papers

Methods to quantify uncertainty in predictions from arbitrary models are in demand in high-stakes domains like medicine and finance. Conformal prediction has emerged as a popular method for producing a set of predictions with specified…

Machine Learning · Computer Science 2025-03-19 Jessica Hullman , Yifan Wu , Dawei Xie , Ziyang Guo , Andrew Gelman

Conformal prediction offers a practical framework for distribution-free uncertainty quantification, providing finite-sample coverage guarantees under relatively mild assumptions on data exchangeability. However, these assumptions cease to…

Machine Learning · Statistics 2024-06-25 Derck W. E. Prinzhorn , Thijmen Nijdam , Putri A. van der Linden , Alexander Timans

Regionalization aims to partition a spatial domain into contiguous regions that share similar characteristics, enabling more effective spatial analysis, policy making, and resource management. Existing approaches for spatial regionalization…

Machine Learning · Statistics 2026-05-07 Jiayu Weng , Alec Kirkley

Time series prediction underpins a broad range of downstream tasks across many scientific domains. Recent advances and increasing adoption of black-box machine learning models for time series prediction highlight the critical need for…

Machine Learning · Computer Science 2026-03-23 Junghwan Lee , Chen Xu , Yao Xie

We propose a novel distribution-free scheme to solve optimization problems where the goal is to minimize the expected value of a cost function subject to probabilistic constraints. Unlike standard sampling-based methods, our idea consists…

Optimization and Control · Mathematics 2025-05-28 Francesco Cordiano , Matin Jafarian , Bart De Schutter

Classical jittered sampling partitions $[0,1]^d$ into $m^d$ cubes for a positive integer $m$ and randomly places a point inside each of them, providing a point set of size $N=m^d$ with small discrepancy. The aim of this note is to provide a…

Combinatorics · Mathematics 2023-06-30 Francois Clement , Nathan Kirk , Florian Pausinger

We revisit the problem of constructing predictive confidence sets for which we wish to obtain some type of conditional validity. We provide new arguments showing how ``split conformal'' methods achieve near desired coverage levels with high…

Statistics Theory · Mathematics 2025-03-04 John C. Duchi

Black box models in machine learning have demonstrated excellent predictive performance in complex problems and high-dimensional settings. However, their lack of transparency and interpretability restrict the applicability of such models in…

Machine Learning · Computer Science 2020-06-09 Numair Sani , Jaron Lee , Razieh Nabi , Ilya Shpitser

A reliable representation of uncertainty is essential for the application of modern machine learning methods in safety-critical settings. In this regard, the use of credal sets (i.e., convex sets of probability distributions) has recently…

Machine Learning · Computer Science 2026-03-10 Paul Hofman , Timo Löhr , Maximilian Muschalik , Yusuf Sale , Eyke Hüllermeier

While improving prediction accuracy has been the focus of machine learning in recent years, this alone does not suffice for reliable decision-making. Deploying learning systems in consequential settings also requires calibrating and…

Machine Learning · Computer Science 2021-08-06 Stephen Bates , Anastasios Angelopoulos , Lihua Lei , Jitendra Malik , Michael I. Jordan

Conformal prediction methods provide statistically rigorous marginal coverage guarantees for machine learning models, but such guarantees fail to account for algorithmic biases, thereby undermining fairness and trust. This paper introduces…

Machine Learning · Computer Science 2026-05-13 Senrong Xu , Yanke Zhou , Yuhao Tan , Zenan Li , Yuan Yao , Taolue Chen , Feng Xu , Xiaoxing Ma

Conformal prediction is a powerful post-hoc framework for uncertainty quantification that provides distribution-free coverage guarantees. However, these guarantees crucially rely on the assumption of exchangeability. This assumption is…

Methodology · Statistics 2025-11-18 M. Stocker , W. Małgorzewicz , M. Fontana , S. Ben Taieb

Conformal Prediction methods have finite-sample distribution-free marginal coverage guarantees. However, they generally do not offer conditional coverage guarantees, which can be important for high-stakes decisions. In this paper, we…

Machine Learning · Statistics 2024-09-27 Ruijiang Gao , Mingzhang Yin , James McInerney , Nathan Kallus

We develop a general framework for distribution-free predictive inference in regression, using conformal inference. The proposed methodology allows for the construction of a prediction band for the response variable using any estimator of…

Methodology · Statistics 2017-03-09 Jing Lei , Max G'Sell , Alessandro Rinaldo , Ryan J. Tibshirani , Larry Wasserman

Explainable machine learning (XML) has emerged as a major challenge in artificial intelligence (AI). Although black-box models such as Deep Neural Networks and Gradient Boosting often exhibit exceptional predictive accuracy, their lack of…

Methodology · Statistics 2024-06-18 Evgenii Kuriabov , Jia Li

Accurate sensor calibration is crucial for autonomous systems, yet its uncertainty quantification remains underexplored. We present the first approach to integrate uncertainty awareness into online extrinsic calibration, combining Monte…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Mathieu Cocheteux , Julien Moreau , Franck Davoine

Building on top of a regression model, Conformal Prediction methods produce distribution free prediction sets, requiring only i.i.d. data. While R packages implementing such methods for the univariate response framework have been developed,…

Methodology · Statistics 2022-06-30 Paolo Vergottini , Matteo Fontana , Jacopo Diquigiovanni , Aldo Solari , Simone Vantini

Conformal prediction is a popular technique for constructing prediction intervals with distribution-free coverage guarantees. The coverage is marginal, meaning it only holds on average over the entire population but not necessarily for any…

Methodology · Statistics 2026-05-28 Yao Zhang , Emmanuel J. Candès

We study the problem of semantic segmentation calibration. Lots of solutions have been proposed to approach model miscalibration of confidence in image classification. However, to date, confidence calibration research on semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Dongdong Wang , Boqing Gong , Liqiang Wang

While the pursuit of higher accuracy in deepfake detection remains a central goal, there is an increasing demand for precise localization of manipulated regions. Despite the remarkable progress made in classification-based detection,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Chao Shuai , Gaojian Wang , Kun Pan , Tong Wu , Fanli Jin , Haohan Tan , Mengxiang Li , Zhenguang Liu , Feng Lin , Kui Ren