English
Related papers

Related papers: Distribution-Free Prediction Sets for Two-Layer Hi…

200 papers

Conformal prediction (CP) is a powerful framework for quantifying uncertainty in machine learning models, offering reliable predictions with finite-sample coverage guarantees. When applied to classification, CP produces a prediction set of…

Machine Learning · Computer Science 2025-08-20 Floris den Hengst , Inès Blin , Majid Mohammadi , Syed Ihtesham Hussain Shah , Taraneh Younesian

This paper studies the open problem of conformalized entry prediction in a row/column-exchangeable matrix. The matrix setting presents novel and unique challenges, but there exists little work on this interesting topic. We meticulously…

Machine Learning · Computer Science 2023-06-07 Meijia Shao , Yuan Zhang

Conformal Prediction (CP) is a distribution-free method for constructing prediction sets with marginal finite-sample coverage guarantees, making it a suitable framework for reliable uncertainty quantification in safety-critical object…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Christopher Ries , Moussa Kassem Sbeyti , Nicolas Bianco , Nadja Klein

We propose a new method called localized conformal prediction, where we can perform conformal inference using only a local region around a new test sample to construct its confidence interval. Localized conformal inference is a natural…

Statistics Theory · Mathematics 2020-07-08 Leying Guan

Quantifying uncertainty in clinical predictions is critical for high-stakes diagnosis tasks. Conformal prediction offers a principled approach by providing prediction sets with theoretical coverage guarantees. However, in practice, patient…

Machine Learning · Computer Science 2026-05-01 Arjun Chatterjee , Sayeed Sajjad Razin , John Wu , Siddhartha Laghuvarapu , Jathurshan Pradeepkumar , Jimeng Sun

Conformal prediction (CP) provides model-agnostic uncertainty quantification with guaranteed coverage, but conventional methods often produce overly conservative uncertainty sets, especially in multi-dimensional settings. This limitation…

Machine Learning · Computer Science 2025-02-12 Minxing Zheng , Shixiang Zhu

Conformal predictive systems are a recent modification of conformal predictors that output, in regression problems, probability distributions for labels of test observations rather than set predictions. The extra information provided by…

Machine Learning · Computer Science 2019-11-05 Vladimir Vovk , Ivan Petej , Ilia Nouretdinov , Valery Manokhin , Alex Gammerman

We study the problem of offline changepoint localization in a distribution-free setting. One observes a vector of data with a single changepoint, assuming that the data before and after the changepoint are iid (or more generally…

Methodology · Statistics 2026-02-10 Rohan Hore , Aaditya Ramdas

Conformal prediction is a technique for constructing prediction intervals that attain valid coverage in finite samples, without making distributional assumptions. Despite this appeal, existing conformal methods can be unnecessarily…

Methodology · Statistics 2019-05-09 Yaniv Romano , Evan Patterson , Emmanuel J. Candès

Conformal methods create prediction bands that control average coverage assuming solely i.i.d. data. Although the literature has mostly focused on prediction intervals, more general regions can often better represent uncertainty. For…

Machine Learning · Statistics 2021-10-06 Rafael Izbicki , Gilson Shimizu , Rafael B. Stern

Many risk-sensitive applications require well-calibrated prediction sets over multiple, potentially correlated target variables, for which the prediction algorithm may report correlated errors. In this work, we aim to construct the…

Machine Learning · Computer Science 2025-03-12 Ji Won Park , Robert Tibshirani , Kyunghyun Cho

Modern image classifiers are very accurate, but the predictions come without uncertainty estimates. Conformal predictors provide uncertainty estimates by computing a set of classes containing the correct class with a user-specified…

Machine Learning · Computer Science 2023-06-06 Fatih Furkan Yilmaz , Reinhard Heckel

Conformal Prediction is a framework that produces prediction intervals based on the output from a machine learning algorithm. In this paper we explore the case when training data is made up of multiple parts available in different sources…

Machine Learning · Statistics 2019-08-16 Ola Spjuth , Robin Carrión Brännström , Lars Carlsson , Niharika Gauraha

Conformal prediction provides model-agnostic and distribution-free uncertainty quantification through prediction sets that are guaranteed to include the ground truth with any user-specified probability. Yet, conformal prediction is not…

Machine Learning · Computer Science 2025-03-18 Yan Scholten , Stephan Günnemann

In a split conformal framework with $K$ classes, a calibration sample of $n$ labeled examples is observed for inference on the label of a new unlabeled example. We explore the setting where a `batch' of $m$ independent such unlabeled…

Methodology · Statistics 2025-03-19 Ulysse Gazin , Ruth Heller , Etienne Roquain , Aldo Solari

Irregular errors such as heteroscedasticity and nonnormality remain major challenges in linear modeling. These issues often lead to biased inference and unreliable measures of uncertainty. Classical remedies, such as robust standard errors…

Methodology · Statistics 2026-03-05 Elsayed Elamir

Multi-fidelity methods are prominently used when cheaply-obtained, but possibly biased and noisy, observations must be effectively combined with limited or expensive true data in order to construct reliable models. This arises in both…

Machine Learning · Statistics 2019-03-19 Kurt Cutajar , Mark Pullin , Andreas Damianou , Neil Lawrence , Javier González

We introduce Compartmentalized Diffusion Models (CDM), a method to train different diffusion models (or prompts) on distinct data sources and arbitrarily compose them at inference time. The individual models can be trained in isolation, at…

Machine Learning · Computer Science 2024-10-15 Aditya Golatkar , Alessandro Achille , Ashwin Swaminathan , Stefano Soatto

Conformal prediction provides a powerful framework for constructing distribution-free prediction regions with finite-sample coverage guarantees. While extensively studied in univariate settings, its extension to multi-output problems…

Machine Learning · Statistics 2025-02-04 Victor Dheur , Matteo Fontana , Yorick Estievenart , Naomi Desobry , Souhaib Ben Taieb

Most existing examples of full conformal predictive systems, split-conformal predictive systems, and cross-conformal predictive systems impose severe restrictions on the adaptation of predictive distributions to the test object at hand. In…

Machine Learning · Computer Science 2019-02-19 Vladimir Vovk , Ivan Petej , Paolo Toccaceli , Alex Gammerman