English
Related papers

Related papers: A critical assessment of conformal prediction meth…

200 papers

As deep neural networks are more commonly deployed in high-stakes domains, their black-box nature makes uncertainty quantification challenging. We investigate the presentation of conformal prediction sets--a distribution-free class of…

Human-Computer Interaction · Computer Science 2024-04-29 Dongping Zhang , Angelos Chatzimparmpas , Negar Kamali , Jessica Hullman

Conformal predictive systems are a recent modification of conformal predictors that output, in regression problems, probability distributions for labels of test observations rather than set predictions. The extra information provided by…

Machine Learning · Computer Science 2019-11-05 Vladimir Vovk , Ivan Petej , Ilia Nouretdinov , Valery Manokhin , Alex Gammerman

Conformal prediction is a general distribution-free approach for constructing prediction sets combined with any machine learning algorithm that achieve valid marginal or conditional coverage in finite samples. Ordinal classification is…

Methodology · Statistics 2024-11-05 Subhrasish Chakraborty , Chhavi Tyagi , Haiyan Qiao , Wenge Guo

This paper introduces a conformal inference method to evaluate uncertainty in classification by generating prediction sets with valid coverage conditional on adaptively chosen features. These features are carefully selected to reflect…

Machine Learning · Statistics 2024-10-31 Yanfei Zhou , Matteo Sesia

We study optimal conformity measures for various criteria of efficiency of classification in an idealised setting. This leads to an important class of criteria of efficiency that we call probabilistic; it turns out that the most standard…

Machine Learning · Computer Science 2016-09-15 Vladimir Vovk , Ilia Nouretdinov , Valentina Fedorova , Ivan Petej , Alex Gammerman

The propensity score is a common tool for estimating the causal effect of a binary treatment in observational data. In this setting, matching, subclassification, imputation, or inverse probability weighting on the propensity score can…

Methodology · Statistics 2018-01-03 Michael J Lopez , Roee Gutman

Understanding the dose-response relation between a continuous treatment and the outcome for an individual can greatly drive decision-making, particularly in areas like personalized drug dosing and personalized healthcare interventions.…

Machine Learning · Computer Science 2026-01-07 Jarne Verhaeghe , Jef Jonkers , Sofie Van Hoecke

While the predictions produced by conformal prediction are set-valued, the data used for training and calibration is supposed to be precise. In the setting of superset learning or learning from partial labels, a variant of weakly supervised…

Machine Learning · Computer Science 2023-06-05 Alireza Javanmardi , Yusuf Sale , Paul Hofman , Eyke Hüllermeier

In this paper, we present a novel approach for conformal prediction (CP), in which we aim to identify a set of promising prediction candidates -- in place of a single prediction. This set is guaranteed to contain a correct answer with high…

Machine Learning · Computer Science 2021-02-03 Adam Fisch , Tal Schuster , Tommi Jaakkola , Regina Barzilay

The two-dimensional case occupies a special position in the theory of critical phenomena due to the exact results provided by lattice solutions and, directly in the continuum, by the infinite-dimensional character of the conformal algebra.…

Statistical Mechanics · Physics 2021-04-01 Gesualdo Delfino

Conformal prediction is a framework for uncertainty quantification that constructs prediction sets for previously unseen data, guaranteeing coverage of the true label with a specified probability. However, the efficiency of these prediction…

Machine Learning · Computer Science 2026-01-06 Erfan Hajihashemi , Yanning Shen

Conformal prediction is a popular, modern technique for providing valid predictive inference for arbitrary machine learning models. Its validity relies on the assumptions of exchangeability of the data, and symmetry of the given model…

Methodology · Statistics 2023-03-20 Rina Foygel Barber , Emmanuel J. Candes , Aaditya Ramdas , Ryan J. Tibshirani

Conformal prediction is an uncertainty quantification method that constructs a prediction set for a previously unseen datum, ensuring the true label is included with a predetermined coverage probability. Adaptive conformal prediction has…

Machine Learning · Computer Science 2024-11-07 Erfan Hajihashemi , Yanning Shen

Forecasting armed conflicts is a critical area of research with the potential to save lives and mitigate suffering. While existing forecasting models offer valuable point predictions, they often lack individual-level uncertainty estimates,…

Methodology · Statistics 2026-01-14 David Randahl , Jonathan P. Williams , Håvard Hegre

Conformal prediction has emerged as an effective strategy for uncertainty quantification by modifying a model to output sets of labels instead of a single label. These prediction sets come with the guarantee that they contain the true label…

Machine Learning · Computer Science 2025-05-28 Haosen Ge , Hamsa Bastani , Osbert Bastani

Conformal prediction builds marginally valid prediction intervals that cover the unknown outcome of a randomly drawn test point with a prescribed probability. However, in practice, data-driven methods are often used to identify specific…

Methodology · Statistics 2025-04-21 Ying Jin , Zhimei Ren

Deep learning based cervical cancer classification can potentially increase access to screening in low-resource regions. However, deep learning models are often overconfident and do not reliably reflect diagnostic uncertainty. Moreover,…

Image and Video Processing · Electrical Eng. & Systems 2025-05-15 Misgina Tsighe Hagos , Antti Suutala , Dmitrii Bychkov , Hakan Kücükel , Joar von Bahr , Milda Poceviciute , Johan Lundin , Nina Linder , Claes Lundström

We present an application of conformal prediction, a form of uncertainty quantification with guarantees, to the detection of railway signals. State-of-the-art architectures are tested and the most promising one undergoes the process of…

Machine Learning · Statistics 2023-01-27 Léo Andéol , Thomas Fel , Florence De Grancey , Luca Mossina

In response to everyday queries, humans explicitly signal uncertainty and offer alternative answers when they are unsure. Machine learning models that output calibrated prediction sets through conformal prediction mimic this human…

Machine Learning · Computer Science 2024-06-11 Jesse C. Cresswell , Yi Sui , Bhargava Kumar , Noël Vouitsis

Binary classification is a task that involves the classification of data into one of two distinct classes. It is widely utilized in various fields. However, conventional classifiers tend to make overconfident predictions for data that…

Machine Learning · Computer Science 2025-03-13 Shoma Yokura , Akihisa Ichiki