English
Related papers

Related papers: Counterfactually Fair Conformal Prediction

200 papers

Conformal prediction is a useful and versatile alternative to model calibration in machine learning classification. It replaces single-class prediction with prediction sets, guaranteeing that the \textit{a priori} probability of the…

Machine Learning · Computer Science 2026-05-26 Sol Erika Boman

Causal approaches to fairness have seen substantial recent interest, both from the machine learning community and from wider parties interested in ethical prediction algorithms. In no small part, this has been due to the fact that causal…

Machine Learning · Computer Science 2019-08-17 Niki Kilbertus , Philip J. Ball , Matt J. Kusner , Adrian Weller , Ricardo Silva

We address counterfactual analysis in empirical models of games with partially identified parameters, and multiple equilibria and/or randomized strategies, by constructing and analyzing the counterfactual predictive distribution set (CPDS).…

Econometrics · Economics 2024-10-17 Brendan Kline , Elie Tamer

Personalized decision making requires the knowledge of potential outcomes under different treatments, and confidence intervals about the potential outcomes further enrich this decision-making process and improve its reliability in…

Machine Learning · Computer Science 2024-05-22 Zonghao Chen , Ruocheng Guo , Jean-François Ton , Yang Liu

Conformal inference is a versatile tool for building prediction sets in regression or classification. We study the false coverage proportion (FCP) in a simultaneous inference setting with a calibration sample of $n$ points and a test sample…

Statistics Theory · Mathematics 2026-02-19 Ulysse Gazin

The rapid advancement of large language models has raised significant concerns regarding their potential misuse by malicious actors. As a result, developing effective detectors to mitigate these risks has become a critical priority.…

Computation and Language · Computer Science 2025-05-15 Xiaowei Zhu , Yubing Ren , Yanan Cao , Xixun Lin , Fang Fang , Yangxi Li

We develop a new method for generating prediction sets that combines the flexibility of conformal methods with an estimate of the conditional distribution $P_{Y \mid X}$. Existing methods, such as conformalized quantile regression and…

Machine Learning · Statistics 2024-10-10 Vincent Plassier , Alexander Fishkov , Mohsen Guizani , Maxim Panov , Eric Moulines

When applied in healthcare, reinforcement learning (RL) seeks to dynamically match the right interventions to subjects to maximize population benefit. However, the learned policy may disproportionately allocate efficacious actions to one…

Machine Learning · Statistics 2025-01-15 Jitao Wang , Chengchun Shi , John D. Piette , Joshua R. Loftus , Donglin Zeng , Zhenke Wu

In this paper we apply Conformal Prediction (CP) to the k-Nearest Neighbours Regression (k-NNR) algorithm and propose ways of extending the typical nonconformity measure used for regression so far. Unlike traditional regression methods…

Machine Learning · Computer Science 2014-01-17 Harris Papadopoulos , Vladimir Vovk , Alex Gammerman

Conformal prediction (CP) gives distribution-free coverage for modern vision and language models, but it is often forced to make a ranking decision from a single unstable nonconformity score. Standard CP uses one realization, while…

Machine Learning · Computer Science 2026-05-25 Jiapeng Zeng , Yogesh Prabhu , Zhanpeng Zeng , Michael A. Newton , Vikas Singh

Decision support systems for classification tasks are predominantly designed to predict the value of the ground truth labels. However, since their predictions are not perfect, these systems also need to make human experts understand when…

Machine Learning · Computer Science 2024-07-17 Eleni Straitouri , Manuel Gomez Rodriguez

We introduce $\textit{Backward Conformal Prediction}$, a method that guarantees conformal coverage while providing flexible control over the size of prediction sets. Unlike standard conformal prediction, which fixes the coverage level and…

Machine Learning · Statistics 2026-02-13 Etienne Gauthier , Francis Bach , Michael I. Jordan

Conformal inference has played a pivotal role in providing uncertainty quantification for black-box ML prediction algorithms with finite sample guarantees. Traditionally, conformal prediction inference requires a data-independent…

Methodology · Statistics 2023-07-04 Siddhaarth Sarkar , Arun Kumar Kuchibhotla

Surrogate models (including deep neural networks and other machine learning algorithms in supervised learning) are capable of approximating arbitrarily complex, high-dimensional input-output problems in science and engineering, but require…

Machine Learning · Computer Science 2025-12-17 Miguel Sánchez-Domínguez , Lucas Lacasa , Javier de Vicente , Gonzalo Rubio , Eusebio Valero

Conformal prediction is a model-agnostic approach to generating prediction sets that cover the true class with a high probability. Although its prediction set size is expected to capture aleatoric uncertainty, there is a lack of evidence…

Machine Learning · Computer Science 2025-11-24 Misgina Tsighe Hagos , Claes Lundström

Counterfactual inference considers a hypothetical intervention in a parallel world that shares some evidence with the factual world. If the evidence specifies a conditional distribution on a manifold, counterfactuals may be analytically…

Machine Learning · Statistics 2024-07-03 Juha Karvanen , Santtu Tikka , Matti Vihola

Conformal Prediction (CP) controls the prediction uncertainty of classification systems by producing a small prediction set, ensuring a predetermined probability that the true class lies within this set. This is commonly done by defining a…

Machine Learning · Computer Science 2025-08-14 Coby Penso , Jacob Goldberger , Ethan Fetaya

We investigate the integration of Conformal Prediction (CP) with supervised learning on deterministically encrypted data, aiming to bridge the gap between rigorous uncertainty quantification and privacy-preserving machine learning. Using…

Machine Learning · Computer Science 2025-07-15 Alexander David Balinsky , Dominik Krzeminski , Alexander Balinsky

Conformal prediction (CP) provides powerful, distribution-free prediction sets, but its guarantees rely on the exchangeability of training and test data, which is often violated in practice due to covariate shifts. While weighted conformal…

Machine Learning · Computer Science 2026-05-05 James Wang , Surbhi Goel

Counterfactual explanations (CFE) are being widely used to explain algorithmic decisions, especially in consequential decision-making contexts (e.g., loan approval or pretrial bail). In this context, CFEs aim to provide individuals affected…

Machine Learning · Computer Science 2021-02-09 Kiarash Mohammadi , Amir-Hossein Karimi , Gilles Barthe , Isabel Valera