English
Related papers

Related papers: Conformal e-prediction in the presence of confound…

200 papers

The same method that creates adversarial examples (AEs) to fool image-classifiers can be used to generate counterfactual explanations (CEs) that explain algorithmic decisions. This observation has led researchers to consider CEs as AEs by…

Artificial Intelligence · Computer Science 2021-11-03 Timo Freiesleben

In response to everyday queries, humans explicitly signal uncertainty and offer alternative answers when they are unsure. Machine learning models that output calibrated prediction sets through conformal prediction mimic this human…

Machine Learning · Computer Science 2024-06-11 Jesse C. Cresswell , Yi Sui , Bhargava Kumar , Noël Vouitsis

We introduce a new observational setting for Positive Unlabeled (PU) data where the observations at prediction time are also labeled. This occurs commonly in practice -- we argue that the additional information is important for prediction,…

Machine Learning · Statistics 2024-07-16 Jan Mielniczuk , Adam Wawrzeńczyk

We introduce a framework for robust uncertainty quantification in situations where labeled training data are corrupted, through noisy or missing labels. We build on conformal prediction, a statistical tool for generating prediction sets…

Machine Learning · Computer Science 2026-02-27 Shai Feldman , Stephen Bates , Yaniv Romano

Recovering causal structure in the presence of latent variables is an important but challenging task. While many methods have been proposed to handle it, most of them require strict and/or untestable assumptions on the causal structure. In…

Machine Learning · Computer Science 2025-10-28 Wei Chen , Linjun Peng , Zhiyi Huang , Haoyue Dai , Zhifeng Hao , Ruichu Cai , Kun Zhang

The identifiability analysis of linear Ordinary Differential Equation (ODE) systems is a necessary prerequisite for making reliable causal inferences about these systems. While identifiability has been well studied in scenarios where the…

Machine Learning · Statistics 2024-10-31 Yuanyuan Wang , Biwei Huang , Wei Huang , Xi Geng , Mingming Gong

Conformal prediction (CP) transforms any model's output into prediction sets guaranteed to include (cover) the true label. CP requires exchangeability, a relaxation of the i.i.d. assumption, to obtain a valid distribution-free coverage…

Machine Learning · Computer Science 2024-07-15 Soroush H. Zargarbashi , Aleksandar Bojchevski

There are things we know, things we know we don't know, and then there are things we don't know we don't know. In this paper we address the latter two issues in a Bayesian framework, introducing the notion of doubt to quantify the degree of…

Data Analysis, Statistics and Probability · Physics 2008-11-18 Glenn D Starkman , Roberto Trotta , Pascal M Vaudrevange

As large language models continue to be widely developed, robust uncertainty quantification techniques will become crucial for their safe deployment in high-stakes scenarios. In this work, we explore how conformal prediction can be used to…

Computation and Language · Computer Science 2023-07-11 Bhawesh Kumar , Charlie Lu , Gauri Gupta , Anil Palepu , David Bellamy , Ramesh Raskar , Andrew Beam

Unreliable predictions can occur when using artificial intelligence (AI) systems with negative consequences for downstream applications, particularly when employed for decision-making. Conformal prediction provides a model-agnostic…

Machine Learning · Computer Science 2024-01-15 Geethen Singh , Glenn Moncrieff , Zander Venter , Kerry Cawse-Nicholson , Jasper Slingsby , Tamara B Robinson

In this work, we investigate the relationship between model generalization and counterfactual explainability in supervised learning. We introduce the notion of $\varepsilon$-valid counterfactual probability ($\varepsilon$-VCP) -- the…

Machine Learning · Computer Science 2025-05-30 Fabiano Veglianti , Flavio Giorgi , Fabrizio Silvestri , Gabriele Tolomei

Regression on observational data can fail to capture a causal relationship in the presence of unobserved confounding. Confounding strength measures this mismatch, but estimating it requires itself additional assumptions. A common assumption…

Machine Learning · Statistics 2022-11-04 Luca Rendsburg , Leena Chennuru Vankadara , Debarghya Ghoshdastidar , Ulrike von Luxburg

A highly accurate but overconfident model is ill-suited for deployment in critical applications such as healthcare and autonomous driving. The classification outcome should reflect a high uncertainty on ambiguous in-distribution samples…

Machine Learning · Computer Science 2022-10-25 Sumedha Singla , Nihal Murali , Forough Arabshahi , Sofia Triantafyllou , Kayhan Batmanghelich

Methods to quantify uncertainty in predictions from arbitrary models are in demand in high-stakes domains like medicine and finance. Conformal prediction has emerged as a popular method for producing a set of predictions with specified…

Machine Learning · Computer Science 2025-03-19 Jessica Hullman , Yifan Wu , Dawei Xie , Ziyang Guo , Andrew Gelman

We consider situations where data have been collected such that the sampling depends on the outcome of interest and possibly further covariates, as for instance in case-control studies. Graphical models represent assumptions about the…

Methodology · Statistics 2011-01-06 Vanessa Didelez , Svend Kreiner , Niels Keiding

We explore the problem of learning under selective labels in the context of algorithm-assisted decision making. Selective labels is a pervasive selection bias problem that arises when historical decision making blinds us to the true outcome…

Machine Learning · Computer Science 2018-07-06 Maria De-Arteaga , Artur Dubrawski , Alexandra Chouldechova

The well-known two-slit interference is understood as a special relation between observable (localization at the slits) and state (being on both slits). Relation between an observable and a quantum state is investigated in the general case.…

Quantum Physics · Physics 2009-11-11 Fedor Herbut

In classical extreme value theory probabilities of extreme events are estimated assuming all the components of a random vector to be in a domain of attraction of an extreme value distribution. In contrast, the conditional extreme value…

Statistics Theory · Mathematics 2011-08-30 Bikramjit Das , Sidney I. Resnick

Whether a variable is the cause of another, or simply associated with it, is often an important scientific question. Causal Inference is the name associated with the body of techniques for addressing that question in a statistical setting.…

Applications · Statistics 2025-06-25 Caren Marzban , Yikun Zhang , Nicholas Bond , Michael Richman

Causal inference from observational data requires assumptions. These assumptions range from measuring confounders to identifying instruments. Traditionally, causal inference assumptions have focused on estimation of effects for a single…

Machine Learning · Statistics 2019-03-04 Rajesh Ranganath , Adler Perotte