English
Related papers

Related papers: Controlling for Unobserved Confounds in Classifica…

200 papers

In the context of the usual calibration model, we consider the case in which the independent variable is unobservable, but a pre-fixed value on its surrogate is available. Thus, considering controlled variables and assuming that the…

Applications · Statistics 2008-02-06 Betsabé G. Blas Achic , Mônica C. Sandoval , Olga Satomi Yoshida

It is a truth universally acknowledged that an observed association without known mechanism must be in want of a causal estimate. However, causal estimation from observational data often relies on the (untestable) assumption of `no…

Methodology · Statistics 2020-12-10 Victor Veitch , Anisha Zaveri

This paper deals with the problem of evaluating the causal effect using observational data in the presence of an unobserved exposure/ outcome variable, when cause-effect relationships between variables can be described as a directed acyclic…

Methodology · Statistics 2012-06-18 Manabu Kuroki , Zhihong Cai

Causal models with unobserved variables impose nontrivial constraints on the distributions over the observed variables. When a common cause of two variables is unobserved, it is impossible to uncover the causal relation between them without…

Statistics Theory · Mathematics 2021-12-14 Beata Zjawin , Elie Wolfe , Robert W. Spekkens

Classical epidemiology has focused on the control of confounding but it is only recently that epidemiologists have started to focus on the bias produced by colliders. A collider for a certain pair of variables (e.g., an outcome Y and an…

Evaluation of treatment effects and more general estimands is typically achieved via parametric modelling, which is unsatisfactory since model misspecification is likely. Data-adaptive model building (e.g. statistical/machine learning) is…

Statistics Theory · Mathematics 2022-01-14 Oliver Hines , Oliver Dukes , Karla Diaz-Ordaz , Stijn Vansteelandt

Selection bias arises when the probability that an observation enters a dataset depends on variables related to the quantities of interest, leading to systematic distortions in estimation and uncertainty quantification. For example, in…

Confounder selection, namely choosing a set of covariates to control for confounding between a treatment and an outcome, is arguably the most important step in the design of an observational study. Previous methods, such as Pearl's…

Methodology · Statistics 2026-03-24 F. Richard Guo , Qingyuan Zhao

Assessing the fairness of a decision making system with respect to a protected class, such as gender or race, is challenging when class membership labels are unavailable. Probabilistic models for predicting the protected class based on…

Applications · Statistics 2018-11-28 Jiahao Chen , Nathan Kallus , Xiaojie Mao , Geoffry Svacha , Madeleine Udell

Causal inference from observational data often assumes "ignorability," that all confounders are observed. This assumption is standard yet untestable. However, many scientific studies involve multiple causes, different variables whose…

Machine Learning · Statistics 2019-04-16 Yixin Wang , David M. Blei

The principal stratification has become a popular tool to address a broad class of causal inference questions, particularly in dealing with non-compliance and truncation-by-death problems. The causal effects within principal strata which…

Methodology · Statistics 2022-06-20 Shanshan Luo , Wei Li , Wang Miao , Yangbo He

Recommender models aim to capture user preferences from historical feedback and then predict user-specific feedback on candidate items. However, the presence of various unmeasured confounders causes deviations between the user preferences…

Information Retrieval · Computer Science 2024-04-03 Hangtong Xu , Yuanbo Xu , Yongjian Yang

Confounding of three binary-variables counterfactual model is discussed in this paper. According to the effect between the control variable and the covariate variable, we investigate three counterfactual models: the control variable is…

Applications · Statistics 2011-08-09 Jingwei Liu , Shuang Hu

When applied to high-dimensional datasets, feature selection algorithms might still leave dozens of irrelevant variables in the dataset. Therefore, even after feature selection has been applied, classifiers must be prepared to the presence…

Machine Learning · Computer Science 2018-11-21 Danilo Vasconcellos Vargas , Hirotaka Takano , Junichi Murata

The assessment of binary classifier performance traditionally centers on discriminative ability using metrics, such as accuracy. However, these metrics often disregard the model's inherent uncertainty, especially when dealing with sensitive…

Machine Learning · Computer Science 2024-02-13 Agathe Fernandes Machado , Arthur Charpentier , Emmanuel Flachaire , Ewen Gallic , François Hu

When decision-makers can directly intervene, policy evaluation algorithms give valid causal estimates. In off-policy evaluation (OPE), there may exist unobserved variables that both impact the dynamics and are used by the unknown behavior…

Machine Learning · Computer Science 2022-04-05 David Bruns-Smith

A key condition for obtaining reliable estimates of the causal effect of a treatment is overlap (a.k.a. positivity): the distributions of the features used to perform causal adjustment cannot be too different in the treated and control…

Methodology · Statistics 2021-04-14 Alexander D'Amour , Alexander Franks

Distribution shifts between sites can seriously degrade model performance since models are prone to exploiting unstable correlations. Thus, many methods try to find features that are stable across sites and discard unstable features.…

Machine Learning · Computer Science 2024-09-11 Minh Nguyen , Alan Q. Wang , Heejong Kim , Mert R. Sabuncu

This paper presents a conformal prediction method for classification in highly imbalanced and open-set settings, where there are many possible classes and not all may be represented in the data. Existing approaches require a finite, known…

Machine Learning · Statistics 2025-10-16 Tianmin Xie , Yanfei Zhou , Ziyi Liang , Stefano Favaro , Matteo Sesia

Identifying effects of actions (treatments) on outcome variables from observational data and causal assumptions is a fundamental problem in causal inference. This identification is made difficult by the presence of confounders which can be…

Methodology · Statistics 2012-03-19 Ilya Shpitser , Tyler VanderWeele , James M. Robins