English
Related papers

Related papers: Controlling for Unobserved Confounds in Classifica…

200 papers

A variety of techniques have been proposed to train machine learning classifiers that are independent of a given feature. While this can be an essential technique for enabling background estimation, it may also be useful for reducing…

High Energy Physics - Phenomenology · Physics 2022-02-09 Aishik Ghosh , Benjamin Nachman

Class imbalance poses a significant challenge in classification tasks, where traditional approaches often lead to biased models and unreliable predictions. Undersampling and oversampling techniques have been commonly employed to address…

Machine Learning · Computer Science 2025-10-22 Matt Clifford , Jonathan Erskine , Alexander Hepburn , Raúl Santos-Rodríguez , Dario Garcia-Garcia

Scientists have been interested in estimating causal peer effects to understand how people's behaviors are affected by their network peers. However, it is well known that identification and estimation of causal peer effects are challenging…

Methodology · Statistics 2021-09-07 Naoki Egami , Eric J. Tchetgen Tchetgen

A recent literature considers causal inference using noisy proxies for unobserved confounding factors. The proxies are divided into two sets that are independent conditional on the confounders. One set of proxies are `negative control…

Econometrics · Economics 2021-10-11 Ben Deaner

Machine learning systems increasingly depend on pipelines of multiple algorithms to provide high quality and well structured predictions. This paper argues interaction effects between clustering and prediction (e.g. classification,…

Machine Learning · Statistics 2019-01-01 Matt Barnes , Artur Dubrawski

The fundamental problem in treatment effect estimation from observational data is confounder identification and balancing. Most of the previous methods realized confounder balancing by treating all observed pre-treatment variables as…

Methodology · Statistics 2021-10-13 Anpeng Wu , Kun Kuang , Junkun Yuan , Bo Li , Runze Wu , Qiang Zhu , Yueting Zhuang , Fei Wu

Unobserved confounding is one of the greatest challenges for causal discovery. The case in which unobserved variables have a widespread effect on many of the observed ones is particularly difficult because most pairs of variables are…

Machine Learning · Statistics 2021-05-26 Alexis Bellot , Mihaela van der Schaar

Recommender systems may be confounded by various types of confounding factors (also called confounders) that may lead to inaccurate recommendations and sacrificed recommendation performance. Current approaches to solving the problem usually…

Information Retrieval · Computer Science 2023-08-15 Shuyuan Xu , Juntao Tan , Shelby Heinecke , Jia Li , Yongfeng Zhang

While learning with limited labelled data can improve performance when the labels are lacking, it is also sensitive to the effects of uncontrolled randomness introduced by so-called randomness factors (e.g., varying order of data). We…

Computation and Language · Computer Science 2024-12-03 Branislav Pecher , Ivan Srba , Maria Bielikova

We consider a causal effect that is confounded by an unobserved variable, but with observed proxy variables of the confounder. We show that, with at least two independent proxy variables satisfying a certain rank condition, the causal…

Methodology · Statistics 2018-06-29 Wang Miao , Zhi Geng , Eric Tchetgen Tchetgen

This paper develops a method to conduct causal inference in the presence of unobserved confounders by leveraging networks with homophily, a frequently observed tendency to form edges with similar nodes. I introduce a concept of asymptotic…

Econometrics · Economics 2025-11-04 Vincent Starck

A highly accurate but overconfident model is ill-suited for deployment in critical applications such as healthcare and autonomous driving. The classification outcome should reflect a high uncertainty on ambiguous in-distribution samples…

Machine Learning · Computer Science 2022-10-25 Sumedha Singla , Nihal Murali , Forough Arabshahi , Sofia Triantafyllou , Kayhan Batmanghelich

Observational data is increasingly used as a means for making individual-level causal predictions and intervention recommendations. The foremost challenge of causal inference from observational data is hidden confounding, whose presence…

Machine Learning · Statistics 2018-10-30 Nathan Kallus , Aahlad Manas Puli , Uri Shalit

The traditional binary classification framework constructs classifiers which may have good accuracy, but whose false positive and false negative error rates are not under users' control. In many cases, one of the errors is more severe and…

Machine Learning · Statistics 2020-10-22 Miloš Simić

We provide new results for nonparametric identification, estimation, and inference of causal effects using `proxy controls': observables that are noisy but informative proxies for unobserved confounding factors. Our analysis applies to…

Econometrics · Economics 2023-11-22 Ben Deaner

A common assumption in causal inference from observational data is that there is no hidden confounding. Yet it is, in general, impossible to verify this assumption from a single dataset. Under the assumption of independent causal mechanisms…

Methodology · Statistics 2023-11-07 Rickard K. A. Karlsson , Jesse H. Krijthe

Understanding the effect of a feature vector $x \in \mathbb{R}^d$ on the response value (label) $y \in \mathbb{R}$ is the cornerstone of many statistical learning problems. Ideally, it is desired to understand how a set of collected…

Machine Learning · Computer Science 2023-06-22 Mohammad Mehrabi , Ryan A. Rossi

Standard methods in preference learning involve estimating the parameters of discrete choice models from data of selections (choices) made by individuals from a discrete set of alternatives (the choice set). While there are many models for…

Machine Learning · Computer Science 2021-08-18 Kiran Tomlinson , Johan Ugander , Austin R. Benson

This research addresses the challenge of conducting interpretable causal inference between a binary treatment and its resulting outcome when not all confounders are known. Confounders are factors that have an influence on both the treatment…

Machine Learning · Computer Science 2023-10-24 Sohaib Kiani , Jared Barton , Jon Sushinsky , Lynda Heimbach , Bo Luo

When studying the causal effect of $x$ on $y$, researchers may conduct regression and report a confidence interval for the slope coefficient $\beta_{x}$. This common confidence interval provides an assessment of uncertainty from sampling…

Methodology · Statistics 2019-08-26 Brian Knaeble , Braxton Osting , Mark Abramson