English
Related papers

Related papers: Removing Spurious Correlation from Neural Network …

200 papers

Causal mediation analysis is used to evaluate direct and indirect causal effects of a treatment on an outcome of interest through an intermediate variable or a mediator.It is difficult to identify the direct and indirect causal effects…

Applications · Statistics 2020-01-14 Wei Li , Chunchen Liu , Zhi Geng , John Murray

This research addresses the challenge of conducting interpretable causal inference between a binary treatment and its resulting outcome when not all confounders are known. Confounders are factors that have an influence on both the treatment…

Machine Learning · Computer Science 2023-10-24 Sohaib Kiani , Jared Barton , Jon Sushinsky , Lynda Heimbach , Bo Luo

Informally, a 'spurious correlation' is the dependence of a model on some aspect of the input data that an analyst thinks shouldn't matter. In machine learning, these have a know-it-when-you-see-it character; e.g., changing the gender of a…

Machine Learning · Computer Science 2021-11-04 Victor Veitch , Alexander D'Amour , Steve Yadlowsky , Jacob Eisenstein

We consider the problem of estimating a causal effect in a multi-domain setting. The causal effect of interest is confounded by an unobserved confounder and can change between the different domains. We assume that we have access to a proxy…

Machine Learning · Computer Science 2025-12-30 Manuel Iglesias-Alonso , Felix Schur , Julius von Kügelgen , Jonas Peters

Many applications of computational social science aim to infer causal conclusions from non-experimental data. Such observational data often contains confounders, variables that influence both potential causes and potential effects.…

Computation and Language · Computer Science 2020-05-05 Katherine A. Keith , David Jensen , Brendan O'Connor

Confounding matters in almost all observational studies that focus on causality. In order to eliminate bias caused by connfounders, oftentimes a substantial number of features need to be collected in the analysis. In this case, large p…

Statistics Theory · Mathematics 2019-12-30 Shinyuu Lee , Yuru Zhu

A fundamental goal of scientific research is to learn about causal relationships. However, despite its critical role in the life and social sciences, causality has not had the same importance in Natural Language Processing (NLP), which has…

Without loss of generality, existing machine learning techniques may learn spurious correlation dependent on the domain, which exacerbates the generalization of models in out-of-distribution (OOD) scenarios. To address this issue, recent…

Machine Learning · Computer Science 2024-06-18 Bin Qin , Jiangmeng Li , Yi Li , Xuesong Wu , Yupeng Wang , Wenwen Qiang , Jianwen Cao

Causal influence measures for machine learnt classifiers shed light on the reasons behind classification, and aid in identifying influential input features and revealing their biases. However, such analyses involve evaluating the classifier…

Machine Learning · Computer Science 2018-04-10 Shayak Sen , Piotr Mardziel , Anupam Datta , Matthew Fredrikson

Researchers are often interested in learning not only the effect of treatments on outcomes, but also the pathways through which these effects operate. A mediator is a variable that is affected by treatment and subsequently affects outcome.…

Methodology · Statistics 2021-12-22 Jeremiah Jones , Ashkan Ertefaie , Robert L. Strawderman

Machine learning practice is often impacted by confounders. Confounding can be particularly severe in remote digital health studies where the participants self-select to enter the study. While many different confounding adjustment…

Applications · Statistics 2019-11-14 Elias Chaibub Neto , Meghasyam Tummalacherla , Lara Mangravite , Larsson Omberg

The reliability of machine learning systems critically assumes that the associations between features and labels remain similar between training and test distributions. However, unmeasured variables, such as confounders, break this…

Machine Learning · Computer Science 2020-08-17 Megha Srivastava , Tatsunori Hashimoto , Percy Liang

Learning correlations from data forms the foundation of today's machine learning (ML) and artificial intelligence research. While contemporary methods enable the automatic discovery of complex patterns, they are prone to failure when…

Machine Learning · Computer Science 2026-05-05 Samuel J. Bell , Skyler Wang

Modern language modeling tasks are often underspecified: for a given token prediction, many words may satisfy the user's intent of producing natural language at inference time, however only one word will minimize the task's loss function at…

Computation and Language · Computer Science 2024-02-23 Emily McMilin

Recent years have witnessed remarkable progress towards computational fake news detection. To mitigate its negative impact, we argue that it is critical to understand what user attributes potentially cause users to share fake news. The key…

Computers and Society · Computer Science 2021-07-16 Lu Cheng , Ruocheng Guo , Kai Shu , Huan Liu

While existing social bot detectors perform well on benchmarks, their robustness across diverse real-world scenarios remains limited due to unclear ground truth and varied misleading cues. In particular, the impact of shortcut learning,…

Computation and Language · Computer Science 2026-03-24 Shiyan Zheng , Herun Wan , Minnan Luo , Junhang Huang

Deep learning has revolutionized the field of artificial intelligence. Based on the statistical correlations uncovered by deep learning-based methods, computer vision has contributed to tremendous growth in areas like autonomous driving and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Kexuan Zhang , Qiyu Sun , Chaoqiang Zhao , Yang Tang

We investigate the estimation of the causal effect of a treatment variable on an outcome in the presence of a latent confounder. We first show that the causal effect is identifiable under certain conditions when data is available from…

Artificial Intelligence · Computer Science 2025-06-16 Yaroslav Kivva , Sina Akbari , Saber Salehkaleybar , Negar Kiyavash

Machine learning models often rely on simple spurious features -- patterns in training data that correlate with targets but are not causally related to them, like image backgrounds in foreground classification. This reliance typically leads…

Machine Learning · Computer Science 2025-06-06 Chenyu You , Haocheng Dai , Yifei Min , Jasjeet S. Sekhon , Sarang Joshi , James S. Duncan

Machine learning models tend to learn spurious features - features that strongly correlate with target labels but are not causal. Existing approaches to mitigate models' dependence on spurious features work in some cases, but fail in…

Machine Learning · Computer Science 2025-04-23 Phuong Quynh Le , Jörg Schlötterer , Christin Seifert