English
Related papers

Related papers: Identifying Spurious Correlations for Robust Text …

200 papers

Learning correlations from data forms the foundation of today's machine learning (ML) and artificial intelligence research. While contemporary methods enable the automatic discovery of complex patterns, they are prone to failure when…

Machine Learning · Computer Science 2026-05-05 Samuel J. Bell , Skyler Wang

Despite alarm over the reliance of machine learning systems on so-called spurious patterns, the term lacks coherent meaning in standard statistical frameworks. However, the language of causality offers clarity: spurious associations are due…

Computation and Language · Computer Science 2020-02-18 Divyansh Kaushik , Eduard Hovy , Zachary C. Lipton

We propose a method for generating spurious features by leveraging large-scale text-to-image diffusion models. Although the previous work detects spurious features in a large-scale dataset like ImageNet and introduces Spurious ImageNet, we…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 AprilPyone MaungMaung , Huy H. Nguyen , Hitoshi Kiya , Isao Echizen

Natural language understanding (NLU) models tend to rely on spurious correlations (i.e., dataset bias) to achieve high performance on in-distribution datasets but poor performance on out-of-distribution ones. Most of the existing debiasing…

Computation and Language · Computer Science 2022-09-14 Shihan Dou , Rui Zheng , Ting Wu , SongYang Gao , Junjie Shan , Qi Zhang , Yueming Wu , Xuanjing Huang

Models driven by spurious correlations often yield poor generalization performance. We propose the counterfactual (CF) alignment method to detect and quantify spurious correlations of black box classifiers. Our methodology is based on…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Joseph Paul Cohen , Louis Blankemeier , Akshay Chaudhari

Model-based, reference-free evaluation metrics have been proposed as a fast and cost-effective approach to evaluate Natural Language Generation (NLG) systems. Despite promising recent results, we find evidence that reference-free evaluation…

Computation and Language · Computer Science 2022-04-22 Esin Durmus , Faisal Ladhak , Tatsunori Hashimoto

Text classification helps analyse texts for semantic meaning and relevance, by mapping the words against this hierarchy. An analysis of various types of texts is invaluable to understanding both their semantic meaning, as well as their…

Machine Learning · Computer Science 2022-11-16 Chaitanya Chadha , Vandit Gupta , Deepak Gupta , Ashish Khanna

Due to their powerful feature association capabilities, neural network-based computer vision models have the ability to detect and exploit unintended patterns within the data, potentially leading to correct predictions based on incorrect or…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Solha Kang , Esla Timothy Anzaku , Wesley De Neve , Arnout Van Messem , Joris Vankerschaver , Francois Rameau , Utku Ozbulak

Deep learning models often achieve high performance by inadvertently learning spurious correlations between targets and non-essential features. For example, an image classifier may identify an object via its background that spuriously…

Machine Learning · Computer Science 2025-06-19 Guangtao Zheng , Wenqian Ye , Aidong Zhang

Text features that are correlated with class labels, but do not directly cause them, are sometimesuseful for prediction, but they may not be insightful. As an alternative to traditional correlation-basedfeature selection, causal inference…

Machine Learning · Computer Science 2020-10-12 Guohou Shan , James Foulds , Shimei Pan

Much recent work in NLP has documented dataset artifacts, bias, and spurious correlations between input features and output labels. However, how to tell which features have "spurious" instead of legitimate correlations is typically left…

Computation and Language · Computer Science 2021-12-30 Matt Gardner , William Merrill , Jesse Dodge , Matthew E. Peters , Alexis Ross , Sameer Singh , Noah A. Smith

The existing algorithms for identification of neurons responsible for undesired and harmful behaviors do not consider the effects of confounders such as topic of the conversation. In this work, we show that confounders can create spurious…

Computation and Language · Computer Science 2024-12-05 Milad Fotouhi , Mohammad Taha Bahadori , Oluwaseyi Feyisetan , Payman Arabshahi , David Heckerman

We propose a generic and interpretable learning framework for building robust text classification model that achieves accuracy comparable to full models under test-time budget constraints. Our approach learns a selector to identify words…

Machine Learning · Computer Science 2019-09-17 Md Rizwan Parvez , Tolga Bolukbasi , Kai-Wei Chang , Venkatesh Saligrama

Predictive models -- learned from observational data not covering the complete data distribution -- can rely on spurious correlations in the data for making predictions. These correlations make the models brittle and hinder generalization.…

Machine Learning · Computer Science 2020-06-16 Khurram Javed , Martha White , Yoshua Bengio

Spurious correlations occur when a model learns unreliable features from the data and are a well-known drawback of data-driven learning. Although there are several algorithms proposed to mitigate it, we are yet to jointly derive the…

Machine Learning · Computer Science 2023-08-23 Gautam Sreekumar , Vishnu Naresh Boddeti

Instance features in images exhibit spurious correlations with background features, affecting the training process of deep neural classifiers. This leads to insufficient attention to instance features by the classifier, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Xuewei Li , Zhenzhen Nie , Mei Yu , Zijian Zhang , Jie Gao , Tianyi Xu , Zhiqiang Liu

Given a textual query along with a corresponding video, the objective of moment retrieval aims to localize the moments relevant to the query within the video. While commendable results have been demonstrated by existing transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Xinyang Zhou , Fanyue Wei , Lixin Duan , Angela Yao , Wen Li

Recent research has revealed that deep neural networks often take dataset biases as a shortcut to make decisions rather than understand tasks, leading to failures in real-world applications. In this study, we focus on the spurious…

Computation and Language · Computer Science 2023-06-23 Yanrui Du , Jing Yan , Yan Chen , Jing Liu , Sendong Zhao , Qiaoqiao She , Hua Wu , Haifeng Wang , Bing Qin

Causal models bring many benefits to decision-making systems (or agents) by making them interpretable, sample-efficient, and robust to changes in the input distribution. However, spurious correlations can lead to wrong causal models and…

Machine Learning · Computer Science 2020-12-09 Sergei Volodin , Nevan Wichers , Jeremy Nixon

End-to-end deep learning exhibits unmatched performance for detecting malware, but such an achievement is reached by exploiting spurious correlations -- features with high relevance at inference time, but known to be useless through domain…

Cryptography and Security · Computer Science 2025-06-12 Bianca Perasso , Ludovico Lozza , Andrea Ponte , Luca Demetrio , Luca Oneto , Fabio Roli