English
Related papers

Related papers: Measuring Spurious Correlation in Classification: …

200 papers

Learning correlations from data forms the foundation of today's machine learning (ML) and artificial intelligence research. While contemporary methods enable the automatic discovery of complex patterns, they are prone to failure when…

Machine Learning · Computer Science 2026-05-05 Samuel J. Bell , Skyler Wang

Due to their powerful feature association capabilities, neural network-based computer vision models have the ability to detect and exploit unintended patterns within the data, potentially leading to correct predictions based on incorrect or…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Solha Kang , Esla Timothy Anzaku , Wesley De Neve , Arnout Van Messem , Joris Vankerschaver , Francois Rameau , Utku Ozbulak

Instance features in images exhibit spurious correlations with background features, affecting the training process of deep neural classifiers. This leads to insufficient attention to instance features by the classifier, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Xuewei Li , Zhenzhen Nie , Mei Yu , Zijian Zhang , Jie Gao , Tianyi Xu , Zhiqiang Liu

Identifying spurious correlations learned by a trained model is at the core of refining a trained model and building a trustworthy model. We present a simple method to identify spurious correlations that have been learned by a model trained…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Misgina Tsighe Hagos , Kathleen M. Curran , Brian Mac Namee

Self-supervised learning (SSL) has emerged as a powerful technique for learning rich representations from unlabeled data. The data representations are able to capture many underlying attributes of data, and be useful in downstream…

Machine Learning · Computer Science 2023-12-01 Weicheng Zhu , Sheng Liu , Carlos Fernandez-Granda , Narges Razavian

Machine learning models are known to learn spurious correlations, i.e., features having strong relations with class labels but no causal relation. Relying on those correlations leads to poor performance in the data groups without these…

Machine Learning · Computer Science 2026-04-28 Phuong Quynh Le , Jörg Schlötterer , Christin Seifert

We present a simple but effective method to measure and mitigate model biases caused by reliance on spurious cues. Instead of requiring costly changes to one's data or model training, our method better utilizes the data one already has by…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Mazda Moayeri , Wenxiao Wang , Sahil Singla , Soheil Feizi

Multi-Task Learning (MTL) is a powerful learning paradigm to improve generalization performance via knowledge sharing. However, existing studies find that MTL could sometimes hurt generalization, especially when two tasks are less…

Machine Learning · Computer Science 2022-11-28 Ziniu Hu , Zhe Zhao , Xinyang Yi , Tiansheng Yao , Lichan Hong , Yizhou Sun , Ed H. Chi

Neural networks trained with (stochastic) gradient descent have an inductive bias towards learning simpler solutions. This makes them highly prone to learning spurious correlations in the training data, that may not hold at test time. In…

Machine Learning · Computer Science 2024-03-08 Yu Yang , Eric Gan , Gintare Karolina Dziugaite , Baharan Mirzasoleiman

To address the problem of NLP classifiers learning spurious correlations between training features and target labels, a common approach is to make the model's predictions invariant to these features. However, this can be counter-productive…

Machine Learning · Computer Science 2023-06-22 Parikshit Bansal , Amit Sharma

Despite the success of machine learning applications in science, industry, and society in general, many approaches are known to be non-robust, often relying on spurious correlations to make predictions. Spuriousness occurs when some…

Computer Vision and Pattern Recognition · Computer Science 2021-06-04 Chun-Hao Chang , George Alexandru Adam , Anna Goldenberg

In prediction tasks, there exist features that are related to the label in the same way across different settings for that task; these are semantic features or semantics. Features with varying relationships to the label are nuisances. For…

Machine Learning · Computer Science 2024-07-04 Aahlad Puli , Nitish Joshi , Yoav Wald , He He , Rajesh Ranganath

Natural language understanding (NLU) models tend to rely on spurious correlations (i.e., dataset bias) to achieve high performance on in-distribution datasets but poor performance on out-of-distribution ones. Most of the existing debiasing…

Computation and Language · Computer Science 2022-09-14 Shihan Dou , Rui Zheng , Ting Wu , SongYang Gao , Junjie Shan , Qi Zhang , Yueming Wu , Xuanjing Huang

Designing robust algorithms capable of training accurate neural networks on uncurated datasets from the web has been the subject of much research as it reduces the need for time consuming human labor. The focus of many previous research…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Paul Albert , Eric Arazo , Tarun Krishna , Noel E. O'Connor , Kevin McGuinness

Often machine learning models tend to automatically learn associations present in the training data without questioning their validity or appropriateness. This undesirable property is the root cause of the manifestation of spurious…

Machine Learning · Computer Science 2023-11-17 Preetam Prabhu Srikar Dammu , Chirag Shah

Neural networks are known to use spurious correlations such as background information for classification. While prior work has looked at spurious correlations that are widespread in the training data, in this work, we investigate how…

Machine Learning · Computer Science 2022-10-06 Yao-Yuan Yang , Chi-Ning Chou , Kamalika Chaudhuri

Spurious correlations are everywhere. While humans often do not perceive them, neural networks are notorious for learning unwanted associations, also known as biases, instead of the underlying decision rule. As a result, practitioners are…

Machine Learning · Computer Science 2023-06-01 Moritz Vandenhirtz , Laura Manduchi , Ričards Marcinkevičs , Julia E. Vogt

Deep learning models often achieve high performance by inadvertently learning spurious correlations between targets and non-essential features. For example, an image classifier may identify an object via its background that spuriously…

Machine Learning · Computer Science 2025-06-19 Guangtao Zheng , Wenqian Ye , Aidong Zhang

Deep learning has seen widespread success in various domains such as science, industry, and society. However, it is acknowledged that certain approaches suffer from non-robustness, relying on spurious correlations for predictions.…

Machine Learning · Computer Science 2025-05-22 Xiaoling Zhou , Wei Ye , Rui Xie , Shikun Zhang

Recently, NLP models have achieved remarkable progress across a variety of tasks; however, they have also been criticized for being not robust. Many robustness problems can be attributed to models exploiting spurious correlations, or…

Computation and Language · Computer Science 2022-05-26 Tianlu Wang , Rohit Sridhar , Diyi Yang , Xuezhi Wang