English
Related papers

Related papers: Mitigating Spurious Correlations via Disagreement …

200 papers

Deep learning models can perform well in complex medical imaging classification tasks, even when basing their conclusions on spurious correlations (i.e. confounders), should they be prevalent in the training dataset, rather than on the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Amar Kumar , Nima Fathi , Raghav Mehta , Brennan Nichyporuk , Jean-Pierre R. Falet , Sotirios Tsaftaris , Tal Arbel

Empirical risk minimization (ERM) is sensitive to spurious correlations in the training data, which poses a significant risk when deploying systems trained under this paradigm in high-stake applications. While the existing literature…

Machine Learning · Computer Science 2023-10-31 Christos Tsirigotis , Joao Monteiro , Pau Rodriguez , David Vazquez , Aaron Courville

Deep learning has seen widespread success in various domains such as science, industry, and society. However, it is acknowledged that certain approaches suffer from non-robustness, relying on spurious correlations for predictions.…

Machine Learning · Computer Science 2025-05-22 Xiaoling Zhou , Wei Ye , Rui Xie , Shikun Zhang

Classifiers trained with Empirical Risk Minimization (ERM) tend to rely on attributes that have high spurious correlation with the target. This can degrade the performance on underrepresented (or 'minority') groups that lack these…

Spurious correlations are brittle associations between certain attributes of inputs and target variables, such as the correlation between an image background and an object class. Deep image classifiers often leverage them for predictions,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Guangtao Zheng , Wenqian Ye , Aidong Zhang

We propose self-adaptive training---a new training algorithm that dynamically corrects problematic training labels by model predictions without incurring extra computational cost---to improve generalization of deep learning for potentially…

Machine Learning · Computer Science 2020-10-01 Lang Huang , Chao Zhang , Hongyang Zhang

In NLP, recent work has seen increased focus on spurious correlations between various features and labels in training data, and how these influence model behavior. However, the presence and effect of such correlations are typically examined…

Computation and Language · Computer Science 2023-06-06 Sofia Serrano , Jesse Dodge , Noah A. Smith

Learning contrastive representations from pairwise comparisons has achieved remarkable success in various fields, such as natural language processing, computer vision, and information retrieval. Collaborative filtering algorithms based on…

Information Retrieval · Computer Science 2023-08-01 Bin Liu , Qin Luo , Bang Wang

Recent research has revealed that deep neural networks often take dataset biases as a shortcut to make decisions rather than understand tasks, leading to failures in real-world applications. In this study, we focus on the spurious…

Computation and Language · Computer Science 2023-06-23 Yanrui Du , Jing Yan , Yan Chen , Jing Liu , Sendong Zhao , Qiaoqiao She , Hua Wu , Haifeng Wang , Bing Qin

Recommendation models trained on the user feedback collected from deployed recommendation systems are commonly biased. User feedback is considerably affected by the exposure mechanism, as users only provide feedback on the items exposed to…

Information Retrieval · Computer Science 2023-11-13 Hangtong Xu , Yuanbo Xu , Yongjian Yang , Fuzhen Zhuang , Hui Xiong

Recent studies highlight that deep learning models often learn spurious features mistakenly linked to labels, compromising their reliability in real-world scenarios where such correlations do not hold. Despite the increasing research…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Xiwei Xuan , Ziquan Deng , Hsuan-Tien Lin , Kwan-Liu Ma

Deep neural networks often learn and rely on spurious correlations, i.e., superficial associations between non-causal features and the targets. For instance, an image classifier may identify camels based on the desert backgrounds. While it…

Machine Learning · Computer Science 2025-07-22 Wenqian Ye , Guangtao Zheng , Aidong Zhang

Neural networks are prone to be biased towards spurious correlations between classes and latent attributes exhibited in a major portion of training data, which ruins their generalization capability. We propose a new method for training…

Machine Learning · Computer Science 2023-05-02 Nayeong Kim , Sehyun Hwang , Sungsoo Ahn , Jaesik Park , Suha Kwak

Learning invariant representations is an important requirement when training machine learning models that are driven by spurious correlations in the datasets. These spurious correlations, between input samples and the target labels, wrongly…

Machine Learning · Computer Science 2022-01-12 Vishnu Suresh Lokhande , Kihyuk Sohn , Jinsung Yoon , Madeleine Udell , Chen-Yu Lee , Tomas Pfister

Ranking samples by fine-grained estimates of spuriosity (the degree to which spurious cues are present) has recently been shown to significantly benefit bias mitigation, over the traditional binary biased-\textit{vs}-unbiased partitioning…

Machine Learning · Computer Science 2025-01-31 Adarsh Kappiyath , Abhra Chaudhuri , Ajay Jaiswal , Ziquan Liu , Yunpeng Li , Xiatian Zhu , Lu Yin

Deep learning models achieve strong performance across various domains but often rely on spurious correlations, making them vulnerable to distribution shifts. This issue is particularly severe in subpopulation shift scenarios, where models…

Machine Learning · Computer Science 2026-03-03 Subeen Park , Joowang Kim , Hakyung Lee , Sunjae Yoo , Kyungwoo Song

Spurious correlations, unstable statistical shortcuts a model can exploit, are expected to degrade performance out-of-distribution (OOD). However, across many popular OOD generalization benchmarks, vanilla empirical risk minimization (ERM)…

Machine Learning · Computer Science 2025-08-05 Olawale Salaudeen , Nicole Chiou , Shiny Weng , Sanmi Koyejo

Machine learning classification models trained with empirical risk minimization (ERM) often inadvertently rely on spurious correlations. When absent in the test data, these unintended associations between non-target attributes and target…

Machine Learning · Computer Science 2025-08-12 Ihab Asaad , Maha Shadaydeh , Joachim Denzler

Standard empirical risk minimization (ERM) models may prioritize learning spurious correlations between spurious features and true labels, leading to poor accuracy on groups where these correlations do not hold. Mitigating this issue often…

Machine Learning · Computer Science 2024-06-05 Yujin Han , Difan Zou

Selective labels occur when label observations are subject to a decision-making process; e.g., diagnoses that depend on the administration of laboratory tests. We study a clinically-inspired selective label problem called disparate…

Machine Learning · Computer Science 2024-06-28 Trenton Chang , Jenna Wiens