English
Related papers

Related papers: Not Only the Last-Layer Features for Spurious Corr…

200 papers

Deep learning models are known to overfit and memorize spurious features in the training dataset. While numerous empirical studies have aimed at understanding this phenomenon, a rigorous theoretical framework to quantify it is still…

Machine Learning · Statistics 2024-05-20 Simone Bombari , Marco Mondelli

Neural networks are prone to be biased towards spurious correlations between classes and latent attributes exhibited in a major portion of training data, which ruins their generalization capability. We propose a new method for training…

Machine Learning · Computer Science 2023-05-02 Nayeong Kim , Sehyun Hwang , Sungsoo Ahn , Jaesik Park , Suha Kwak

Neural networks often learn to make predictions that overly rely on spurious correlation existing in the dataset, which causes the model to be biased. While previous work tackles this issue by using explicit labeling on the spuriously…

Machine Learning · Computer Science 2020-11-24 Junhyun Nam , Hyuntak Cha , Sungsoo Ahn , Jaeho Lee , Jinwoo Shin

Deep learning has seen widespread success in various domains such as science, industry, and society. However, it is acknowledged that certain approaches suffer from non-robustness, relying on spurious correlations for predictions.…

Machine Learning · Computer Science 2025-05-22 Xiaoling Zhou , Wei Ye , Rui Xie , Shikun Zhang

Spurious correlation caused by subgroup underrepresentation has received increasing attention as a source of bias that can be perpetuated by deep neural networks (DNNs). Distributionally robust optimization has shown success in addressing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Nilesh Kumar , Ruby Shrestha , Zhiyuan Li , Linwei Wang

The paradigm of worst-group loss minimization has shown its promise in avoiding to learn spurious correlations, but requires costly additional supervision on spurious attributes. To resolve this, recent works focus on developing weaker…

Machine Learning · Computer Science 2022-04-06 Junhyun Nam , Jaehyung Kim , Jaeho Lee , Jinwoo Shin

Supervised and preference-based fine-tuning techniques have become popular for aligning large language models (LLMs) with user intent and correctness criteria. However, real-world training data often exhibits spurious correlations --…

Computation and Language · Computer Science 2025-05-12 Julia Shuieh , Prasann Singhal , Apaar Shanker , John Heyer , George Pu , Samuel Denton

Bias in classifiers is a severe issue of modern deep learning methods, especially for their application in safety- and security-critical areas. Often, the bias of a classifier is a direct consequence of a bias in the training dataset,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Christian Reimers , Paul Bodesheim , Jakob Runge , Joachim Denzler

Deep learning models can suffer from severe performance degradation when relying on spurious correlations between input features and labels, making the models perform well on training data but have poor prediction accuracy for minority…

Machine Learning · Computer Science 2025-02-17 Tao Wen , Zihan Wang , Quan Zhang , Qi Lei

Instance features in images exhibit spurious correlations with background features, affecting the training process of deep neural classifiers. This leads to insufficient attention to instance features by the classifier, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Xuewei Li , Zhenzhen Nie , Mei Yu , Zijian Zhang , Jie Gao , Tianyi Xu , Zhiqiang Liu

As the use of artificial intelligence rapidly increases, the development of trustworthy artificial intelligence has become important. However, recent studies have shown that deep neural networks are susceptible to learn spurious…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Yooshin Cho , Hanbyel Cho , Janghyeon Lee , HyeongGwon Hong , Jaesung Ahn , Junmo Kim

Deep neural networks often develop spurious bias, reliance on correlations between non-essential features and classes for predictions. For example, a model may identify objects based on frequently co-occurring backgrounds rather than…

Machine Learning · Computer Science 2025-06-02 Guangtao Zheng , Wenqian Ye , Aidong Zhang

It is well-known that training neural networks for image classification with empirical risk minimization (ERM) makes them vulnerable to relying on spurious attributes instead of causal ones for prediction. Previously, deep feature…

Predictive models -- learned from observational data not covering the complete data distribution -- can rely on spurious correlations in the data for making predictions. These correlations make the models brittle and hinder generalization.…

Machine Learning · Computer Science 2020-06-16 Khurram Javed , Martha White , Yoshua Bengio

We consider the problem of the extraction of semantic attributes, supervised only with classification labels. For example, when learning to classify images of birds into species, we would like to observe the emergence of features that…

Machine Learning · Computer Science 2021-06-14 Ameen Ali , Tomer Galanti , Evgeniy Zheltonozhskiy , Chaim Baskin , Lior Wolf

Learning invariant representations is an important requirement when training machine learning models that are driven by spurious correlations in the datasets. These spurious correlations, between input samples and the target labels, wrongly…

Machine Learning · Computer Science 2022-01-12 Vishnu Suresh Lokhande , Kihyuk Sohn , Jinsung Yoon , Madeleine Udell , Chen-Yu Lee , Tomas Pfister

While deep neural networks can achieve state-of-the-art performance in many tasks, these models are more fragile than they appear. They are prone to learning spurious correlations in their training data, leading to surprising failure cases.…

Machine Learning · Computer Science 2024-09-05 Jeff Mitchell , Jesús Martínez del Rincón , Niall McLaughlin

Modern NLP models are often trained over large untrusted datasets, raising the potential for a malicious adversary to compromise model behaviour. For instance, backdoors can be implanted through crafting training instances with a specific…

Computation and Language · Computer Science 2023-10-23 Xuanli He , Qiongkai Xu , Jun Wang , Benjamin Rubinstein , Trevor Cohn

Dataset bias is a critical challenge in machine learning since it often leads to a negative impact on a model due to the unintended decision rules captured by spurious correlations. Although existing works often handle this issue based on…

Machine Learning · Computer Science 2022-04-05 Seonguk Seo , Joon-Young Lee , Bohyung Han

Recent research has revealed that deep neural networks often take dataset biases as a shortcut to make decisions rather than understand tasks, leading to failures in real-world applications. In this study, we focus on the spurious…

Computation and Language · Computer Science 2023-06-23 Yanrui Du , Jing Yan , Yan Chen , Jing Liu , Sendong Zhao , Qiaoqiao She , Hua Wu , Haifeng Wang , Bing Qin