English
Related papers

Related papers: Spuriousness-Aware Meta-Learning for Learning Robu…

200 papers

Deep neural networks can be unreliable in the real world especially when they heavily use {\it spurious} features for their predictions. Focusing on image classifications, we define {\it core features} as the set of visual features that are…

Machine Learning · Computer Science 2022-03-29 Sahil Singla , Soheil Feizi

We propose a method for generating spurious features by leveraging large-scale text-to-image diffusion models. Although the previous work detects spurious features in a large-scale dataset like ImageNet and introduces Spurious ImageNet, we…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 AprilPyone MaungMaung , Huy H. Nguyen , Hitoshi Kiya , Isao Echizen

Deep neural networks have exhibited remarkable performance in various domains. However, the reliance of these models on spurious features has raised concerns about their reliability. A promising solution to this problem is last-layer…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Mohammad Azizmalayeri , Reza Abbasi , Amir Hosein Haji Mohammad rezaie , Reihaneh Zohrabi , Mahdi Amiri , Mohammad Taghi Manzuri , Mohammad Hossein Rohban

Current methods for detecting spurious correlations rely on analyzing dataset statistics or error patterns, leaving many harmful shortcuts invisible when counterexamples are absent. We introduce BEE (Bridging Explainability and Embeddings),…

Artificial Intelligence · Computer Science 2026-02-12 Cristian Daniel Păduraru , Antonio Bărbălau , Radu Filipescu , Andrei Liviu Nicolicioiu , Elena Burceanu

Spurious correlations are everywhere. While humans often do not perceive them, neural networks are notorious for learning unwanted associations, also known as biases, instead of the underlying decision rule. As a result, practitioners are…

Machine Learning · Computer Science 2023-06-01 Moritz Vandenhirtz , Laura Manduchi , Ričards Marcinkevičs , Julia E. Vogt

Spurious correlations in real-world datasets cause machine learning models to rely on irrelevant patterns, undermining reliability, generalization, and fairness. Active learning offers a promising way to address this failure mode by…

Machine Learning · Computer Science 2026-05-21 Kin Whye Chew , Jingxian Wang

Recent research has revealed that deep neural networks often take dataset biases as a shortcut to make decisions rather than understand tasks, leading to failures in real-world applications. In this study, we focus on the spurious…

Computation and Language · Computer Science 2023-06-23 Yanrui Du , Jing Yan , Yan Chen , Jing Liu , Sendong Zhao , Qiaoqiao She , Hua Wu , Haifeng Wang , Bing Qin

Learning representations unaffected by superficial characteristics is important to ensure that shifts in these characteristics at test time do not compromise downstream prediction performance. For instance, in healthcare applications, we…

Machine Learning · Computer Science 2025-07-28 Minghui Sun , Benjamin A. Goldstein , Matthew M. Engelhard

Prompt tuning of Vision-Language Models (VLMs) such as CLIP, has demonstrated the ability to rapidly adapt to various downstream tasks. However, recent studies indicate that tuned VLMs may suffer from the problem of spurious correlations,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Chaoquan Jiang , Yunfan Yang , Rui Hu , Jitao Sang

Neural networks have revolutionized numerous fields, yet they remain vulnerable to a critical flaw: the tendency to learn implicit biases, spurious correlations between certain attributes and target labels in training data. These biases are…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Piyush Arora , Navlika Singh , Vasubhya Diwan , Pratik Mazumder

Predictive uncertainty-a model's self awareness regarding its accuracy on an input-is key for both building robust models via training interventions and for test-time applications such as selective classification. We propose a novel…

Machine Learning · Computer Science 2024-01-04 Nishant Jain , Karthikeyan Shanmugam , Pradeep Shenoy

Recent work has shown evidence of 'Clever Hans' behavior in high-performance neural translationese classifiers, where BERT-based classifiers capitalize on spurious correlations, in particular topic information, between data and target…

Computation and Language · Computer Science 2024-06-13 Angana Borah , Daria Pylypenko , Cristina Espana-Bonet , Josef van Genabith

State-of-the art vision models can achieve superhuman performance on image classification tasks when testing and training data come from the same distribution. However, when models are tested on corrupted images (e.g. due to scale changes,…

Machine Learning · Computer Science 2019-06-11 Luke Metz , Niru Maheswaranathan , Jonathon Shlens , Jascha Sohl-Dickstein , Ekin D. Cubuk

Deep neural networks often learn and rely on spurious correlations, i.e., superficial associations between non-causal features and the targets. For instance, an image classifier may identify camels based on the desert backgrounds. While it…

Machine Learning · Computer Science 2025-07-22 Wenqian Ye , Guangtao Zheng , Aidong Zhang

Deep learning models are known to overfit and memorize spurious features in the training dataset. While numerous empirical studies have aimed at understanding this phenomenon, a rigorous theoretical framework to quantify it is still…

Machine Learning · Statistics 2024-05-20 Simone Bombari , Marco Mondelli

Instruction tuning on a mixture of tasks has improved zero-shot capabilities in natural language processing (NLP). Nevertheless, existing methods often learn features that exhibit correlations between instruction-formatted samples and…

Computation and Language · Computer Science 2024-02-12 Lu Chen , Wei Huang , Ruqing Zhang , Wei Chen , Jiafeng Guo , Xueqi Cheng

Recently, NLP models have achieved remarkable progress across a variety of tasks; however, they have also been criticized for being not robust. Many robustness problems can be attributed to models exploiting spurious correlations, or…

Computation and Language · Computer Science 2022-05-26 Tianlu Wang , Rohit Sridhar , Diyi Yang , Xuezhi Wang

Deep learning models achieve strong performance across various domains but often rely on spurious correlations, making them vulnerable to distribution shifts. This issue is particularly severe in subpopulation shift scenarios, where models…

Machine Learning · Computer Science 2026-03-03 Subeen Park , Joowang Kim , Hakyung Lee , Sunjae Yoo , Kyungwoo Song

Deep neural networks may be susceptible to learning spurious correlations that hold on average but not in atypical test samples. As with the recent emergence of vision transformer (ViT) models, it remains underexplored how spurious…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Soumya Suvra Ghosal , Yifei Ming , Yixuan Li

Cross-modal retrieval methods are the preferred tool to search databases for the text that best matches a query image and vice versa. However, image-text retrieval models commonly learn to memorize spurious correlations in the training…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Jae Myung Kim , A. Sophia Koepke , Cordelia Schmid , Zeynep Akata