中文
相关论文

相关论文: An XAI-based Analysis of Shortcut Learning in Neur…

200 篇论文

Deep neural classifiers tend to rely on spurious correlations between spurious attributes of inputs and targets to make predictions, which could jeopardize their generalization capability. Training classifiers robust to spurious…

机器学习 · 计算机科学 2024-05-07 Guangtao Zheng , Wenqian Ye , Aidong Zhang

Deep learning models are known to overfit and memorize spurious features in the training dataset. While numerous empirical studies have aimed at understanding this phenomenon, a rigorous theoretical framework to quantify it is still…

机器学习 · 统计学 2024-05-20 Simone Bombari , Marco Mondelli

Spurious correlations are brittle associations between certain attributes of inputs and target variables, such as the correlation between an image background and an object class. Deep image classifiers often leverage them for predictions,…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Guangtao Zheng , Wenqian Ye , Aidong Zhang

Neural networks often learn to make predictions that overly rely on spurious correlation existing in the dataset, which causes the model to be biased. While previous work tackles this issue by using explicit labeling on the spuriously…

机器学习 · 计算机科学 2020-11-24 Junhyun Nam , Hyuntak Cha , Sungsoo Ahn , Jaeho Lee , Jinwoo Shin

Deep neural networks often develop spurious bias, reliance on correlations between non-essential features and classes for predictions. For example, a model may identify objects based on frequently co-occurring backgrounds rather than…

机器学习 · 计算机科学 2025-06-02 Guangtao Zheng , Wenqian Ye , Aidong Zhang

Natural language understanding (NLU) models tend to rely on spurious correlations (i.e., dataset bias) to achieve high performance on in-distribution datasets but poor performance on out-of-distribution ones. Most of the existing debiasing…

计算与语言 · 计算机科学 2022-09-14 Shihan Dou , Rui Zheng , Ting Wu , SongYang Gao , Junjie Shan , Qi Zhang , Yueming Wu , Xuanjing Huang

Spurious correlations occur when a model learns unreliable features from the data and are a well-known drawback of data-driven learning. Although there are several algorithms proposed to mitigate it, we are yet to jointly derive the…

机器学习 · 计算机科学 2023-08-23 Gautam Sreekumar , Vishnu Naresh Boddeti

Spurious correlations are everywhere. While humans often do not perceive them, neural networks are notorious for learning unwanted associations, also known as biases, instead of the underlying decision rule. As a result, practitioners are…

机器学习 · 计算机科学 2023-06-01 Moritz Vandenhirtz , Laura Manduchi , Ričards Marcinkevičs , Julia E. Vogt

We present a simple but effective method to measure and mitigate model biases caused by reliance on spurious cues. Instead of requiring costly changes to one's data or model training, our method better utilizes the data one already has by…

计算机视觉与模式识别 · 计算机科学 2023-11-01 Mazda Moayeri , Wenxiao Wang , Sahil Singla , Soheil Feizi

Shortcuts, spurious rules that perform well during training but fail to generalize, present a major challenge to the reliability of deep networks (Geirhos et al., 2020). However, the impact of shortcuts on feature representations remains…

机器学习 · 计算机科学 2025-11-06 Nikita Tsoy , Nikola Konstantinov

Deep classifiers are known to rely on spurious features $\unicode{x2013}$ patterns which are correlated with the target on the training data but not inherently relevant to the learning problem, such as the image backgrounds when classifying…

机器学习 · 计算机科学 2022-10-21 Pavel Izmailov , Polina Kirichenko , Nate Gruver , Andrew Gordon Wilson

For real-world applications of machine learning (ML), it is essential that models make predictions based on well-generalizing features rather than spurious correlations in the data. The identification of such spurious correlations, also…

机器学习 · 计算机科学 2023-07-24 Nicolas M. Müller , Simon Roschmann , Shahbaz Khan , Philip Sperl , Konstantin Böttinger

Deep neural networks may be susceptible to learning spurious correlations that hold on average but not in atypical test samples. As with the recent emergence of vision transformer (ViT) models, it remains underexplored how spurious…

计算机视觉与模式识别 · 计算机科学 2022-03-18 Soumya Suvra Ghosal , Yifei Ming , Yixuan Li

Explainable AI (XAI) methods focus on explaining what a neural network has learned - in other words, identifying the features that are the most influential to the prediction. In this paper, we call them "distinguishing features". However,…

计算机视觉与模式识别 · 计算机科学 2021-04-19 Kaili Wang , Jose Oramas , Tinne Tuytelaars

Recently, NLP models have achieved remarkable progress across a variety of tasks; however, they have also been criticized for being not robust. Many robustness problems can be attributed to models exploiting spurious correlations, or…

计算与语言 · 计算机科学 2022-05-26 Tianlu Wang , Rohit Sridhar , Diyi Yang , Xuezhi Wang

In NLP, recent work has seen increased focus on spurious correlations between various features and labels in training data, and how these influence model behavior. However, the presence and effect of such correlations are typically examined…

计算与语言 · 计算机科学 2023-06-06 Sofia Serrano , Jesse Dodge , Noah A. Smith

Neural networks often exhibit simplicity bias, favoring simpler features over more complex ones, even when both are equally predictive. We introduce a novel method called imbalanced label coupling to explore and extend this simplicity bias…

机器学习 · 计算机科学 2024-10-23 Zhehang Du

Explainable Artificial Intelligence (XAI) aims to make learning machines less opaque, and offers researchers and practitioners various tools to reveal the decision-making strategies of neural networks. In this work, we investigate how XAI…

机器学习 · 计算机科学 2023-11-15 Dennis Grinwald , Kirill Bykov , Shinichi Nakajima , Marina M. -C. Höhne

Predictive models -- learned from observational data not covering the complete data distribution -- can rely on spurious correlations in the data for making predictions. These correlations make the models brittle and hinder generalization.…

机器学习 · 计算机科学 2020-06-16 Khurram Javed , Martha White , Yoshua Bengio

The term `spurious correlations' has been used in NLP to informally denote any undesirable feature-label correlations. However, a correlation can be undesirable because (i) the feature is irrelevant to the label (e.g. punctuation in a…

计算与语言 · 计算机科学 2022-10-26 Nitish Joshi , Xiang Pan , He He