中文
相关论文

相关论文: An XAI-based Analysis of Shortcut Learning in Neur…

200 篇论文

Research in Explainable Artificial Intelligence (XAI) is increasing, aiming to make deep learning models more transparent. Most XAI methods focus on justifying the decisions made by Artificial Intelligence (AI) systems in security-relevant…

Instruction tuning on a mixture of tasks has improved zero-shot capabilities in natural language processing (NLP). Nevertheless, existing methods often learn features that exhibit correlations between instruction-formatted samples and…

计算与语言 · 计算机科学 2024-02-12 Lu Chen , Wei Huang , Ruqing Zhang , Wei Chen , Jiafeng Guo , Xueqi Cheng

Supervised learning methods have been found to exhibit inductive biases favoring simpler features. When such features are spuriously correlated with the label, this can result in suboptimal performance on minority subgroups. Despite the…

计算机视觉与模式识别 · 计算机科学 2024-06-28 Kimia Hamidieh , Haoran Zhang , Swami Sankaranarayanan , Marzyeh Ghassemi

The study of neural networks from the perspective of Fourier features has garnered significant attention. While existing analytical research suggests that neural networks tend to learn low-frequency features, a clear attribution method for…

机器学习 · 计算机科学 2025-07-16 Zechen Liu , Feiyang Zhang , Wei Song , Xiang Li , Wei Wei

Artificial neural networks (ANNs) have become an important tool for image classification with many applications in research and industry. However, it remains largely unknown how relevant image features are selected and how data properties…

计算机视觉与模式识别 · 计算机科学 2019-08-09 Marcell Wolnitza , Babette Dellen

Explainable AI (XAI) methods typically focus on identifying essential input features or more abstract concepts for tasks like image or text classification. However, for algorithmic tasks like combinatorial optimization, these concepts may…

机器学习 · 计算机科学 2024-12-30 Elad Shoham , Hadar Cohen , Khalil Wattad , Havana Rika , Dan Vilenchik

Recent research has revealed that machine learning models have a tendency to leverage spurious correlations that exist in the training set but may not hold true in general circumstances. For instance, a sentiment classifier may erroneously…

计算与语言 · 计算机科学 2024-02-06 Oscar Chew , Hsuan-Tien Lin , Kai-Wei Chang , Kuan-Hao Huang

Shortcut learning, i.e., a model's reliance on undesired features not directly relevant to the task, is a major challenge that severely limits the applications of machine learning algorithms, particularly when deploying them to assist in…

机器学习 · 计算机科学 2025-06-17 Lukas Kuhn , Sari Sadiya , Jorg Schlotterer , Florian Buettner , Christin Seifert , Gemma Roig

The inherent "black box" nature of deep neural networks (DNNs) compromises their transparency and reliability. Recently, explainable AI (XAI) has garnered increasing attention from researchers. Several perturbation-based interpretations…

计算机视觉与模式识别 · 计算机科学 2024-08-27 Xuran Hu , Mingzhe Zhu , Zhenpeng Feng , Miloš Daković , Ljubiša Stanković

The hypothesis that Convolutional Neural Networks (CNNs) are inherently texture-biased has shaped much of the discourse on feature use in deep learning. We revisit this hypothesis by examining limitations in the cue-conflict experiment by…

计算机视觉与模式识别 · 计算机科学 2026-01-12 Tom Burgert , Oliver Stoll , Paolo Rota , Begüm Demir

Explainable artificial intelligence (XAI) aims to provide human-interpretable insights into the behavior of deep neural networks (DNNs), typically by estimating a simplified causal structure of the model. In existing work, this causal…

计算机视觉与模式识别 · 计算机科学 2026-03-11 Robin Hesse , Simone Schaub-Meyer , Janina Hesse , Bernt Schiele , Stefan Roth

Deep-learning models can extract a rich assortment of features from data. Which features a model uses depends not only on \emph{predictivity} -- how reliably a feature indicates training-set labels -- but also on \emph{availability} -- how…

机器学习 · 计算机科学 2024-07-15 Katherine L. Hermann , Hossein Mobahi , Thomas Fel , Michael C. Mozer

Continual Learning (CL) is the research field addressing learning without forgetting when the data distribution is not static. This paper studies spurious features' influence on continual learning algorithms. We show that continual learning…

机器学习 · 计算机科学 2022-05-27 Timothée Lesort

Recent work has investigated the vulnerability of local surrogate methods to adversarial perturbations on a machine learning (ML) model's inputs, where the explanation is manipulated while the meaning and structure of the original input…

机器学习 · 计算机科学 2025-01-20 Christopher Burger , Charles Walter , Thai Le

Neural networks can fail when the data contains spurious correlations. To understand this phenomenon, researchers have proposed numerous spurious correlations benchmarks upon which to evaluate mitigation methods. However, we observe that…

机器学习 · 计算机科学 2024-09-09 Samuel J. Bell , Diane Bouchacourt , Levent Sagun

Machine learning (ML) is increasingly often used to inform high-stakes decisions. As complex ML models (e.g., deep neural networks) are often considered black boxes, a wealth of procedures has been developed to shed light on their inner…

机器学习 · 统计学 2023-06-23 Rick Wilming , Céline Budding , Klaus-Robert Müller , Stefan Haufe

We investigate enhancing the sensitivity of new physics searches at the LHC by machine learning in the case of background dominance and a high degree of overlap between the observables for signal and background. We use two different models,…

高能物理 - 唯象学 · 物理学 2023-07-10 Daniel Alvestad , Nikolai Fomin , Jörn Kersten , Steffen Maeland , Inga Strümke

The reliability of machine learning systems critically assumes that the associations between features and labels remain similar between training and test distributions. However, unmeasured variables, such as confounders, break this…

机器学习 · 计算机科学 2020-08-17 Megha Srivastava , Tatsunori Hashimoto , Percy Liang

Spurious correlations can cause strong biases in deep neural networks, impairing generalization ability. While most existing debiasing methods require full supervision on either spurious attributes or target labels, training a debiased…

机器学习 · 计算机科学 2023-10-10 Geon Yeong Park , Chanyong Jung , Sangmin Lee , Jong Chul Ye , Sang Wan Lee

The usage of convolutional neural networks (CNNs) for unsupervised image segmentation was investigated in this study. In the proposed approach, label prediction and network parameter learning are alternately iterated to meet the following…

计算机视觉与模式识别 · 计算机科学 2020-08-26 Wonjik Kim , Asako Kanezaki , Masayuki Tanaka