English
Related papers

Related papers: Attention cannot be an Explanation

200 papers

Neural network architectures in natural language processing often use attention mechanisms to produce probability distributions over input token representations. Attention has empirically been demonstrated to improve performance in various…

Computation and Language · Computer Science 2021-05-10 George Chrysostomou , Nikolaos Aletras

Sparse attention has been claimed to increase model interpretability under the assumption that it highlights influential inputs. Yet the attention distribution is typically over representations internal to the model rather than the inputs…

Computation and Language · Computer Science 2021-06-09 Clara Meister , Stefan Lazov , Isabelle Augenstein , Ryan Cotterell

We consider the problem of visually explaining similarity models, i.e., explaining why a model predicts two images to be similar in addition to producing a scalar score. While much recent work in visual model interpretability has focused on…

Computer Vision and Pattern Recognition · Computer Science 2020-10-15 Meng Zheng , Srikrishna Karanam , Terrence Chen , Richard J. Radke , Ziyan Wu

Attention maps in neural models for NLP are appealing to explain the decision made by a model, hopefully emphasizing words that justify the decision. While many empirical studies hint that attention maps can provide such justification from…

Computation and Language · Computer Science 2025-01-24 Duc Hau Nguyen , Duc Hau Nguyen , Pascale Sébillot

Research in interpretable machine learning proposes different computational and human subject approaches to evaluate model saliency explanations. These approaches measure different qualities of explanations to achieve diverse goals in…

Human-Computer Interaction · Computer Science 2020-06-30 Sina Mohseni , Jeremy E. Block , Eric D. Ragan

This paper explores the much discussed, possible explanatory link between attention weights (AW) in transformer models and predicted output. Contrary to intuition and early research on attention, more recent prior research has provided…

Computation and Language · Computer Science 2024-10-25 Omar Naim , Nicholas Asher

Compared with only pursuing recommendation accuracy, the explainability of a recommendation model has drawn more attention in recent years. Many graph-based recommendations resort to informative paths with the attention mechanism for the…

Information Retrieval · Computer Science 2024-03-05 Yicong Li , Xiangguo Sun , Hongxu Chen , Sixiao Zhang , Yu Yang , Guandong Xu

The attention layer in a neural network model provides insights into the model's reasoning behind its prediction, which are usually criticized for being opaque. Recently, seemingly contradictory viewpoints have emerged about the…

Computation and Language · Computer Science 2019-09-26 Shikhar Vashishth , Shyam Upadhyay , Gaurav Singh Tomar , Manaal Faruqui

A popular approach to unveiling the black box of neural NLP models is to leverage saliency methods, which assign scalar importance scores to each input component. A common practice for evaluating whether an interpretability method is…

Computation and Language · Computer Science 2023-05-12 Josip Jukić , Martin Tutek , Jan Šnajder

Transformers are widely used in natural language processing, where they consistently achieve state-of-the-art performance. This is mainly due to their attention-based architecture, which allows them to model rich linguistic relations…

Computation and Language · Computer Science 2022-11-29 Nikolaos Mylonas , Ioannis Mollas , Grigorios Tsoumakas

In recent years, deep saliency models have made significant progress in predicting human visual attention. However, the mechanisms behind their success remain largely unexplained due to the opaque nature of deep neural networks. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Shi Chen , Ming Jiang , Qi Zhao

The attention mechanism lies at the core of the transformer architecture, providing an interpretable model-internal signal that has motivated a growing interest in attention-based model explanations. Although attention weights do not…

Machine Learning · Computer Science 2025-08-13 Marte Eggen , Jacob Lysnæs-Larsen , Inga Strümke

Explainability is key to enhancing artificial intelligence's trustworthiness in medicine. However, several issues remain concerning the actual benefit of explainable models for clinical decision-making. Firstly, there is a lack of consensus…

Image and Video Processing · Electrical Eng. & Systems 2023-12-18 Kazuma Kobayashi , Yasuyuki Takamizawa , Mototaka Miyake , Sono Ito , Lin Gu , Tatsuya Nakatsuka , Yu Akagi , Tatsuya Harada , Yukihide Kanemitsu , Ryuji Hamamoto

Understanding and explaining deep learning models is an imperative task. Towards this, we propose a method that obtains gradient-based certainty estimates that also provide visual attention maps. Particularly, we solve for visual question…

Computer Vision and Pattern Recognition · Computer Science 2020-02-25 Badri N. Patro , Mayank Lunayach , Vinay P. Namboodiri

In this work, we present the first general logic of attention. Attention is a powerful cognitive ability that allows agents to focus on potentially complex information, such as logically structured propositions, higher-order beliefs, or…

Artificial Intelligence · Computer Science 2025-05-21 Gaia Belardinelli , Thomas Bolander , Sebastian Watzl

Explaining and interpreting the decisions of recommender systems are becoming extremely relevant both, for improving predictive performance, and providing valid explanations to users. While most of the recent interest has focused on…

Information Retrieval · Computer Science 2019-06-19 Rishabh Jain , Pranava Madhyastha

We propose a graph-oriented attention-based explainability method for tabular data. Tasks involving tabular data have been solved mostly using traditional tree-based machine learning models which have the challenges of feature selection and…

Machine Learning · Computer Science 2024-06-05 Andrea Treviño Gavito , Diego Klabjan , Jean Utke

Understanding and explaining deep learning models is an imperative task. Towards this, we propose a method that obtains gradient-based certainty estimates that also provide visual attention maps. Particularly, we solve for visual question…

Computer Vision and Pattern Recognition · Computer Science 2019-10-18 Badri N. Patro , Mayank Lunayach , Shivansh Patel , Vinay P. Namboodiri

In recent years, considerable work has been devoted to explaining predictive, deep learning-based models, and in turn how to evaluate explanations. An important class of evaluation methods are ones that are human-centered, which typically…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Yayan Zhao , Mingwei Li , Matthew Berger

Attention mechanism is effective in both focusing the deep learning models on relevant features and interpreting them. However, attentions may be unreliable since the networks that generate them are often trained in a weakly-supervised…

Machine Learning · Statistics 2020-06-11 Jay Heo , Hae Beom Lee , Saehoon Kim , Juho Lee , Kwang Joon Kim , Eunho Yang , Sung Ju Hwang