English
Related papers

Related papers: Attention cannot be an Explanation

200 papers

Human attention modelling has proven, in recent years, to be particularly useful not only for understanding the cognitive processes underlying visual exploration, but also for providing support to artificial intelligence models that aim to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Giuseppe Cartella , Marcella Cornia , Vittorio Cuculo , Alessandro D'Amelio , Dario Zanca , Giuseppe Boccignone , Rita Cucchiara

Attention plays a fundamental role in both natural and artificial intelligence systems. In deep learning, attention-based neural architectures, such as transformer architectures, are widely used to tackle problems in natural language…

Machine Learning · Computer Science 2022-02-18 Pierre Baldi , Roman Vershynin

Saliency maps are widely used for visual explanations in deep learning, but a fundamental lack of consensus persists regarding their intended purpose and alignment with diverse user queries. This ambiguity hinders the effective evaluation…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Yehonatan Elisha , Seffi Cohen , Oren Barkan , Noam Koenigstein

The apparent ``black box'' nature of neural networks is a barrier to adoption in applications where explainability is essential. This paper presents TAME (Trainable Attention Mechanism for Explanations), a method for generating explanation…

Computer Vision and Pattern Recognition · Computer Science 2025-01-30 Mariano Ntrougkas , Nikolaos Gkalelis , Vasileios Mezaris

Attention mechanisms are a central property of cognitive systems allowing them to selectively deploy cognitive resources in a flexible manner. Attention has been long studied in the neurosciences and there are numerous phenomenological…

Machine Learning · Computer Science 2023-04-11 Ryan Singh , Christopher L. Buckley

Attention maps, a popular heatmap-based explanation method for Visual Question Answering (VQA), are supposed to help users understand the model by highlighting portions of the image/question used by the model to infer answers. However, we…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Arijit Ray , Michael Cogswell , Xiao Lin , Kamran Alipour , Ajay Divakaran , Yi Yao , Giedrius Burachas

Transformer is a ubiquitous model for natural language processing and has attracted wide attentions in computer vision. The attention maps are indispensable for a transformer model to encode the dependencies among input tokens. However,…

Machine Learning · Computer Science 2021-02-26 Yujing Wang , Yaming Yang , Jiangang Bai , Mingliang Zhang , Jing Bai , Jing Yu , Ce Zhang , Gao Huang , Yunhai Tong

Self-attention model have shown its flexibility in parallel computation and the effectiveness on modeling both long- and short-term dependencies. However, it calculates the dependencies between representations without considering the…

Computation and Language · Computer Science 2019-02-18 Baosong Yang , Jian Li , Derek Wong , Lidia S. Chao , Xing Wang , Zhaopeng Tu

Deep Learning has become overly complicated and has enjoyed stellar success in solving several classical problems like image classification, object detection, etc. Several methods for explaining these decisions have been proposed. Black-box…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Siddhant Agarwal , Owais Iqbal , Sree Aditya Buridi , Madda Manjusha , Abir Das

Neural attention, especially the self-attention made popular by the Transformer, has become the workhorse of state-of-the-art natural language processing (NLP) models. Very recent work suggests that the self-attention in the Transformer…

Computation and Language · Computer Science 2020-10-16 Zhengxuan Wu , Thanh-Son Nguyen , Desmond C. Ong

Deep neural perception and control networks have become key components of self-driving vehicles. User acceptance is likely to benefit from easy-to-interpret textual explanations which allow end-users to understand what triggered a…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Jinkyu Kim , Anna Rohrbach , Trevor Darrell , John Canny , Zeynep Akata

A plethora of research in the literature shows how human eye fixation pattern varies depending on different factors, including genetics, age, social functioning, cognitive functioning, and so on. Analysis of these variations in visual…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Shafin Rahman , Sejuti Rahman , Omar Shahid , Md. Tahmeed Abdullah , Jubair Ahmed Sourov

The interest in complex deep neural networks for computer vision applications is increasing. This leads to the need for improving the interpretable capabilities of these models. Recent explanation methods present visualizations of the…

Machine Learning · Computer Science 2020-04-24 Dan Valle , Tiago Pimentel , Adriano Veloso

Lane change prediction of surrounding vehicles is a key building block of path planning. The focus has been on increasing the accuracy of prediction by posing it purely as a function estimation problem at the cost of model…

Computer Vision and Pattern Recognition · Computer Science 2019-03-08 Oliver Scheel , Naveen Shankar Nagaraja , Loren Schwarz , Nassir Navab , Federico Tombari

Natural Language Inference (NLI) models are known to learn from biases and artefacts within their training data, impacting how well they generalise to other unseen datasets. Existing de-biasing approaches focus on preventing the models from…

Computation and Language · Computer Science 2022-05-03 Joe Stacey , Yonatan Belinkov , Marek Rei

Of later years, numerous bottom-up attention models have been proposed on different assumptions. However, the produced saliency maps may be different from each other even from the same input image. We also observe that human fixation map…

Computer Vision and Pattern Recognition · Computer Science 2018-11-08 Jian Li

We present a novel visual attention tracking technique based on Shared Attention modeling. Our proposed method models the viewer as a participant in the activity occurring in the scene. We go beyond image salience and instead of only…

Computer Vision and Pattern Recognition · Computer Science 2016-09-02 Siavash Gorji , James J. Clark

Attention plays a critical role in human visual experience. Furthermore, it has recently been demonstrated that attention can also play an important role in the context of applying artificial neural networks to a variety of tasks from…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Sergey Zagoruyko , Nikos Komodakis

The attention mechanism is the computational core of modern Transformer architectures, but its quadratic complexity in the input sequence length is the bottleneck for large-scale inference. This has motivated a rapidly growing body of work…

Survey experiments are widely used to identify causal effects in political science and the social sciences. Yet researchers are typically interested in more than the internal validity of an experimentally induced contrast. They also want to…

Econometrics · Economics 2026-04-15 Jiawei Fu , Xiaojun Li