English
Related papers

Related papers: Do Attention Heads Compete or Cooperate during Cou…

200 papers

There is a growing interest in the ability of neural networks to execute algorithmic tasks (e.g., arithmetic, summary statistics, and sorting). The goal of this work is to better understand the role of attention in Transformers for…

Machine Learning · Computer Science 2025-06-11 Artur Back de Luca , George Giapitzakis , Shenghao Yang , Petar Veličković , Kimon Fountoulakis

The multi-head self-attention mechanism of the transformer model has been thoroughly investigated recently. In one vein of study, researchers are interested in understanding why and how transformers work. In another vein, researchers…

Computation and Language · Computer Science 2022-10-28 Raymond Li , Wen Xiao , Linzi Xing , Lanjun Wang , Gabriel Murray , Giuseppe Carenini

Attention is a cornerstone of human cognition that facilitates the efficient extraction of information in everyday life. Recent developments in artificial intelligence like the Transformer architecture also incorporate the idea of attention…

Other Quantitative Biology · Quantitative Biology 2024-07-03 Minglu Zhao , Dehong Xu , Tao Gao

The transformer architecture is central to the success of modern Large Language Models (LLMs), in part due to its surprising ability to perform a wide range of tasks - including mathematical reasoning, memorization, and retrieval - using…

Machine Learning · Computer Science 2025-09-05 Yihe Dong , Lorenzo Noci , Mikhail Khodak , Mufan Li

The notion that cooperation can aid a group of agents to solve problems more efficiently than if those agents worked in isolation is prevalent, despite the little quantitative groundwork to support it. Here we consider a primordial form of…

Adaptation and Self-Organizing Systems · Physics 2014-10-22 José F. Fontanari

Attention mechanisms in deep learning architectures have often been used as a means of transparency and, as such, to shed light on the inner workings of the architectures. Recently, there has been a growing interest in whether or not this…

Computation and Language · Computer Science 2019-11-12 Joris Baan , Maartje ter Hoeve , Marlies van der Wees , Anne Schuth , Maarten de Rijke

Attention-based architectures have become ubiquitous in machine learning, yet our understanding of the reasons for their effectiveness remains limited. This work proposes a new way to understand self-attention networks: we show that their…

Machine Learning · Computer Science 2023-08-02 Yihe Dong , Jean-Baptiste Cordonnier , Andreas Loukas

Attention is a key component of Transformers, which have recently achieved considerable success in natural language processing. Hence, attention is being extensively studied to investigate various linguistic capabilities of Transformers,…

Computation and Language · Computer Science 2020-10-07 Goro Kobayashi , Tatsuki Kuribayashi , Sho Yokoi , Kentaro Inui

Multi-task indoor scene understanding is widely considered as an intriguing formulation, as the affinity of different tasks may lead to improved performance. In this paper, we tackle the new problem of joint semantic, affordance and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Xiaoxue Chen , Tianyu Liu , Hao Zhao , Guyue Zhou , Ya-Qin Zhang

Attention mechanisms have seen some success for natural language processing downstream tasks in recent years and generated new State-of-the-Art results. A thorough evaluation of the attention mechanism for the task of Argumentation Mining…

Computation and Language · Computer Science 2019-06-25 Maximilian Spliethöver , Jonas Klaff , Hendrik Heuer

Multi-head attention plays a crucial role in the recent success of Transformer models, which leads to consistent performance improvements over conventional attention in various applications. The popular belief is that this effectiveness…

Computation and Language · Computer Science 2021-06-18 Liyuan Liu , Jialu Liu , Jiawei Han

We study transformer language models, analyzing attention heads whose attention patterns are spread out, and whose attention scores depend weakly on content. We argue that the softmax denominators of these heads are stable when the…

Computation and Language · Computer Science 2025-10-07 Alex Gibson

State-of-the-art transformer models use pairwise dot-product based self-attention, which comes at a computational cost quadratic in the input sequence length. In this paper, we investigate the global structure of attention scores computed…

Machine Learning · Computer Science 2021-06-17 Srinadh Bhojanapalli , Ayan Chakrabarti , Himanshu Jain , Sanjiv Kumar , Michal Lukasik , Andreas Veit

Multi-task learning with transformer encoders (MTL) has emerged as a powerful technique to improve performance on closely-related tasks for both accuracy and efficiency while a question still remains whether or not it would perform as well…

Computation and Language · Computer Science 2021-09-16 Han He , Jinho D. Choi

Label aggregation such as majority voting is commonly used to resolve annotator disagreement in dataset creation. However, this may disregard minority values and opinions. Recent studies indicate that learning from individual annotations…

Computation and Language · Computer Science 2023-10-24 Xinpeng Wang , Barbara Plank

Multi-head attention has each of the attention heads collect salient information from different parts of an input sequence, making it a powerful mechanism for sequence modeling. Multilingual and multi-domain learning are common scenarios…

Computation and Language · Computer Science 2021-06-22 Hongyu Gong , Yun Tang , Juan Pino , Xian Li

In this paper, we investigate the role of attention heads in Context-aware Machine Translation models for pronoun disambiguation in the English-to-German and English-to-French language directions. We analyze their influence by both…

Computation and Language · Computer Science 2024-12-17 Paweł Mąka , Yusuf Can Semerci , Jan Scholtes , Gerasimos Spanakis

We investigate in-context temporal biases in attention heads and transformer outputs. Using cognitive science methodologies, we analyze attention scores and outputs of the GPT-2 models of varying sizes. Across attention heads, we observe…

Machine Learning · Computer Science 2025-02-12 Deven Mahesh Mistry , Anooshka Bajaj , Yash Aggarwal , Sahaj Singh Maini , Zoran Tiganj

Attention-based mechanisms are widely used in machine learning, most prominently in transformers. However, hyperparameters such as the rank of the attention matrices and the number of heads are scaled nearly the same way in all realizations…

Machine Learning · Computer Science 2024-07-24 Noah Amsel , Gilad Yehudai , Joan Bruna

Attention is a very efficient way to model the relationship between two sequences by comparing how similar two intermediate representations are. Initially demonstrated in NMT, it is a standard in all NLU tasks today when efficient…

Computation and Language · Computer Science 2019-06-24 Rajarshee Mitra