English
Related papers

Related papers: Breaking the Attention Bottleneck

200 papers

The attention model has become a standard component in neural machine translation (NMT) and it guides translation process by selectively focusing on parts of the source sentence when predicting each target word. However, we find that the…

Computation and Language · Computer Science 2017-08-31 Long Zhou , Jiajun Zhang , Chengqing Zong

The self-attention mechanism, a cornerstone of Transformer-based state-of-the-art deep learning architectures, is largely heuristic-driven and fundamentally challenging to interpret. Establishing a robust theoretical foundation to explain…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Laziz U. Abdullaev , Maksim Tkachenko , Tan M. Nguyen

In reading comprehension, generating sentence-level distractors is a significant task, which requires a deep understanding of the article and question. The traditional entity-centered methods can only generate word-level or phrase-level…

Computation and Language · Computer Science 2019-11-21 Xiaorui Zhou , Senlin Luo , Yunfang Wu

Attention is an increasingly popular mechanism used in a wide range of neural architectures. The mechanism itself has been realized in a variety of formats. However, because of the fast-paced advances in this domain, a systematic overview…

Computation and Language · Computer Science 2021-10-12 Andrea Galassi , Marco Lippi , Paolo Torroni

Recently, the Transformer model that is based solely on attention mechanisms, has advanced the state-of-the-art on various machine translation tasks. However, recent studies reveal that the lack of recurrence hinders its further improvement…

Computation and Language · Computer Science 2019-04-08 Jie Hao , Xing Wang , Baosong Yang , Longyue Wang , Jinfeng Zhang , Zhaopeng Tu

The attention mechanism is the primary component of the transformer architecture; it has led to significant advancements in deep learning spanning many domains and covering multiple tasks. In computer vision, the attention mechanism was…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Abdullah Nazhat Abdullah , Tarkan Aydin

The paradigm of Transformers using the self-attention mechanism has manifested its advantage in learning graph-structured data. Yet, Graph Transformers are capable of modeling full range dependencies but are often deficient in extracting…

Machine Learning · Computer Science 2024-09-11 Minhong Zhu , Zhenhao Zhao , Weiran Cai

The incredible success of transformers on sequence modeling tasks can be largely attributed to the self-attention mechanism, which allows information to be transferred between different parts of a sequence. Self-attention allows…

Machine Learning · Computer Science 2024-08-14 Eshaan Nichani , Alex Damian , Jason D. Lee

The quadratic computational complexity of softmax transformers has become a bottleneck in long-context scenarios. In contrast, linear attention model families provide a promising direction towards a more efficient sequential model. These…

Computation and Language · Computer Science 2026-02-04 Difan Deng , Andreas Bentzen Winje , Lukas Fehring , Marius Lindauer

Models based on the Transformer architecture have achieved better accuracy than the ones based on competing architectures for a large set of tasks. A unique feature of the Transformer is its universal application of a self-attention…

Machine Learning · Computer Science 2020-10-01 Nan Ding , Xinjie Fan , Zhenzhong Lan , Dale Schuurmans , Radu Soricut

In humans, Attention is a core property of all perceptual and cognitive operations. Given our limited ability to process competing sources, attention mechanisms select, modulate, and focus on the information most relevant to behavior. For…

Machine Learning · Computer Science 2021-04-01 Alana de Santana Correia , Esther Luna Colombini

Attention mechanisms have become a popular component in deep neural networks, yet there has been little examination of how different influencing factors and methods for computing attention from these factors affect performance. Toward a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Xizhou Zhu , Dazhi Cheng , Zheng Zhang , Stephen Lin , Jifeng Dai

Attention is a core component of transformer architecture, whether encoder-only, decoder-only, or encoder-decoder model. However, the standard softmax attention often produces noisy probability distribution, which can impair effective…

Computation and Language · Computer Science 2025-11-11 Dhananjay Ram , Wei Xia , Stefano Soatto

Attention layers are widely used in natural language processing (NLP) and are beginning to influence computer vision architectures. Training very large transformer models allowed significant improvement in both fields, but once trained,…

Machine Learning · Computer Science 2021-05-21 Jean-Baptiste Cordonnier , Andreas Loukas , Martin Jaggi

Attention mechanisms are ubiquitous components in neural architectures applied to natural language processing. In addition to yielding gains in predictive accuracy, attention weights are often claimed to confer interpretability, purportedly…

Computation and Language · Computer Science 2020-04-08 Danish Pruthi , Mansi Gupta , Bhuwan Dhingra , Graham Neubig , Zachary C. Lipton

Pretrained language models based on the transformer architecture have shown great success in NLP. Textual training data often comes from the web and is thus tagged with time-specific information, but most language models ignore this…

Computation and Language · Computer Science 2022-05-05 Guy D. Rosin , Kira Radinsky

Discovering new materials better suited to specific purposes is an important issue in improving the quality of human life. Here, a neural network that creates molecules that meet some desired conditions based on a deep understanding of…

Machine Learning · Computer Science 2022-02-15 Hyunseung Kim , Jonggeol Na , Won Bo Lee

Attention is a state of arousal capable of dealing with limited processing bottlenecks in human beings by focusing selectively on one piece of information while ignoring other perceptible information. For decades, concepts and functions of…

Machine Learning · Computer Science 2021-12-14 Alana Santana , Esther Colombini

Although deep neural networks generally have fixed network structures, the concept of dynamic mechanism has drawn more and more attention in recent years. Attention mechanisms compute input-dependent dynamic attention weights for…

Machine Learning · Computer Science 2019-12-03 Lanqing Xue , Xiaopeng Li , Nevin L. Zhang

Transformers have the representational capacity to simulate Massively Parallel Computation (MPC) algorithms, but they suffer from quadratic time complexity, which severely limits their scalability. We introduce an efficient attention…

Machine Learning · Computer Science 2025-09-12 Jingwen Liu , Hantao Yu , Clayton Sanford , Alexandr Andoni , Daniel Hsu
‹ Prev 1 3 4 5 6 7 10 Next ›