English
Related papers

Related papers: Expanding Expressivity in Transformer Models with …

200 papers

Since their introduction the Trasformer architectures emerged as the dominating architectures for both natural language processing and, more recently, computer vision applications. An intrinsic limitation of this family of "fully-attentive"…

Machine Learning · Computer Science 2023-03-16 Carmelo Scribano , Giorgia Franchini , Marco Prato , Marko Bertogna

Attention layers are widely used in natural language processing (NLP) and are beginning to influence computer vision architectures. Training very large transformer models allowed significant improvement in both fields, but once trained,…

Machine Learning · Computer Science 2021-05-21 Jean-Baptiste Cordonnier , Andreas Loukas , Martin Jaggi

Object Detection with Transformers (DETR) and related works reach or even surpass the highly-optimized Faster-RCNN baseline with self-attention network architectures. Inspired by the evidence that pure self-attention possesses a strong…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Wenchi Ma , Tianxiao Zhang , Guanghui Wang

Attention mechanisms in deep neural networks have achieved excellent performance on sequence-prediction tasks. Here, we show that these recently-proposed attention-based mechanisms---in particular, the Transformer with its parallelizable…

Machine Learning · Computer Science 2019-07-10 Zhengxuan Wu , Xiyu Zhang , Tan Zhi-Xuan , Jamil Zaki , Desmond C. Ong

Transformer models achieve state-of-the-art performance on a wide range of NLP tasks. They however suffer from a prohibitive limitation due to the self-attention mechanism, inducing $O(n^2)$ complexity with regard to sequence length. To…

Computation and Language · Computer Science 2022-10-28 Charles Condevaux , Sébastien Harispe

We incorporate Tensor-Product Representations within the Transformer in order to better support the explicit representation of relation structure. Our Tensor-Product Transformer (TP-Transformer) sets a new state of the art on the…

Machine Learning · Computer Science 2020-11-05 Imanol Schlag , Paul Smolensky , Roland Fernandez , Nebojsa Jojic , Jürgen Schmidhuber , Jianfeng Gao

Standard inference and training with transformer based architectures scale quadratically with input sequence length. This is prohibitively large for a variety of applications especially in web-page translation, query-answering etc.…

Computation and Language · Computer Science 2023-03-20 Lovish Madaan , Srinadh Bhojanapalli , Himanshu Jain , Prateek Jain

This research endeavors to offer insights into unlocking the further potential of transformer-based architectures. One of the primary motivations is to offer a geometric interpretation for the attention mechanism in transformers. In our…

Machine Learning · Computer Science 2025-12-16 Zhongping Ji

Large Language Models (LLMs) have achieved impressive performance across diverse tasks but continue to struggle with learning transitive relations, a cornerstone for complex planning. To address this issue, we investigate the Multi-Token…

Artificial Intelligence · Computer Science 2025-09-30 Qimin Zhong , Hao Liao , Siwei Wang , Mingyang Zhou , Xiaoqun Wu , Rui Mao , Wei Chen

Transformers have emerged as the architecture of choice for many state-of-the-art AI models, showcasing exceptional performance across a wide range of AI applications. However, the memory demands imposed by Transformers limit their ability…

Computation and Language · Computer Science 2023-11-28 Hao Liu , Matei Zaharia , Pieter Abbeel

Recent work on Transformer-based large language models (LLMs) has revealed striking limits in their working memory capacity, similar to what has been found in human behavioral studies. Specifically, these models' performance drops…

Computation and Language · Computer Science 2024-11-19 Dongyu Gong , Hantao Zhang

Variants dropout methods have been designed for the fully-connected layer, convolutional layer and recurrent layer in neural networks, and shown to be effective to avoid overfitting. As an appealing alternative to recurrent and…

Computation and Language · Computer Science 2019-07-29 Lin Zehui , Pengfei Liu , Luyao Huang , Junkun Chen , Xipeng Qiu , Xuanjing Huang

\textit{Attention} computes the dependency between representations, and it encourages the model to focus on the important selective features. Attention-based models, such as Transformer and graph attention network (GAT), are widely utilized…

Machine Learning · Computer Science 2021-03-02 Kyungwoo Song , Yohan Jung , Dongjun Kim , Il-Chul Moon

This work introduces an efficient method to scale Transformer-based Large Language Models (LLMs) to infinitely long inputs with bounded memory and computation. A key component in our proposed approach is a new attention technique dubbed…

Computation and Language · Computer Science 2024-08-13 Tsendsuren Munkhdalai , Manaal Faruqui , Siddharth Gopal

Over the past decade, Deep Convolutional Neural Networks have been widely adopted for medical image segmentation and shown to achieve adequate performance. However, due to the inherent inductive biases present in the convolutional…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Jeya Maria Jose Valanarasu , Poojan Oza , Ilker Hacihaliloglu , Vishal M. Patel

This document provides a brief introduction to the attention mechanism used in modern language models based on the Transformer architecture. We first illustrate how text is encoded as vectors and how the attention mechanism processes these…

Numerical Analysis · Mathematics 2026-04-02 Michel Fabrice Serret

Attention mechanism is one of the most successful techniques in deep learning based Natural Language Processing (NLP). The transformer network architecture is completely based on attention mechanisms, and it outperforms sequence-to-sequence…

Audio and Speech Processing · Electrical Eng. & Systems 2020-06-30 Sevinj Yolchuyeva , Géza Németh , Bálint Gyires-Tóth

Transformers are increasingly dominating multi-modal reasoning tasks, such as visual question answering, achieving state-of-the-art results thanks to their ability to contextualize information using the self-attention and co-attention…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Hila Chefer , Shir Gur , Lior Wolf

Transformer architectures, underpinned by the self-attention mechanism, have achieved state-of-the-art results across numerous natural language processing (NLP) tasks by effectively modeling long-range dependencies. However, the…

Machine Learning · Computer Science 2025-04-15 Andrew Kiruluta , Priscilla Burity , Samantha Williams

Transformers and large language models (LLMs) have revolutionized machine learning, with attention mechanisms at the core of their success. As the landscape of attention variants expands, so too do the challenges of optimizing their…

Computation and Language · Computer Science 2025-02-24 Feiyang Chen , Yu Cheng , Lei Wang , Yuqing Xia , Ziming Miao , Lingxiao Ma , Fan Yang , Jilong Xue , Zhi Yang , Mao Yang , Haibo Chen