English
Related papers

Related papers: Modeling Recurrence for Transformer

200 papers

Document-level Neural Machine Translation (DocNMT) has been proven crucial for handling discourse phenomena by introducing document-level context information. One of the most important directions is to input the whole document directly to…

Computation and Language · Computer Science 2023-09-26 Zihan Liu , Zewei Sun , Shanbo Cheng , Shujian Huang , Mingxuan Wang

Modeling the parser state is key to good performance in transition-based parsing. Recurrent Neural Networks considerably improved the performance of transition-based systems by modelling the global state, e.g. stack-LSTM parsers, or local…

Computation and Language · Computer Science 2020-10-22 Ramon Fernandez Astudillo , Miguel Ballesteros , Tahira Naseem , Austin Blodgett , Radu Florian

The success of Transformer-based Language Models (LMs) stems from their attention mechanism. While this mechanism has been extensively studied in explainability research, particularly through the attention values obtained during the forward…

Computation and Language · Computer Science 2024-12-24 Shahar Katz , Lior Wolf

We introduce the Block-Recurrent Transformer, which applies a transformer layer in a recurrent fashion along a sequence, and has linear complexity with respect to sequence length. Our recurrent cell operates on blocks of tokens rather than…

Machine Learning · Computer Science 2022-11-03 DeLesley Hutchins , Imanol Schlag , Yuhuai Wu , Ethan Dyer , Behnam Neyshabur

Attention-based models, such as Transformer, excel across various tasks but lack a comprehensive theoretical understanding, especially regarding token-wise sparsity and internal linear representations. To address this gap, we introduce the…

Machine Learning · Statistics 2025-02-27 Pierre Marion , Raphaël Berthier , Gérard Biau , Claire Boyer

In this work, we address the challenging task of referring segmentation. The query expression in referring segmentation typically indicates the target object by describing its relationship with others. Therefore, to find the target one…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Henghui Ding , Chang Liu , Suchen Wang , Xudong Jiang

Recent studies reveal the potential of recurrent neural network transducer (RNN-T) for end-to-end (E2E) speech recognition. Among some most popular E2E systems including RNN-T, Attention Encoder-Decoder (AED), and Connectionist Temporal…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-19 Bin Wang , Yan Yin , Hui Lin

The great success of Transformer-based models benefits from the powerful multi-head self-attention mechanism, which learns token dependencies and encodes contextual information from the input. Prior work strives to attribute model decisions…

Computation and Language · Computer Science 2021-02-26 Yaru Hao , Li Dong , Furu Wei , Ke Xu

Theoretical efforts to prove advantages of Transformers in comparison with classical architectures such as feedforward and recurrent neural networks have mostly focused on representational power. In this work, we take an alternative…

Machine Learning · Statistics 2025-03-17 Alireza Mousavi-Hosseini , Clayton Sanford , Denny Wu , Murat A. Erdogdu

The Transformer-based model have made significant strides in semantic matching tasks by capturing connections between phrase pairs. However, to assess the relevance of sentence pairs, it is insufficient to just examine the general…

Computation and Language · Computer Science 2024-12-11 Bo Li , Di Liang , Zixin Zhang

Recent progress in neural machine translation is directed towards larger neural networks trained on an increasing amount of hardware resources. As a result, NMT models are costly to train, both financially, due to the electricity and…

Computation and Language · Computer Science 2020-05-19 Tom Kocmi , Ondřej Bojar

In this paper a doubly attentive transformer machine translation model (DATNMT) is presented in which a doubly-attentive transformer decoder normally joins spatial visual features obtained via pretrained convolutional neural networks,…

Computation and Language · Computer Science 2018-08-01 Hasan Sait Arslan , Mark Fishel , Gholamreza Anbarjafari

Previous work on multimodal machine translation (MMT) has focused on the way of incorporating vision features into translation but little attention is on the quality of vision models. In this work, we investigate the impact of vision models…

Computation and Language · Computer Science 2022-03-18 Bei Li , Chuanhao Lv , Zefan Zhou , Tao Zhou , Tong Xiao , Anxiang Ma , JingBo Zhu

Attention-based neural networks, such as Transformers, have become ubiquitous in numerous applications, including computer vision, natural language processing, and time-series analysis. In all kinds of attention networks, the attention maps…

Machine Learning · Computer Science 2023-05-01 Yujing Wang , Yaming Yang , Zhuo Li , Jiangang Bai , Mingliang Zhang , Xiangtai Li , Jing Yu , Ce Zhang , Gao Huang , Yunhai Tong

Attention is a very popular and effective mechanism in artificial neural network-based sequence-to-sequence models. In this survey paper, a comprehensive review of the different attention models used in developing automatic speech…

Sound · Computer Science 2021-02-16 Priyabrata Karmakar , Shyh Wei Teng , Guojun Lu

Non-autoregressive neural machine translation (NAT) models are proposed to accelerate the inference process while maintaining relatively high performance. However, existing NAT models are difficult to achieve the desired efficiency-quality…

Computation and Language · Computer Science 2023-03-15 Pei Guo , Yisheng Xiao , Juntao Li , Min Zhang

Encoder-decoder architecture is widely adopted for sequence-to-sequence modeling tasks. For machine translation, despite the evolution from long short-term memory networks to Transformer networks, plus the introduction and development of…

Computation and Language · Computer Science 2022-10-24 Yingbo Gao , Christian Herold , Zijian Yang , Hermann Ney

Transformers have had tremendous impact for several sequence related tasks, largely due to their ability to retrieve from any part of the sequence via softmax based dot-product attention. This mechanism plays a crucial role in Transformer's…

Machine Learning · Computer Science 2025-07-15 Sai Surya Duvvuri , Inderjit S. Dhillon

The prevalent approach to neural machine translation relies on bi-directional LSTMs to encode the source sentence. In this paper we present a faster and simpler architecture based on a succession of convolutional layers. This allows to…

Computation and Language · Computer Science 2017-07-26 Jonas Gehring , Michael Auli , David Grangier , Yann N. Dauphin

Transformer-based large language models are increasingly used for long-horizon tasks; however, their attention mechanism scales poorly with context length. To handle this, we study a sleep-like consolidation mechanism in which a model…

Computation and Language · Computer Science 2026-05-28 Sangyun Lee , Sean McLeish , Tom Goldstein , Giulia Fanti