English
Related papers

Related papers: Modeling Context With Linear Attention for Scalabl…

200 papers

Document-level translation remains one of the most challenging tasks for large language models, which are constrained by limited context windows that impede global cohesion, while simultaneously suffering from redundant contextual…

Computation and Language · Computer Science 2026-05-29 Yutong Wang , Xuebo Liu , Derek F. Wong , Zhilin Li , Rongqing Jiang , Min Zhang , Shimin Tao , Daimeng Wei , Min Zhang

Recent work has shown that either (1) increasing the input length or (2) increasing model size can improve the performance of Transformer-based neural models. In this paper, we present a new model, called LongT5, with which we explore the…

Computation and Language · Computer Science 2022-05-04 Mandy Guo , Joshua Ainslie , David Uthus , Santiago Ontanon , Jianmo Ni , Yun-Hsuan Sung , Yinfei Yang

The field of artificial intelligence has witnessed significant advancements in natural language processing, largely attributed to the capabilities of Large Language Models (LLMs). These models form the backbone of Agents designed to address…

Computation and Language · Computer Science 2025-01-16 Jiaxin Guo , Yuanchang Luo , Daimeng Wei , Ling Zhang , Zongyao Li , Hengchao Shang , Zhiqiang Rao , Shaojun Li , Jinlong Yang , Zhanglin Wu , Hao Yang

The quadratic complexity of self-attention in Transformers has hindered the processing of long text. To alleviate this problem, previous works have proposed to sparsify the attention matrix, taking advantage of the observation that crucial…

Computation and Language · Computer Science 2024-01-12 Ziwei He , Jian Yuan , Le Zhou , Jingwen Leng , Bo Jiang

Since 2017, the Transformer-based models play critical roles in various downstream Natural Language Processing tasks. However, a common limitation of the attention mechanism utilized in Transformer Encoder is that it cannot automatically…

Computation and Language · Computer Science 2022-04-20 Ziyang Luo , Yadong Xi , Jing Ma , Zhiwei Yang , Xiaoxi Mao , Changjie Fan , Rongsheng Zhang

Cross-lingual semantic textual similarity systems estimate the degree of the meaning similarity between two sentences, each in a different language. State-of-the-art algorithms usually employ machine translation and combine vast amount of…

Computation and Language · Computer Science 2018-07-12 Tomáš Brychcín

Recent progress in pretrained Transformer-based language models has shown great success in learning contextual representation of text. However, due to the quadratic self-attention complexity, most of the pretrained Transformers models can…

Computation and Language · Computer Science 2021-10-22 Peng Xu , Xinchi Chen , Xiaofei Ma , Zhiheng Huang , Bing Xiang

The quality of output from large language models (LLMs), particularly in machine translation (MT), is closely tied to the quality of in-context examples (ICEs) provided along with the query, i.e., the text to translate. The effectiveness of…

Computation and Language · Computer Science 2024-09-19 Javad Pourmostafa Roshan Sharami , Dimitar Shterionov , Pieter Spronck

Most state-of-the-art neural machine translation systems, despite being different in architectural skeletons (e.g. recurrence, convolutional), share an indispensable feature: the Attention. However, most existing attention methods are…

Computation and Language · Computer Science 2019-08-17 Phi Xuan Nguyen , Shafiq Joty

Pretrained language models based on the transformer architecture have shown great success in NLP. Textual training data often comes from the web and is thus tagged with time-specific information, but most language models ignore this…

Computation and Language · Computer Science 2022-05-05 Guy D. Rosin , Kira Radinsky

Lexical ambiguity is a challenging and pervasive problem in machine translation (\mt). We introduce a simple and scalable approach to resolve translation ambiguity by incorporating a small amount of extra-sentential context in neural \mt.…

Computation and Language · Computer Science 2023-11-28 Elijah Rippeth , Marine Carpuat , Kevin Duh , Matt Post

Document-level machine translation incorporates inter-sentential dependencies into the translation of a source sentence. In this paper, we propose a new framework to model cross-sentence dependencies by training neural machine translation…

Computation and Language · Computer Science 2020-03-31 Pei Zhang , Xu Zhang , Wei Chen , Jian Yu , Yanfeng Wang , Deyi Xiong

Despite being the current de-facto models in most NLP tasks, transformers are often limited to short sequences due to their quadratic attention complexity on the number of tokens. Several attempts to address this issue were studied, either…

Computation and Language · Computer Science 2023-07-19 Amine Abdaoui , Sourav Dutta

Lattices are an efficient and effective method to encode ambiguity of upstream systems in natural language processing tasks, for example to compactly capture multiple speech recognition hypotheses, or to represent multiple linguistic…

Computation and Language · Computer Science 2019-06-05 Matthias Sperber , Graham Neubig , Ngoc-Quan Pham , Alex Waibel

Having a sequence-to-sequence model which can operate in an online fashion is important for streaming applications such as Voice Search. Neural transducer is a streaming sequence-to-sequence model, but has shown a significant degradation in…

Computation and Language · Computer Science 2017-12-06 Tara N. Sainath , Chung-Cheng Chiu , Rohit Prabhavalkar , Anjuli Kannan , Yonghui Wu , Patrick Nguyen , Zhifeng Chen

Large language models (LLMs) have excelled in various NLP tasks, including machine translation (MT), yet most studies focus on sentence-level translation. This work investigates the inherent capability of instruction-tuned LLMs for…

Computation and Language · Computer Science 2025-04-22 Yirong Sun , Dawei Zhu , Yanjun Chen , Erjia Xiao , Xinghao Chen , Xiaoyu Shen

Non-autoregressive translation (NAT) models achieve comparable performance and superior speed compared to auto-regressive translation (AT) models in the context of sentence-level machine translation (MT). However, their abilities are…

Computation and Language · Computer Science 2023-12-12 Guangsheng Bao , Zhiyang Teng , Hao Zhou , Jianhao Yan , Yue Zhang

Long context understanding remains challenging for large language models due to their limited context windows. This paper introduces Long Input Fine-Tuning (LIFT) for long context modeling, a novel framework that enhances LLM performance on…

Computation and Language · Computer Science 2024-12-19 Yansheng Mao , Jiaqi Li , Fanxu Meng , Jing Xiong , Zilong Zheng , Muhan Zhang

Although the Transformer model can effectively acquire context features via a self-attention mechanism, deeper syntactic knowledge is still not effectively modeled. To alleviate the above problem, we propose Syntactic knowledge via Graph…

Computation and Language · Computer Science 2023-05-24 Yuqian Dai , Serge Sharoff , Marc de Kamps

The recent surge of large language models (LLMs) highlights their ability to perform in-context learning, i.e., "learning" to perform a task from a few demonstrations in the context without any parameter updates. However, their capabilities…

Computation and Language · Computer Science 2023-07-07 Tianle Cai , Kaixuan Huang , Jason D. Lee , Mengdi Wang