English
Related papers

Related papers: Anticipation-Free Training for Simultaneous Machin…

200 papers

Existing approaches to neural machine translation condition each output word on previously generated outputs. We introduce a model that avoids this autoregressive property and produces its outputs in parallel, allowing an order of magnitude…

Computation and Language · Computer Science 2018-03-12 Jiatao Gu , James Bradbury , Caiming Xiong , Victor O. K. Li , Richard Socher

Neural machine translation (NMT) has become the de-facto standard in real-world machine translation applications. However, NMT models can unpredictably produce severely pathological translations, known as hallucinations, that seriously…

Computation and Language · Computer Science 2023-05-22 Nuno M. Guerreiro , Pierre Colombo , Pablo Piantanida , André F. T. Martins

Simultaneous Speech Translation (SimulST) enables real-time cross-lingual communication by jointly optimizing speech recognition and machine translation under strict latency constraints. Existing systems struggle to balance translation…

Computation and Language · Computer Science 2025-10-30 Chenyang Le , Bing Han , Jinshun Li , Songyong Chen , Yanmin Qian

Large language models (LLMs) have revolutionized natural language processing (NLP) by excelling at understanding and generating human-like text. However, their widespread deployment can be prohibitively expensive. SortedNet is a recent…

Computation and Language · Computer Science 2024-02-12 Parsa Kavehzadeh , Mojtaba Valipour , Marzieh Tahaei , Ali Ghodsi , Boxing Chen , Mehdi Rezagholizadeh

Conventional spoken language translation (SLT) systems are pipeline based systems, where we have an Automatic Speech Recognition (ASR) system to convert the modality of source from speech to text and a Machine Translation (MT) systems to…

Non-autoregressive translation (NAT) models, which remove the dependence on previous target tokens from the inputs of the decoder, achieve significantly inference speedup but at the cost of inferior accuracy compared to autoregressive…

Computation and Language · Computer Science 2018-12-27 Junliang Guo , Xu Tan , Di He , Tao Qin , Linli Xu , Tie-Yan Liu

We present a survey on multilingual neural machine translation (MNMT), which has gained a lot of traction in the recent years. MNMT has been useful in improving translation quality as a result of knowledge transfer. MNMT is more promising…

Computation and Language · Computer Science 2020-01-08 Raj Dabre , Chenhui Chu , Anoop Kunchukuttan

Multimodal Large Language Models (MLLMs) have achieved notable success in enhancing translation performance by integrating multimodal information. However, existing research primarily focuses on image-guided methods, whose applicability is…

Computation and Language · Computer Science 2026-03-04 Yexing Du , Youcheng Pan , Zekun Wang , Zheng Chu , Yichong Huang , Kaiyuan Liu , Bo Yang , Yang Xiang , Ming Liu , Bing Qin

We present the task of PreQuEL, Pre-(Quality-Estimation) Learning. A PreQuEL system predicts how well a given sentence will be translated, without recourse to the actual translation, thus eschewing unnecessary resource allocation when…

Computation and Language · Computer Science 2022-12-06 Shachar Don-Yehiya , Leshem Choshen , Omri Abend

Attention mechanism has enhanced state-of-the-art Neural Machine Translation (NMT) by jointly learning to align and translate. It tends to ignore past alignment information, however, which often leads to over-translation and…

Computation and Language · Computer Science 2016-08-09 Zhaopeng Tu , Zhengdong Lu , Yang Liu , Xiaohua Liu , Hang Li

Machine Translation (MT) system generally aims at automatic representation of source language into target language retaining the originality of context using various Natural Language Processing (NLP) techniques. Among various NLP methods,…

Computation and Language · Computer Science 2026-03-04 Sudhansu Bala Das , Divyajoti Panda , Tapas Kumar Mishra , Bidyut Kr. Patra

Non-autoregressive neural machine translation (NAT) offers substantial translation speed up compared to autoregressive neural machine translation (AT) at the cost of translation quality. Latent variable modeling has emerged as a promising…

Computation and Language · Computer Science 2024-09-10 DongNyeong Heo , Heeyoul Choi

For spoken language translation (SLT) in live scenarios such as conferences, lectures and meetings, it is desirable to show the translation to the user as quickly as possible, avoiding an annoying lag between speaker and translated…

Computation and Language · Computer Science 2021-06-02 Yuekun Yao , Barry Haddow

Large language model (LLM) shows promising performances in a variety of downstream tasks, such as machine translation (MT). However, using LLMs for translation suffers from high computational costs and significant latency. Based on our…

Computation and Language · Computer Science 2025-05-21 Zhanglin Wu , Daimeng Wei , Xiaoyu Chen , Hengchao Shang , Jiaxin Guo , Zongyao Li , Yuanchang Luo , Jinlong Yang , Zhiqiang Rao , Hao Yang

Simultaneous speech translation (SimulST) systems aim at generating their output with the lowest possible latency, which is normally computed in terms of Average Lagging (AL). In this paper we highlight that, despite its widespread…

Computation and Language · Computer Science 2023-10-19 Sara Papi , Marco Gaido , Matteo Negri , Marco Turchi

A prerequisite for training corpus-based machine translation (MT) systems -- either Statistical MT (SMT) or Neural MT (NMT) -- is the availability of high-quality parallel data. This is arguably more important today than ever before, as NMT…

Computation and Language · Computer Science 2018-04-18 Alberto Poncelas , Dimitar Shterionov , Andy Way , Gideon Maillette de Buy Wenniger , Peyman Passban

Large language models have demonstrated exceptional performance across multiple crosslingual NLP tasks, including machine translation (MT). However, persistent challenges remain in addressing context-sensitive units (CSUs), such as…

Computation and Language · Computer Science 2025-05-30 Qiuyu Ding , Zhiqiang Cao , Hailong Cao , Tiejun Zhao

Simultaneous speech translation (SST) takes streaming speech input and generates text translation on the fly. Existing methods either have high latency due to recomputation of input representations, or fall behind of offline ST in…

Computation and Language · Computer Science 2024-08-20 Siqi Ouyang , Xi Xu , Chinmay Dandekar , Lei Li

We present a survey on multilingual neural machine translation (MNMT), which has gained a lot of traction in the recent years. MNMT has been useful in improving translation quality as a result of translation knowledge transfer (transfer…

Computation and Language · Computer Science 2020-01-08 Raj Dabre , Chenhui Chu , Anoop Kunchukuttan

Recently, there has been a surge in research in multimodal machine translation (MMT), where additional modalities such as images are used to improve translation quality of textual systems. A particular use for such multimodal systems is the…

Computation and Language · Computer Science 2022-07-07 Veneta Haralampieva , Ozan Caglayan , Lucia Specia