English
Related papers

Related papers: Efficient Inference for Multilingual Neural Machin…

200 papers

In encoder-decoder neural models, multiple encoders are in general used to represent the contextual information in addition to the individual sentence. In this paper, we investigate multi-encoder approaches in documentlevel neural machine…

Computation and Language · Computer Science 2020-05-19 Bei Li , Hui Liu , Ziyang Wang , Yufan Jiang , Tong Xiao , Jingbo Zhu , Tongran Liu , Changliang Li

With multilingual machine translation (MMT) models continuing to grow in size and number of supported languages, it is natural to reuse and upgrade existing models to save computation as data becomes available in more languages. However,…

Computation and Language · Computer Science 2023-02-08 Simeng Sun , Maha Elbayad , Anna Sun , James Cross

Neural Machine Translation (NMT) typically leverages monolingual data in training through backtranslation. We investigate an alternative simple method to use monolingual data for NMT training: We combine the scores of a pre-trained and…

Computation and Language · Computer Science 2019-01-25 Felix Stahlberg , James Cross , Veselin Stoyanov

Conventional Neural Machine Translation (NMT) models benefit from the training with an additional agent, e.g., dual learning, and bidirectional decoding with one agent decoding from left to right and the other decoding in the opposite…

Computation and Language · Computer Science 2019-09-04 Tianchi Bi , Hao Xiong , Zhongjun He , Hua Wu , Haifeng Wang

Attention-based Neural Machine Translation (NMT) models suffer from attention deficiency issues as has been observed in recent research. We propose a novel mechanism to address some of these limitations and improve the NMT attention.…

Computation and Language · Computer Science 2016-08-10 Baskaran Sankaran , Haitao Mi , Yaser Al-Onaizan , Abe Ittycheriah

Recent studies have shown that reinforcement learning (RL) is an effective approach for improving the performance of neural machine translation (NMT) system. However, due to its instability, successfully RL training is challenging,…

Machine Learning · Computer Science 2018-08-28 Lijun Wu , Fei Tian , Tao Qin , Jianhuang Lai , Tie-Yan Liu

Large language models (LLMs) have achieved remarkable success across diverse tasks, yet their inference processes are hindered by substantial time and energy demands due to single-token generation at each decoding step. While previous…

Computation and Language · Computer Science 2025-04-11 Zongyue Qin , Ziniu Hu , Zifan He , Neha Prakriya , Jason Cong , Yizhou Sun

The advent of the attention mechanism in neural machine translation models has improved the performance of machine translation systems by enabling selective lookup into the source sentence. In this paper, the efficiencies of translation…

Computation and Language · Computer Science 2017-01-10 Krupakar Hans , R S Milton

Many-to-one neural machine translation systems improve over one-to-one systems when training data is scarce. In this paper, we design and test a novel algorithm for selecting the language of minibatches when training such systems. The…

Computation and Language · Computer Science 2024-10-08 Àlex R. Atrio , Alexis Allemann , Ljiljana Dolamic , Andrei Popescu-Belis

The many-to-many multilingual neural machine translation can be regarded as the process of integrating semantic features from the source sentences and linguistic features from the target sentences. To enhance zero-shot translation, models…

Computation and Language · Computer Science 2024-08-05 Mengyu Bu , Shuhao Gu , Yang Feng

Neural machine translation (NMT) has recently become popular in the field of machine translation. However, NMT suffers from the problem of repeating or missing words in the translation. To address this problem, Tu et al. (2017) proposed an…

Computation and Language · Computer Science 2017-06-27 Yukio Matsumura , Takayuki Sato , Mamoru Komachi

Language pairs with limited amounts of parallel data, also known as low-resource languages, remain a challenge for neural machine translation. While the Transformer model has achieved significant improvements for many language pairs and has…

Computation and Language · Computer Science 2020-11-05 Ali Araabi , Christof Monz

We propose LLMA, an LLM accelerator to losslessly speed up Large Language Model (LLM) inference with references. LLMA is motivated by the observation that there are abundant identical text spans between the decoding result by an LLM and the…

Computation and Language · Computer Science 2023-04-11 Nan Yang , Tao Ge , Liang Wang , Binxing Jiao , Daxin Jiang , Linjun Yang , Rangan Majumder , Furu Wei

Natural Language Processing systems are heavily dependent on the availability of annotated data to train practical models. Primarily, models are trained on English datasets. In recent times, significant advances have been made in…

Computation and Language · Computer Science 2023-01-18 Ankit Kumar Upadhyay , Harsit Kumar Upadhya

Through the development of neural machine translation, the quality of machine translation systems has been improved significantly. By exploiting advancements in deep learning, systems are now able to better approximate the complex mapping…

Computation and Language · Computer Science 2018-08-03 Jan Niehues , Ngoc-Quan Pham , Thanh-Le Ha , Matthias Sperber , Alex Waibel

In the encoder-decoder architecture for neural machine translation (NMT), the hidden states of the recurrent structures in the encoder and decoder carry the crucial information about the sentence.These vectors are generated by parameters…

Computation and Language · Computer Science 2017-08-08 Rongxiang Weng , Shujian Huang , Zaixiang Zheng , Xinyu Dai , Jiajun Chen

We present a framework for machine translation evaluation using neural networks in a pairwise setting, where the goal is to select the better translation from a pair of hypotheses, given the reference translation. In this framework,…

Computation and Language · Computer Science 2017-10-06 Francisco Guzmán , Shafiq R. Joty , Lluís Màrquez , Preslav Nakov

Multilingual Neural Machine Translation (MNMT) for low-resource languages (LRL) can be enhanced by the presence of related high-resource languages (HRL), but the relatedness of HRL usually relies on predefined linguistic assumptions about…

Computation and Language · Computer Science 2019-10-31 Surafel M. Lakew , Alina Karakanta , Marcello Federico , Matteo Negri , Marco Turchi

The advent of deep learning has led to a significant gain in machine translation. However, most of the studies required a large parallel dataset which is scarce and expensive to construct and even unavailable for some languages. This paper…

Computation and Language · Computer Science 2023-04-04 Viet H. Pham , Thang M. Pham , Giang Nguyen , Long Nguyen , Dien Dinh

The Neural Machine Translation (NMT) model is essentially a joint language model conditioned on both the source sentence and partial translation. Therefore, the NMT model naturally involves the mechanism of the Language Model (LM) that…

Computation and Language · Computer Science 2021-06-01 Mengqi Miao , Fandong Meng , Yijin Liu , Xiao-Hua Zhou , Jie Zhou