English
Related papers

Related papers: Efficient Inference for Multilingual Neural Machin…

200 papers

Large Transformer models have achieved state-of-the-art results in neural machine translation and have become standard in the field. In this work, we look for the optimal combination of known techniques to optimize inference speed without…

Computation and Language · Computer Science 2020-10-08 Yi-Te Hsu , Sarthak Garg , Yi-Hsiu Liao , Ilya Chatsviorkin

To improve the performance of Neural Machine Translation~(NMT) for low-resource languages~(LRL), one effective strategy is to leverage parallel data from a related high-resource language~(HRL). However, multilingual data has been found more…

Computation and Language · Computer Science 2020-10-06 Luyu Gao , Xinyi Wang , Graham Neubig

In this paper, we present our first attempts in building a multilingual Neural Machine Translation framework under a unified approach. We are then able to employ attention-based NMT for many-to-many multilingual translation tasks. Our…

Computation and Language · Computer Science 2016-11-16 Thanh-Le Ha , Jan Niehues , Alexander Waibel

Attentional sequence-to-sequence models have become the new standard for machine translation, but one challenge of such models is a significant increase in training and decoding cost compared to phrase-based systems. Here, we focus on…

Computation and Language · Computer Science 2017-05-08 Jacob Devlin

Multilingual neural machine translation (NMT) enables training a single model that supports translation from multiple source languages into multiple target languages. In this paper, we push the limits of multilingual NMT in terms of number…

Computation and Language · Computer Science 2019-07-03 Roee Aharoni , Melvin Johnson , Orhan Firat

Recent work in multilingual translation advances translation quality surpassing bilingual baselines using deep transformer models with increased capacity. However, the extra latency and memory costs introduced by this approach may make it…

Computation and Language · Computer Science 2022-06-07 Xiang Kong , Adithya Renduchintala , James Cross , Yuqing Tang , Jiatao Gu , Xian Li

Recently, neural machine translation (NMT) has been extended to multilinguality, that is to handle more than one translation direction with a single system. Multilingual NMT showed competitive performance against pure bilingual systems.…

Computation and Language · Computer Science 2018-06-22 Surafel M. Lakew , Mauro Cettolo , Marcello Federico

Large language model (LLM) shows promising performances in a variety of downstream tasks, such as machine translation (MT). However, using LLMs for translation suffers from high computational costs and significant latency. Based on our…

Computation and Language · Computer Science 2025-05-21 Zhanglin Wu , Daimeng Wei , Xiaoyu Chen , Hengchao Shang , Jiaxin Guo , Zongyao Li , Yuanchang Luo , Jinlong Yang , Zhiqiang Rao , Hao Yang

Neural machine translation (NMT) often makes mistakes in translating low-frequency content words that are essential to understanding the meaning of the sentence. We propose a method to alleviate this problem by augmenting NMT systems with…

Computation and Language · Computer Science 2016-10-06 Philip Arthur , Graham Neubig , Satoshi Nakamura

We introduce our efforts towards building a universal neural machine translation (NMT) system capable of translating between any language pair. We set a milestone towards this goal by building a single massively multilingual NMT model…

With the advent of the Transformer architecture, Neural Machine Translation (NMT) results have shown great improvement lately. However, results in low-resource conditions still lag behind in both bilingual and multilingual setups, due to…

Computation and Language · Computer Science 2023-12-04 Isidora Chara Tourni , Derry Wijaya

Transfer learning or multilingual model is essential for low-resource neural machine translation (NMT), but the applicability is limited to cognate languages by sharing their vocabularies. This paper shows effective techniques to transfer a…

Computation and Language · Computer Science 2019-06-06 Yunsu Kim , Yingbo Gao , Hermann Ney

Machine Translation System (MTS) serves as an effective tool for communication by translating text or speech from one language to another language. The need of an efficient translation system becomes obvious in a large multilingual…

Computation and Language · Computer Science 2024-03-18 Sudhansu Bala Das , Atharv Biradar , Tapas Kumar Mishra , Bidyut Kumar Patra

As neural machine translation (NMT) is not easily amenable to explicit correction of errors, incorporating pre-specified translations into NMT is widely regarded as a non-trivial challenge. In this paper, we propose and explore three…

Computation and Language · Computer Science 2019-12-03 Tao Wang , Shaohui Kuang , Deyi Xiong , António Branco

We propose a simple solution to use a single Neural Machine Translation (NMT) model to translate between multiple languages. Our solution requires no change in the model architecture from our base system but instead introduces an artificial…

Neural machine translation (NMT) systems require large amounts of high quality in-domain parallel corpora for training. State-of-the-art NMT systems still face challenges related to out-of-vocabulary words and dealing with low-resource…

Computation and Language · Computer Science 2019-09-18 Jetic Gū , Hassan S. Shavarani , Anoop Sarkar

In this paper, we propose to extend the recently introduced model-agnostic meta-learning algorithm (MAML) for low-resource neural machine translation (NMT). We frame low-resource translation as a meta-learning problem, and we learn to adapt…

Computation and Language · Computer Science 2018-08-28 Jiatao Gu , Yong Wang , Yun Chen , Kyunghyun Cho , Victor O. K. Li

Neural Machine Translation (NMT) remains a formidable challenge, especially when dealing with low-resource languages. Pre-trained sequence-to-sequence (seq2seq) multi-lingual models, such as mBART-50, have demonstrated impressive…

Computation and Language · Computer Science 2024-07-10 Aniruddha Roy , Pretam Ray , Ayush Maheshwari , Sudeshna Sarkar , Pawan Goyal

With the rapid advancement of Neural Machine Translation (NMT), enhancing translation efficiency and quality has become a focal point of research. Despite the commendable performance of general models such as the Transformer in various…

Computation and Language · Computer Science 2024-02-26 Jingpu Yang , Zehua Han , Mengyu Xiang , Helin Wang , Yuxiao Huang , Miao Fang

The recently proposed massively multilingual neural machine translation (NMT) system has been shown to be capable of translating over 100 languages to and from English within a single model. Its improved translation performance on low…

Computation and Language · Computer Science 2019-11-13 Aditya Siddhant , Melvin Johnson , Henry Tsai , Naveen Arivazhagan , Jason Riesa , Ankur Bapna , Orhan Firat , Karthik Raman
‹ Prev 1 2 3 10 Next ›