English
Related papers

Related papers: Improving Zero-shot Multilingual Neural Machine Tr…

200 papers

An effective method to generate a large number of parallel sentences for training improved neural machine translation (NMT) systems is the use of back-translations of the target-side monolingual data. Recently, iterative back-translation…

Computation and Language · Computer Science 2020-12-11 Idris Abdulmumin , Bashir Shehu Galadanci , Abubakar Isa

Previous work mainly focuses on improving cross-lingual transfer for NLU tasks with a multilingual pretrained encoder (MPE), or improving the performance on supervised machine translation with BERT. However, it is under-explored that…

Computation and Language · Computer Science 2021-11-08 Guanhua Chen , Shuming Ma , Yun Chen , Li Dong , Dongdong Zhang , Jia Pan , Wenping Wang , Furu Wei

Despite the growing variety of languages supported by existing multilingual neural machine translation (MNMT) models, most of the world's languages are still being left behind. We aim to extend large-scale MNMT models to incorporate a new…

Computation and Language · Computer Science 2025-12-02 Wen Lai , Viktor Hangya , Yingli Shen , Alexander Fraser

An effective method to generate a large number of parallel sentences for training improved neural machine translation (NMT) systems is the use of the back-translations of the target-side monolingual data. The standard back-translation…

Computation and Language · Computer Science 2021-11-04 Idris Abdulmumin , Bashir Shehu Galadanci , Aliyu Garba

The training paradigm for machine translation has gradually shifted, from learning neural machine translation (NMT) models with extensive parallel corpora to instruction finetuning on multilingual large language models (LLMs) with…

Computation and Language · Computer Science 2024-02-08 Pengzhi Gao , Zhongjun He , Hua Wu , Haifeng Wang

Context-aware neural machine translation (NMT) is a promising direction to improve the translation quality by making use of the additional context, e.g., document-level translation, or having meta-information. Although there exist various…

Computation and Language · Computer Science 2020-10-20 Jingjing Huo , Christian Herold , Yingbo Gao , Leonard Dahlmann , Shahram Khadivi , Hermann Ney

Multilingual neural machine translation (MNMT) learns to translate multiple language pairs with a single model, potentially improving both the accuracy and the memory-efficiency of deployed models. However, the heavy data imbalance between…

Computation and Language · Computer Science 2021-09-10 Chunting Zhou , Daniel Levy , Xian Li , Marjan Ghazvininejad , Graham Neubig

Multilingual neural machine translation (NMT), which translates multiple languages using a single model, is of great practical importance due to its advantages in simplifying the training process, reducing online maintenance costs, and…

Computation and Language · Computer Science 2019-08-27 Xu Tan , Jiale Chen , Di He , Yingce Xia , Tao Qin , Tie-Yan Liu

Neural Machine translation is a challenging task due to the inherent complex nature and the fluidity that natural languages bring. Nonetheless, in recent years, it has achieved state-of-the-art performance in several language pairs.…

Computation and Language · Computer Science 2023-04-19 Vakul Goyle , Parvathy Krishnaswamy , Kannan Girija Ravikumar , Utsa Chattopadhyay , Kartikay Goyle

Neural machine translation (NMT) approaches have improved the state of the art in many machine translation settings over the last couple of years, but they require large amounts of training data to produce sensible output. We demonstrate…

Computation and Language · Computer Science 2017-08-22 Robert Östling , Jörg Tiedemann

This paper proposes a technique for adding a new source or target language to an existing multilingual NMT model without re-training it on the initial set of languages. It consists in replacing the shared vocabulary with a small…

Computation and Language · Computer Science 2021-10-22 Alexandre Berard

Prior work has proved that Translation memory (TM) can boost the performance of Neural Machine Translation (NMT). In contrast to existing work that uses bilingual corpus as TM and employs source-side similarity search for memory retrieval,…

Computation and Language · Computer Science 2021-06-03 Deng Cai , Yan Wang , Huayang Li , Wai Lam , Lemao Liu

In the field of machine learning, the well-trained model is assumed to be able to recover the training labels, i.e. the synthetic labels predicted by the model should be as close to the ground-truth labels as possible. Inspired by this, we…

Computation and Language · Computer Science 2021-08-30 Lei Zhou , Liang Ding , Kevin Duh , Shinji Watanabe , Ryohei Sasano , Koichi Takeda

We frame the task of machine translation evaluation as one of scoring machine translation output with a sequence-to-sequence paraphraser, conditioned on a human reference. We propose training the paraphraser as a multilingual NMT system,…

Computation and Language · Computer Science 2020-10-29 Brian Thompson , Matt Post

We present META-MT, a meta-learning approach to adapt Neural Machine Translation (NMT) systems in a few-shot setting. META-MT provides a new approach to make NMT models easily adaptable to many target domains with the minimal amount of…

Computation and Language · Computer Science 2020-04-07 Amr Sharaf , Hany Hassan , Hal Daumé

Machine translation systems achieve near human-level performance on some languages, yet their effectiveness strongly relies on the availability of large amounts of parallel sentences, which hinders their applicability to the majority of…

Computation and Language · Computer Science 2018-08-15 Guillaume Lample , Myle Ott , Alexis Conneau , Ludovic Denoyer , Marc'Aurelio Ranzato

While end-to-end neural machine translation (NMT) has made remarkable progress recently, NMT systems only rely on parallel corpora for parameter estimation. Since parallel corpora are usually limited in quantity, quality, and coverage,…

Computation and Language · Computer Science 2016-12-13 Yong Cheng , Wei Xu , Zhongjun He , Wei He , Hua Wu , Maosong Sun , Yang Liu

Neural Machine Translation (NMT) is a new approach to machine translation that has made great progress in recent years. However, recent studies show that NMT generally produces fluent but inadequate translations (Tu et al. 2016b; Tu et al.…

Computation and Language · Computer Science 2017-01-02 Xing Wang , Zhengdong Lu , Zhaopeng Tu , Hang Li , Deyi Xiong , Min Zhang

Neural Machine Translation (NMT) models have been effective on large bilingual datasets. However, the existing methods and techniques show that the model's performance is highly dependent on the number of examples in training data. For many…

Computation and Language · Computer Science 2022-06-10 Nalin Kumar , Deepak Kumar , Subhankar Mishra

Machine Translation System (MTS) serves as an effective tool for communication by translating text or speech from one language to another language. The need of an efficient translation system becomes obvious in a large multilingual…

Computation and Language · Computer Science 2024-03-18 Sudhansu Bala Das , Atharv Biradar , Tapas Kumar Mishra , Bidyut Kumar Patra