English
Related papers

Related papers: On Synthetic Data for Back Translation

200 papers

Back-translation has proven to be an effective method to utilize monolingual data in neural machine translation (NMT), and iteratively conducting back-translation can further improve the model performance. Selecting which monolingual data…

Computation and Language · Computer Science 2020-10-09 Zi-Yi Dou , Antonios Anastasopoulos , Graham Neubig

It has been shown that the performance of neural machine translation (NMT) drops starkly in low-resource conditions, often requiring large amounts of auxiliary data to achieve competitive results. An effective method of generating auxiliary…

Computation and Language · Computer Science 2021-04-06 Lidia Kidane , Sachin Kumar , Yulia Tsvetkov

Back-translation (BT) has become one of the de facto components in unsupervised neural machine translation (UNMT), and it explicitly makes UNMT have translation ability. However, all the pseudo bi-texts generated by BT are treated equally…

Computation and Language · Computer Science 2021-09-24 Jinliang Lu , Jiajun Zhang

Compared with only using limited authentic parallel data as training corpus, many studies have proved that incorporating synthetic parallel data, which generated by back translation (BT) or forward translation (FT, or selftraining), into…

Computation and Language · Computer Science 2020-04-07 Shanbo Cheng , Shaohui Kuang , Rongxiang Weng , Heng Yu , Changfeng Zhu , Weihua Luo

The quality of neural machine translation can be improved by leveraging additional monolingual resources to create synthetic training data. Source-side monolingual data can be (forward-)translated into the target language for self-training;…

Computation and Language · Computer Science 2020-10-06 Nikolay Bogoychev , Rico Sennrich

Neural Machine Translation (NMT) for low-resource languages is still a challenging task in front of NLP researchers. In this work, we deploy a standard data augmentation methodology by back-translation to a new language translation…

Computation and Language · Computer Science 2024-06-11 Kung Yin Hong , Lifeng Han , Riza Batista-Navarro , Goran Nenadic

While back-translation is simple and effective in exploiting abundant monolingual corpora to improve low-resource neural machine translation (NMT), the synthetic bilingual corpora generated by NMT models trained on limited authentic…

Computation and Language · Computer Science 2019-09-04 Shuo Wang , Yang Liu , Chao Wang , Huanbo Luan , Maosong Sun

Without real bilingual corpus available, unsupervised Neural Machine Translation (NMT) typically requires pseudo parallel data generated with the back-translation method for the model training. However, due to weak supervision, the pseudo…

Computation and Language · Computer Science 2019-01-15 Shuo Ren , Zhirui Zhang , Shujie Liu , Ming Zhou , Shuai Ma

An effective method to generate a large number of parallel sentences for training improved neural machine translation (NMT) systems is the use of back-translations of the target-side monolingual data. Recently, iterative back-translation…

Computation and Language · Computer Science 2020-12-11 Idris Abdulmumin , Bashir Shehu Galadanci , Abubakar Isa

Machine Translation is one of the major oldest and the most active research area in Natural Language Processing. Currently, Statistical Machine Translation (SMT) dominates the Machine Translation research. Statistical Machine Translation is…

Computation and Language · Computer Science 2014-10-01 M. Anand Kumar , V. Dhanalakshmi , K. P. Soman , V. Sharmiladevi

Unsupervised neural machine translation(NMT) is associated with noise and errors in synthetic data when executing vanilla back-translations. Here, we explicitly exploits language model(LM) to drive construction of an unsupervised NMT…

Computation and Language · Computer Science 2019-11-12 Wei Zhang , Youyuan Lin , Ruoran Ren , Xiaodong Wang , Zhenshuang Liang , Zhen Huang

This paper illustrates our approach to the shared task on large-scale multilingual machine translation in the sixth conference on machine translation (WMT-21). This work aims to build a single multilingual translation system with a…

Computation and Language · Computer Science 2021-09-21 Baohao Liao , Shahram Khadivi , Sanjika Hewavitharana

Back translation, as a technique for extending a dataset, is widely used by researchers in low-resource language translation tasks. It typically translates from the target to the source language to ensure high-quality translation results.…

Computation and Language · Computer Science 2024-08-23 Hengjie Liu , Ruibo Hou , Yves Lepage

In this paper, we introduce a data-driven approach for Formality-Sensitive Machine Translation (FSMT) that caters to the unique linguistic properties of four target languages. Our methodology centers on two core strategies: 1)…

Computation and Language · Computer Science 2023-06-28 Seugnjun Lee , Hyeonseok Moon , Chanjun Park , Heuiseok Lim

Neural Machine Translation (NMT) is a new approach to machine translation that has made great progress in recent years. However, recent studies show that NMT generally produces fluent but inadequate translations (Tu et al. 2016b; Tu et al.…

Computation and Language · Computer Science 2017-01-02 Xing Wang , Zhengdong Lu , Zhaopeng Tu , Hang Li , Deyi Xiong , Min Zhang

Many language pairs are low resource, meaning the amount and/or quality of available parallel data is not sufficient to train a neural machine translation (NMT) model which can reach an acceptable standard of accuracy. Many works have…

Computation and Language · Computer Science 2021-11-23 Idris Abdulmumin , Bashir Shehu Galadanci , Abubakar Isa , Habeebah Adamu Kakudi , Ismaila Idris Sinan

Back-translation is a widely used data augmentation technique which leverages target monolingual data. However, its effectiveness has been challenged since automatic metrics such as BLEU only show significant improvements for test examples…

Computation and Language · Computer Science 2020-08-19 Sergey Edunov , Myle Ott , Marc'Aurelio Ranzato , Michael Auli

An effective method to generate a large number of parallel sentences for training improved neural machine translation (NMT) systems is the use of the back-translations of the target-side monolingual data. The standard back-translation…

Computation and Language · Computer Science 2021-11-04 Idris Abdulmumin , Bashir Shehu Galadanci , Aliyu Garba

Language coverage bias, which indicates the content-dependent differences between sentence pairs originating from the source and target languages, is important for neural machine translation (NMT) because the target-original training data…

Computation and Language · Computer Science 2021-06-08 Shuo Wang , Zhaopeng Tu , Zhixing Tan , Shuming Shi , Maosong Sun , Yang Liu

Back translation is one of the most widely used methods for improving the performance of neural machine translation systems. Recent research has sought to enhance the effectiveness of this method by increasing the 'diversity' of the…

Computation and Language · Computer Science 2023-09-01 Laurie Burchell , Alexandra Birch , Kenneth Heafield