English
Related papers

Related papers: Alternated Training with Synthetic and Authentic D…

200 papers

In neural machine translation (NMT), monolingual data in the target language are usually exploited through a method so-called "back-translation" to synthesize additional training parallel data. The synthetic data have been shown helpful to…

Computation and Language · Computer Science 2021-02-01 Benjamin Marie , Atsushi Fujita

Monolingual data has been demonstrated to be helpful in improving the translation quality of neural machine translation (NMT). The current methods stay at the usage of word-level knowledge, such as generating synthetic parallel data or…

Computation and Language · Computer Science 2019-08-22 Rongxiang Weng , Heng Yu , Shujian Huang , Weihua Luo , Jiajun Chen

Multimodal machine translation (MMT) simultaneously takes the source sentence and a relevant image as input for translation. Since there is no paired image available for the input sentence in most cases, recent studies suggest utilizing…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Wenyu Guo , Qingkai Fang , Dong Yu , Yang Feng

Multi-source translation systems translate from multiple languages to a single target language. By using information from these multiple sources, these systems achieve large gains in accuracy. To train these systems, it is necessary to have…

Computation and Language · Computer Science 2018-11-09 Yuta Nishimura , Katsuhito Sudoh , Graham Neubig , Satoshi Nakamura

Conventional Neural Machine Translation (NMT) models benefit from the training with an additional agent, e.g., dual learning, and bidirectional decoding with one agent decoding from left to right and the other decoding in the opposite…

Computation and Language · Computer Science 2019-09-04 Tianchi Bi , Hao Xiong , Zhongjun He , Hua Wu , Haifeng Wang

Most existing simultaneous machine translation (SiMT) systems are trained and evaluated on offline translation corpora. We argue that SiMT systems should be trained and tested on real interpretation data. To illustrate this argument, we…

Computation and Language · Computer Science 2021-10-12 Jinming Zhao , Philip Arthur , Gholamreza Haffari , Trevor Cohn , Ehsan Shareghi

Neural Machine Translation (NMT) systems are known to degrade when confronted with noisy data, especially when the system is trained only on clean data. In this paper, we show that augmenting training data with sentences containing…

Computation and Language · Computer Science 2019-03-13 Antonios Anastasopoulos , Alison Lui , Toan Nguyen , David Chiang

Neural machine translation (NMT) becomes a new approach to machine translation and generates much more fluent results compared to statistical machine translation (SMT). However, SMT is usually better than NMT in translation adequacy. It is…

Computation and Language · Computer Science 2017-04-24 Long Zhou , Wenpeng Hu , Jiajun Zhang , Chengqing Zong

In this paper, we introduce a novel approach to generate synthetic data for training Neural Machine Translation systems. The proposed approach transforms a given parallel corpus between a written language and a target language to a parallel…

Computation and Language · Computer Science 2017-11-30 Hany Hassan , Mostafa Elaraby , Ahmed Tawfik

Neural Machine Translation (NMT) models are known to suffer from noisy inputs. To make models robust, we generate adversarial augmentation samples that attack the model and preserve the source-side semantic meaning at the same time. To…

Computation and Language · Computer Science 2021-10-13 Weiting Tan , Shuoyang Ding , Huda Khayrallah , Philipp Koehn

Neural Machine Translation (NMT) models are typically trained on heterogeneous data that are concatenated and randomly shuffled. However, not all of the training data are equally useful to the model. Curriculum training aims to present the…

Computation and Language · Computer Science 2022-03-29 Tasnim Mohiuddin , Philipp Koehn , Vishrav Chaudhary , James Cross , Shruti Bhosale , Shafiq Joty

We address the problem of simultaneous translation by modifying the Neural MT decoder to operate with dynamically built encoder and attention. We propose a tunable agent which decides the best segmentation strategy for a user-defined BLEU…

Computation and Language · Computer Science 2018-06-12 Fahim Dalvi , Nadir Durrani , Hassan Sajjad , Stephan Vogel

Training efficiency is one of the main problems for Neural Machine Translation (NMT). Deep networks need for very large data as well as many training iterations to achieve state-of-the-art performance. This results in very high computation…

Computation and Language · Computer Science 2017-10-04 Dakun Zhang , Jungi Kim , Josep Crego , Jean Senellart

Multi-source translation is an approach to exploit multiple inputs (e.g. in two different languages) to increase translation accuracy. In this paper, we examine approaches for multi-source neural machine translation (NMT) using an…

Computation and Language · Computer Science 2018-06-11 Yuta Nishimura , Katsuhito Sudoh , Graham Neubig , Satoshi Nakamura

Parallel corpora are indispensable for training neural machine translation (NMT) models, and parallel corpora for most language pairs do not exist or are scarce. In such cases, pivot language NMT can be helpful where a pivot language is…

Computation and Language · Computer Science 2021-04-16 Raj Dabre , Aizhan Imankulova , Masahiro Kaneko , Abhisek Chakrabarty

Multimodal machine translation (MMT) aims to improve translation quality by incorporating information from other modalities, such as vision. Previous MMT systems mainly focus on better access and use of visual information and tend to…

Computation and Language · Computer Science 2023-09-06 Yaoming Zhu , Zewei Sun , Shanbo Cheng , Luyang Huang , Liwei Wu , Mingxuan Wang

Synthetic-to-real data translation using generative adversarial learning has achieved significant success in improving synthetic data. Yet, limited studies focus on deep evaluation and comparison of adversarial training on general-purpose…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Tingwei Shen , Ganning Zhao , Suya You

The performance of Neural Machine Translation (NMT) systems often suffers in low-resource scenarios where sufficiently large-scale parallel corpora cannot be obtained. Pre-trained word embeddings have proven to be invaluable for improving…

Computation and Language · Computer Science 2018-04-19 Ye Qi , Devendra Singh Sachan , Matthieu Felix , Sarguna Janani Padmanabhan , Graham Neubig

Back-translation is an effective strategy to improve the performance of Neural Machine Translation~(NMT) by generating pseudo-parallel data. However, several recent works have found that better translation quality of the pseudo-parallel…

Computation and Language · Computer Science 2021-02-17 Hieu Pham , Xinyi Wang , Yiming Yang , Graham Neubig

Synthetic data has emerged as a cost-effective alternative to real data for training artificial neural networks (ANN). However, the disparity between synthetic and real data results in a domain gap. That gap leads to poor performance and…

Machine Learning · Computer Science 2025-09-03 Paul Wachter , Lukas Niehaus , Julius Schöning