English
Related papers

Related papers: Chinese-Japanese Unsupervised Neural Machine Trans…

200 papers

It has been shown that the performance of neural machine translation (NMT) drops starkly in low-resource conditions, underperforming phrase-based statistical machine translation (PBSMT) and requiring large amounts of auxiliary data to…

Computation and Language · Computer Science 2019-05-29 Rico Sennrich , Biao Zhang

We conduct an empirical study of neural machine translation (NMT) for truly low-resource languages, and propose a training curriculum fit for cases when both parallel training data and compute resource are lacking, reflecting the reality of…

Computation and Language · Computer Science 2021-11-30 Garry Kuwanto , Afra Feyza Akyürek , Isidora Chara Tourni , Siyang Li , Alexander Gregory Jones , Derry Wijaya

Unsupervised translation has reached impressive performance on resource-rich language pairs such as English-French and English-German. However, early studies have shown that in more realistic settings involving low-resource, rare languages,…

Computation and Language · Computer Science 2021-03-15 Xavier Garcia , Aditya Siddhant , Orhan Firat , Ankur P. Parikh

Neural Machine Translation (NMT) models generally perform translation using a fixed-size lexical vocabulary, which is an important bottleneck on their generalization capability and overall translation quality. The standard approach to…

Computation and Language · Computer Science 2019-10-22 Duygu Ataman , Orhan Firat , Mattia A. Di Gangi , Marcello Federico , Alexandra Birch

Neural machine translation (NMT) has recently achieved impressive results. A potential problem of the existing NMT algorithm, however, is that the decoding is conducted from left to right, without considering the right context. This paper…

Computation and Language · Computer Science 2017-10-06 Aodong Li , Shiyue Zhang , Dong Wang , Thomas Fang Zheng

Recent advances in Unsupervised Neural Machine Translation (UNMT) have minimized the gap between supervised and unsupervised machine translation performance for closely related language pairs. However, the situation is very different for…

Computation and Language · Computer Science 2021-06-10 Tamali Banerjee , Rudra Murthy , Pushpak Bhattacharyya

Unsupervised neural machine translation (UNMT) has recently attracted great interest in the machine translation community. The main advantage of the UNMT lies in its easy collection of required large training text sentences while with only…

Computation and Language · Computer Science 2020-12-04 Haipeng Sun , Rui Wang , Kehai Chen , Xugang Lu , Masao Utiyama , Eiichiro Sumita , Tiejun Zhao

Neural machine translation (NMT) has recently become popular in the field of machine translation. However, NMT suffers from the problem of repeating or missing words in the translation. To address this problem, Tu et al. (2017) proposed an…

Computation and Language · Computer Science 2017-06-27 Yukio Matsumura , Takayuki Sato , Mamoru Komachi

Over the last few years two promising research directions in low-resource neural machine translation (NMT) have emerged. The first focuses on utilizing high-resource languages to improve the quality of low-resource languages via…

Computation and Language · Computer Science 2020-05-12 Aditya Siddhant , Ankur Bapna , Yuan Cao , Orhan Firat , Mia Chen , Sneha Kudugunta , Naveen Arivazhagan , Yonghui Wu

Neural machine translation (NMT) becomes a new approach to machine translation and generates much more fluent results compared to statistical machine translation (SMT). However, SMT is usually better than NMT in translation adequacy. It is…

Computation and Language · Computer Science 2017-04-24 Long Zhou , Wenpeng Hu , Jiajun Zhang , Chengqing Zong

Multilingual machine translation (MMT) benefits from cross-lingual transfer but is a challenging multitask optimization problem. This is partly because there is no clear framework to systematically learn language-specific parameters.…

Computation and Language · Computer Science 2023-02-13 Haoran Xu , Jean Maillard , Vedanuj Goswami

Despite impressive empirical successes of neural machine translation (NMT) on standard benchmarks, limited parallel data impedes the application of NMT models to many language pairs. Data augmentation methods such as back-translation make…

Computation and Language · Computer Science 2019-10-08 Chunting Zhou , Xuezhe Ma , Junjie Hu , Graham Neubig

Word meaning, representation, and interpretation play fundamental roles in natural language understanding (NLU), natural language processing (NLP), and natural language generation (NLG) tasks. Many of the inherent difficulties in these…

Computation and Language · Computer Science 2025-12-18 Lifeng Han , Gareth J. F. Jones , Alan F. Smeaton

The encoder-decoder framework for neural machine translation (NMT) has been shown effective in large data scenarios, but is much less effective for low-resource languages. We present a transfer learning method that significantly improves…

Computation and Language · Computer Science 2016-04-11 Barret Zoph , Deniz Yuret , Jonathan May , Kevin Knight

Exploiting a common language as an auxiliary for better translation has a long tradition in machine translation and lets supervised learning-based machine translation enjoy the enhancement delivered by the well-used pivot language in the…

Computation and Language · Computer Science 2020-10-12 Zuchao Li , Hai Zhao , Rui Wang , Masao Utiyama , Eiichiro Sumita

Neural machine translation (NMT) systems have recently obtained state-of-the art in many machine translation systems between popular language pairs because of the availability of data. For low-resourced language pairs, there are few…

Computation and Language · Computer Science 2020-12-17 Thi-Vinh Ngo , Thanh-Le Ha , Phuong-Thai Nguyen , Le-Minh Nguyen

Multimodal neural machine translation (NMT) has become an increasingly important area of research over the years because additional modalities, such as image data, can provide more context to textual data. Furthermore, the viability of…

Computation and Language · Computer Science 2020-10-20 Andrew Merritt , Chenhui Chu , Yuki Arase

In this paper, we present our first attempts in building a multilingual Neural Machine Translation framework under a unified approach. We are then able to employ attention-based NMT for many-to-many multilingual translation tasks. Our…

Computation and Language · Computer Science 2016-11-16 Thanh-Le Ha , Jan Niehues , Alexander Waibel

Simultaneous machine translation (SiMT) is usually done via sequence-level knowledge distillation (Seq-KD) from a full-sentence neural machine translation (NMT) model. However, there is still a significant performance gap between NMT and…

Computation and Language · Computer Science 2022-12-05 Hexuan Deng , Liang Ding , Xuebo Liu , Meishan Zhang , Dacheng Tao , Min Zhang

We propose a simple solution to use a single Neural Machine Translation (NMT) model to translate between multiple languages. Our solution requires no change in the model architecture from our base system but instead introduces an artificial…