English
Related papers

Related papers: Nematus: a Toolkit for Neural Machine Translation

200 papers

Neural machine translation (NMT), a new approach to machine translation, has achieved promising results comparable to those of traditional approaches such as statistical machine translation (SMT). Despite its recent success, NMT cannot…

Computation and Language · Computer Science 2017-07-21 Zi Long , Takehito Utsuro , Tomoharu Mitsuhashi , Mikio Yamamoto

While monolingual data has been shown to be useful in improving bilingual neural machine translation (NMT), effectively and efficiently leveraging monolingual data for Multilingual NMT (MNMT) systems is a less explored area. In this work,…

Computation and Language · Computer Science 2020-10-07 Yiren Wang , ChengXiang Zhai , Hany Hassan Awadalla

Neural Machine Translation (NMT) is a new approach for automatic translation of text from one human language into another. The basic concept in NMT is to train a large Neural Network that maximizes the translation performance on a given…

Computation and Language · Computer Science 2016-12-22 Markus Freitag , Yaser Al-Onaizan

Unsupervised Neural Machine Translation (UNMT) focuses on improving NMT results under the assumption there is no human translated parallel data, yet little work has been done so far in highlighting its advantages compared to supervised…

Computation and Language · Computer Science 2023-12-21 Isidora Chara Tourni , Derry Wijaya

We introduce a demonstration of our system, which implements online learning for neural machine translation in a production environment. These techniques allow the system to continuously learn from the corrections provided by the…

Scarcity of parallel sentence pairs is a major challenge for training high quality neural machine translation (NMT) models in bilingually low-resource scenarios, as NMT is data-hungry. Multi-task learning is an elegant approach to inject…

Computation and Language · Computer Science 2020-01-13 Poorya Zaremoodi , Gholamreza Haffari

Monolingual data has been demonstrated to be helpful in improving the translation quality of neural machine translation (NMT). The current methods stay at the usage of word-level knowledge, such as generating synthetic parallel data or…

Computation and Language · Computer Science 2019-08-22 Rongxiang Weng , Heng Yu , Shujian Huang , Weihua Luo , Jiajun Chen

Documenting the construction of an NMT (Neural Machine Translation) system for En/Ja based on the Transformer architecture leveraging the OpenNMT framework. A systematic exploration of corpora pre-processing, hyperparameter tuning and model…

Computation and Language · Computer Science 2022-02-24 Matthew Bieda

Monolingual data have been demonstrated to be helpful in improving translation quality of both statistical machine translation (SMT) systems and neural machine translation (NMT) systems, especially in resource-poor or domain adaptation…

Computation and Language · Computer Science 2018-03-02 Zhirui Zhang , Shujie Liu , Mu Li , Ming Zhou , Enhong Chen

We introduce and describe the results of a novel shared task on bandit learning for machine translation. The task was organized jointly by Amazon and Heidelberg University for the first time at the Second Conference on Machine Translation…

Computation and Language · Computer Science 2017-07-31 Artem Sokolov , Julia Kreutzer , Kellen Sunderland , Pavel Danchenko , Witold Szymaniak , Hagen Fürstenau , Stefan Riezler

Pronoun translation is a longstanding challenge in neural machine translation (NMT), often requiring inter-sentential context to ensure linguistic accuracy. To address this, we introduce ProNMT, a novel framework designed to enhance pronoun…

Computation and Language · Computer Science 2025-01-07 Harshit Dhankhar , Baban Gain , Asif Ekbal , Yogesh Mani Tripathi

Recent work achieved remarkable results in training neural machine translation (NMT) systems in a fully unsupervised way, with new and dedicated architectures that rely on monolingual corpora only. In this work, we propose to define…

Computation and Language · Computer Science 2018-10-31 Benjamin Marie , Atsushi Fujita

Neural Machine Translation (NMT) models achieve state-of-the-art performance on many translation benchmarks. As an active research field in NMT, knowledge distillation is widely applied to enhance the model's performance by transferring…

Computation and Language · Computer Science 2021-05-28 Fusheng Wang , Jianhao Yan , Fandong Meng , Jie Zhou

The optimization and machine learning toolkit (OMLT) is an open-source software package incorporating neural network and gradient-boosted tree surrogate models, which have been trained using machine learning, into larger optimization…

Neural machine translation (NMT) generates the next target token given as input the previous ground truth target tokens during training while the previous generated target tokens during inference, which causes discrepancy between training…

Computation and Language · Computer Science 2020-07-22 Kaitao Song , Xu Tan , Jianfeng Lu

While neural machine translation (NMT) has become the new paradigm, the parameter optimization requires large-scale parallel data which is scarce in many domains and language pairs. In this paper, we address a new translation scenario in…

Computation and Language · Computer Science 2017-11-06 Yining Wang , Yang Zhao , Jiajun Zhang , Chengqing Zong , Zhengshan Xue

Neural Machine Translation (NMT) models achieve their best performance when large sets of parallel data are used for training. Consequently, techniques for augmenting the training set have become popular recently. One of these methods is…

Computation and Language · Computer Science 2019-09-10 Alberto Poncelas , Maja Popovic , Dimitar Shterionov , Gideon Maillette de Buy Wenniger , Andy Way

Neural chat translation (NCT) aims to translate a cross-lingual chat between speakers of different languages. Existing context-aware NMT models cannot achieve satisfactory performances due to the following inherent problems: 1) limited…

Computation and Language · Computer Science 2023-01-30 Chulun Zhou , Yunlong Liang , Fandong Meng , Jie Zhou , Jinan Xu , Hongji Wang , Min Zhang , Jinsong Su

Neural machine translation (NMT) systems require large amounts of high quality in-domain parallel corpora for training. State-of-the-art NMT systems still face challenges related to out-of-vocabulary words and dealing with low-resource…

Computation and Language · Computer Science 2019-09-18 Jetic Gū , Hassan S. Shavarani , Anoop Sarkar

SGNMT is a decoding platform for machine translation which allows paring various modern neural models of translation with different kinds of constraints and symbolic models. In this paper, we describe three use cases in which SGNMT is…

Computation and Language · Computer Science 2018-03-21 Felix Stahlberg , Danielle Saunders , Gonzalo Iglesias , Bill Byrne