English
Related papers

Related papers: Toward Multilingual Neural Machine Translation wit…

200 papers

We propose a method to transfer knowledge across neural machine translation (NMT) models by means of a shared dynamic vocabulary. Our approach allows to extend an initial model for a given language pair to cover new languages by adapting…

Computation and Language · Computer Science 2018-11-06 Surafel M. Lakew , Aliia Erofeeva , Matteo Negri , Marcello Federico , Marco Turchi

Recent advances in Neural Machine Translation (NMT) show that adding syntactic information to NMT systems can improve the quality of their translations. Most existing work utilizes some specific types of linguistically-inspired tree…

Computation and Language · Computer Science 2018-08-29 Xinyi Wang , Hieu Pham , Pengcheng Yin , Graham Neubig

Monolingual data has been demonstrated to be helpful in improving the translation quality of neural machine translation (NMT). The current methods stay at the usage of word-level knowledge, such as generating synthetic parallel data or…

Computation and Language · Computer Science 2019-08-22 Rongxiang Weng , Heng Yu , Shujian Huang , Weihua Luo , Jiajun Chen

Translating in real-time, a.k.a. simultaneous translation, outputs translation words before the input sentence ends, which is a challenging problem for conventional machine translation methods. We propose a neural machine translation (NMT)…

Computation and Language · Computer Science 2017-01-12 Jiatao Gu , Graham Neubig , Kyunghyun Cho , Victor O. K. Li

The basic concept in Neural Machine Translation (NMT) is to train a large Neural Network that maximizes the translation performance on a given parallel corpus. NMT is then using a simple left-to-right beam-search decoder to generate new…

Computation and Language · Computer Science 2018-12-19 Markus Freitag , Yaser Al-Onaizan

Neural machine translation (NMT) systems operate primarily on words (or sub-words), ignoring lower-level patterns of morphology. We present a character-aware decoder designed to capture such patterns when translating into morphologically…

Computation and Language · Computer Science 2019-06-20 Adithya Renduchintala , Pamela Shapiro , Kevin Duh , Philipp Koehn

Neural machine translation has recently achieved impressive results, while using little in the way of external linguistic information. In this paper we show that the strong learning capability of neural MT models does not make linguistic…

Computation and Language · Computer Science 2016-06-29 Rico Sennrich , Barry Haddow

The encoder-decoder framework for neural machine translation (NMT) has been shown effective in large data scenarios, but is much less effective for low-resource languages. We present a transfer learning method that significantly improves…

Computation and Language · Computer Science 2016-04-11 Barret Zoph , Deniz Yuret , Jonathan May , Kevin Knight

Compared to sentence-level systems, document-level neural machine translation (NMT) models produce a more consistent output across a document and are able to better resolve ambiguities within the input. There are many works on…

Computation and Language · Computer Science 2023-06-09 Christian Herold , Hermann Ney

Neural Machine Translation (NMT) systems rely on large amounts of parallel data. This is a major challenge for low-resource languages. Building on recent work on unsupervised and semi-supervised methods, we present an approach that combines…

Computation and Language · Computer Science 2018-05-29 Lierni Sestorain , Massimiliano Ciaramita , Christian Buck , Thomas Hofmann

We present a framework for machine translation evaluation using neural networks in a pairwise setting, where the goal is to select the better translation from a pair of hypotheses, given the reference translation. In this framework,…

Computation and Language · Computer Science 2017-10-06 Francisco Guzmán , Shafiq R. Joty , Lluís Màrquez , Preslav Nakov

While achieving state-of-the-art results in multiple tasks and languages, translation-based cross-lingual transfer is often overlooked in favour of massively multilingual pre-trained encoders. Arguably, this is due to its main limitations:…

Computation and Language · Computer Science 2021-07-26 Edoardo Maria Ponti , Julia Kreutzer , Ivan Vulić , Siva Reddy

We introduce a Multi-modal Neural Machine Translation model in which a doubly-attentive decoder naturally incorporates spatial visual features obtained using pre-trained convolutional neural networks, bridging the gap between image…

Computation and Language · Computer Science 2017-02-07 Iacer Calixto , Qun Liu , Nick Campbell

Machine translation (MT) is a technique that leverages computers to translate human languages automatically. Nowadays, neural machine translation (NMT) which models direct mapping between source and target languages with deep neural…

Computation and Language · Computer Science 2020-04-14 Jiajun Zhang , Chengqing Zong

Although attention-based Neural Machine Translation (NMT) has achieved remarkable progress in recent years, it still suffers from issues of repeating and dropping translations. To alleviate these issues, we propose a novel key-value…

Computation and Language · Computer Science 2018-07-02 Fandong Meng , Zhaopeng Tu , Yong Cheng , Haiyang Wu , Junjie Zhai , Yuekui Yang , Di Wang

Common intermediate language representation in neural machine translation can be used to extend bilingual to multilingual systems by incremental training. In this paper, we propose a new architecture based on introducing an interlingual…

Computation and Language · Computer Science 2019-12-10 Carlos Escolano , Marta R. Costa-jussà , José A. R. Fonollosa

Encoder-decoder models have achieved remarkable success in speech and text tasks, yet efficiently adapting these models to diverse uni/multi-modal scenarios remains an open challenge. In this paper, we propose Whisper-UT, a unified and…

The field of machine translation (MT), the automatic translation of written text from one natural language into another, has experienced a major paradigm shift in recent years. Statistical MT, which mainly relies on various count-based…

Computation and Language · Computer Science 2020-10-01 Felix Stahlberg

Morphological modeling in neural machine translation (NMT) is a promising approach to achieving open-vocabulary machine translation for morphologically-rich languages. However, existing methods such as sub-word tokenization and…

Computation and Language · Computer Science 2024-04-04 Antoine Nzeyimana

Neural Machine Translation (NMT) has become the new state-of-the-art in several language pairs. However, it remains a challenging problem how to integrate NMT with a bilingual dictionary which mainly contains words rarely or never seen in…

Computation and Language · Computer Science 2016-10-25 Jiajun Zhang , Chengqing Zong