English
Related papers

Related papers: Achieving Open Vocabulary Neural Machine Translati…

200 papers

Neural Machine Translation (NMT) models generally perform translation using a fixed-size lexical vocabulary, which is an important bottleneck on their generalization capability and overall translation quality. The standard approach to…

Computation and Language · Computer Science 2019-10-22 Duygu Ataman , Orhan Firat , Mattia A. Di Gangi , Marcello Federico , Alexandra Birch

Neural Machine Translation (MT) has reached state-of-the-art results. However, one of the main challenges that neural MT still faces is dealing with very large vocabularies and morphologically rich languages. In this paper, we propose a…

Computation and Language · Computer Science 2016-07-01 Marta R. Costa-Jussà , José A. R. Fonollosa

Neural machine translation (NMT), a new approach to machine translation, has been proved to outperform conventional statistical machine translation (SMT) across a variety of language pairs. Translation is an open-vocabulary problem, but…

Computation and Language · Computer Science 2017-11-15 Yining Wang , Long Zhou , Jiajun Zhang , Chengqing Zong

Translation into morphologically-rich languages challenges neural machine translation (NMT) models with extremely sparse vocabularies where atomic treatment of surface forms is unrealistic. This problem is typically addressed by either…

Computation and Language · Computer Science 2020-02-28 Duygu Ataman , Wilker Aziz , Alexandra Birch

Neural machine translation (NMT) models typically operate with a fixed vocabulary, but translation is an open-vocabulary problem. Previous work addresses the translation of out-of-vocabulary words by backing off to a dictionary. In this…

Computation and Language · Computer Science 2016-06-13 Rico Sennrich , Barry Haddow , Alexandra Birch

Neural machine translation (NMT) has achieved notable success in recent times, however it is also widely recognized that this approach has limitations with handling infrequent words and word pairs. This paper presents a novel…

Computation and Language · Computer Science 2017-08-08 Yang Feng , Shiyue Zhang , Andi Zhang , Dong Wang , Andrew Abel

Most existing machine translation systems operate at the level of words, relying on explicit segmentation to extract tokens. We introduce a neural machine translation (NMT) model that maps a source character sequence to a target character…

Computation and Language · Computer Science 2017-06-14 Jason Lee , Kyunghyun Cho , Thomas Hofmann

Neural machine translation (NMT) systems operate primarily on words (or sub-words), ignoring lower-level patterns of morphology. We present a character-aware decoder designed to capture such patterns when translating into morphologically…

Computation and Language · Computer Science 2019-06-20 Adithya Renduchintala , Pamela Shapiro , Kevin Duh , Philipp Koehn

Neural machine translation (NMT) has significantly improved the quality of automatic translation models. One of the main challenges in current systems is the translation of rare words. We present a generic approach to address this weakness…

Computation and Language · Computer Science 2018-09-11 Ngoc-Quan Pham , Jan Niehues , Alex Waibel

Machine translation systems achieve near human-level performance on some languages, yet their effectiveness strongly relies on the availability of large amounts of parallel sentences, which hinders their applicability to the majority of…

Computation and Language · Computer Science 2018-08-15 Guillaume Lample , Myle Ott , Alexis Conneau , Ludovic Denoyer , Marc'Aurelio Ranzato

We propose a simple solution to use a single Neural Machine Translation (NMT) model to translate between multiple languages. Our solution requires no change in the model architecture from our base system but instead introduces an artificial…

We explore the effectiveness of character-level neural machine translation using Transformer architecture for various levels of language similarity and size of the training dataset on translation between Czech and Croatian, German,…

Computation and Language · Computer Science 2023-08-09 Josef Jon , Ondřej Bojar

In this paper, we introduce a hybrid search for attention-based neural machine translation (NMT). A target phrase learned with statistical MT models extends a hypothesis in the NMT beam search when the attention of the NMT model focuses on…

Computation and Language · Computer Science 2017-08-11 Leonard Dahlmann , Evgeny Matusov , Pavel Petrushkov , Shahram Khadivi

Transfer learning or multilingual model is essential for low-resource neural machine translation (NMT), but the applicability is limited to cognate languages by sharing their vocabularies. This paper shows effective techniques to transfer a…

Computation and Language · Computer Science 2019-06-06 Yunsu Kim , Yingbo Gao , Hermann Ney

We propose a method to transfer knowledge across neural machine translation (NMT) models by means of a shared dynamic vocabulary. Our approach allows to extend an initial model for a given language pair to cover new languages by adapting…

Computation and Language · Computer Science 2018-11-06 Surafel M. Lakew , Aliia Erofeeva , Matteo Negri , Marcello Federico , Marco Turchi

Recently, neural machine translation (NMT) has emerged as a powerful alternative to conventional statistical approaches. However, its performance drops considerably in the presence of morphologically rich languages (MRLs). Neural engines…

Computation and Language · Computer Science 2018-04-19 Peyman Passban , Qun Liu , Andy Way

This paper describes CAiRE's submission to the unsupervised machine translation track of the WMT'19 news shared task from German to Czech. We leverage a phrase-based statistical machine translation (PBSMT) model and a pre-trained language…

Computation and Language · Computer Science 2019-11-19 Zihan Liu , Yan Xu , Genta Indra Winata , Pascale Fung

Neural Machine Translation (NMT) has become the new state-of-the-art in several language pairs. However, it remains a challenging problem how to integrate NMT with a bilingual dictionary which mainly contains words rarely or never seen in…

Computation and Language · Computer Science 2016-10-25 Jiajun Zhang , Chengqing Zong

In neural machine translation (NMT), researchers face the challenge of un-seen (or out-of-vocabulary OOV) words translation. To solve this, some researchers propose the splitting of western languages such as English and German into…

Computation and Language · Computer Science 2019-06-25 Lifeng Han , Shaohui Kuang

We introduce a neural machine translation model that views the input and output sentences as sequences of characters rather than words. Since word-level information provides a crucial source of bias, our input model composes representations…

Computation and Language · Computer Science 2015-11-17 Wang Ling , Isabel Trancoso , Chris Dyer , Alan W Black
‹ Prev 1 2 3 10 Next ›