English
Related papers

Related papers: Neural Machine Translation with Word Predictions

200 papers

Neural machine translation (NMT) has significantly improved the quality of automatic translation models. One of the main challenges in current systems is the translation of rare words. We present a generic approach to address this weakness…

Computation and Language · Computer Science 2018-09-11 Ngoc-Quan Pham , Jan Niehues , Alex Waibel

The Neural Machine Translation (NMT) model is essentially a joint language model conditioned on both the source sentence and partial translation. Therefore, the NMT model naturally involves the mechanism of the Language Model (LM) that…

Computation and Language · Computer Science 2021-06-01 Mengqi Miao , Fandong Meng , Yijin Liu , Xiao-Hua Zhou , Jie Zhou

In Multimodal Neural Machine Translation (MNMT), a neural model generates a translated sentence that describes an image, given the image itself and one source descriptions in English. This is considered as the multimodal image caption…

Computation and Language · Computer Science 2018-06-01 Jean-Benoit Delbrouck , Stéphane Dupont , Omar Seddati

This paper proposes a novel method to inject custom terminology into neural machine translation at run time. Previous works have mainly proposed modifications to the decoding algorithm in order to constrain the output to include…

Computation and Language · Computer Science 2019-06-26 Georgiana Dinu , Prashant Mathur , Marcello Federico , Yaser Al-Onaizan

In machine translation (MT) that involves translating between two languages with significant differences in word order, determining the correct word order of translated words is a major challenge. The dependency parse tree of a source…

Computation and Language · Computer Science 2017-02-16 Christian Hadiwinoto , Hwee Tou Ng

Classical translation models constrain the space of possible outputs by selecting a subset of translation rules based on the input sentence. Recent work on improving the efficiency of neural translation models adopted a similar strategy by…

Computation and Language · Computer Science 2016-10-04 Gurvan L'Hostis , David Grangier , Michael Auli

Despite the impressive quality improvements yielded by neural machine translation (NMT) systems, controlling their translation output to adhere to user-provided terminology constraints remains an open problem. We describe our approach to…

Computation and Language · Computer Science 2018-05-11 Eva Hasler , Adrià De Gispert , Gonzalo Iglesias , Bill Byrne

Recently, universal neural machine translation (NMT) with shared encoder-decoder gained good performance on zero-shot translation. Unlike universal NMT, jointly trained language-specific encoders-decoders aim to achieve universal…

Computation and Language · Computer Science 2021-02-15 Junwei Liao , Yu Shi , Ming Gong , Linjun Shou , Hong Qu , Michael Zeng

Differently from the traditional statistical MT that decomposes the translation task into distinct separately learned components, neural machine translation uses a single neural network to model the entire translation process. Despite…

Computation and Language · Computer Science 2021-09-06 Elena Voita , Rico Sennrich , Ivan Titov

Latent tree learning(LTL) methods learn to parse sentences using only indirect supervision from a downstream task. Recent advances in latent tree learning have made it possible to recover moderately high quality tree structures by training…

Computation and Language · Computer Science 2019-09-24 Phu Mon Htut , Kyunghyun Cho , Samuel R. Bowman

Neural Machine Translation (NMT) has become the new state-of-the-art in several language pairs. However, it remains a challenging problem how to integrate NMT with a bilingual dictionary which mainly contains words rarely or never seen in…

Computation and Language · Computer Science 2016-10-25 Jiajun Zhang , Chengqing Zong

A sentence can be translated into more than one correct sentences. However, most of the existing neural machine translation models only use one of the correct translations as the targets, and the other correct sentences are punished as the…

Computation and Language · Computer Science 2018-05-15 Shuming Ma , Xu Sun , Yizhong Wang , Junyang Lin

Recent neural machine translation (NMT) systems have been greatly improved by encoder-decoder models with attention mechanisms and sub-word units. However, important differences between languages with logographic and alphabetic writing…

Computation and Language · Computer Science 2018-09-11 Longtu Zhang , Mamoru Komachi

We present a document-level neural machine translation model which takes both source and target document context into account using memory networks. We model the problem as a structured prediction problem with interdependencies among the…

Computation and Language · Computer Science 2018-05-17 Sameen Maruf , Gholamreza Haffari

The applications of recurrent neural networks in machine translation are increasing in natural language processing. Besides other languages, Bangla language contains a large amount of vocabulary. Improvement of English to Bangla machine…

Computation and Language · Computer Science 2021-06-15 Shaykh Siddique , Tahmid Ahmed , Md. Rifayet Azam Talukder , Md. Mohsin Uddin

Neural machine translation (NMT) methods developed for natural language processing have been shown to be highly successful in automating translation from one natural language to another. Recently, these NMT methods have been adapted to the…

Computation and Language · Computer Science 2023-05-24 Dharma KC , Clayton T. Morrison

Adding linguistic information (syntax or semantics) to neural machine translation (NMT) has mostly focused on using point estimates from pre-trained models. Directly using the capacity of massive pre-trained contextual word embedding models…

Computation and Language · Computer Science 2021-04-08 Hassan S. Shavarani , Anoop Sarkar

Neural Machine Translation (NMT) has become a popular technology in recent years, and the encoder-decoder framework is the mainstream among all the methods. It's obvious that the quality of the semantic representations from encoding is very…

Computation and Language · Computer Science 2020-01-15 Boyuan Pan , Yazheng Yang , Zhou Zhao , Yueting Zhuang , Deng Cai

We introduce a powerful approach for Neural Machine Translation (NMT), whereby, during training and testing, together with the input we provide its phonetic encoding and the variants of such an encoding. This way we obtain very significant…

Computation and Language · Computer Science 2019-11-12 Abdul Rafae Khan , Jia Xu

The non-autoregressive models have boosted the efficiency of neural machine translation through parallelized decoding at the cost of effectiveness when comparing with the autoregressive counterparts. In this paper, we claim that the…

Computation and Language · Computer Science 2021-01-25 Ye Liu , Yao Wan , Jian-Guo Zhang , Wenting Zhao , Philip S. Yu