Word Representation Models for Morphologically Rich Languages in Neural Machine Translation
Neural and Evolutionary Computing
2016-06-15 v1 Computation and Language
Abstract
Dealing with the complex word forms in morphologically rich languages is an open problem in language processing, and is particularly important in translation. In contrast to most modern neural systems of translation, which discard the identity for rare words, in this paper we propose several architectures for learning word representations from character and morpheme level word decompositions. We incorporate these representations in a novel machine translation model which jointly learns word alignments and translations via a hard attention mechanism. Evaluating on translating from several morphologically rich languages into English, we show consistent improvements over strong baseline methods, of between 1 and 1.5 BLEU points.
Cite
@article{arxiv.1606.04217,
title = {Word Representation Models for Morphologically Rich Languages in Neural Machine Translation},
author = {Ekaterina Vylomova and Trevor Cohn and Xuanli He and Gholamreza Haffari},
journal= {arXiv preprint arXiv:1606.04217},
year = {2016}
}