Orthographic Syllable as basic unit for SMT between Related Languages
Computation and Language
2016-10-04 v1
Abstract
We explore the use of the orthographic syllable, a variable-length consonant-vowel sequence, as a basic unit of translation between related languages which use abugida or alphabetic scripts. We show that orthographic syllable level translation significantly outperforms models trained over other basic units (word, morpheme and character) when training over small parallel corpora.
Cite
@article{arxiv.1610.00634,
title = {Orthographic Syllable as basic unit for SMT between Related Languages},
author = {Anoop Kunchukuttan and Pushpak Bhattacharyya},
journal= {arXiv preprint arXiv:1610.00634},
year = {2016}
}
Comments
7 pages, 1 figure, compiled with XeTex, to be published at the Conference on Empirical Methods in Natural Language Processing (EMNLP), 2016