Language identification has become a prerequisite for all kinds of automated text processing systems. In this paper, we present a rule-based language identifier tool for two closely related Indo-Aryan languages: Hindi and Magahi. This system has currently achieved an accuracy of approx 86.34%. We hope to improve this in the future. Automatic identification of languages will be significant in the accuracy of output of Web Crawlers.
Cite
@article{arxiv.1804.05095,
title = {Automatic Language Identification System for Hindi and Magahi},
author = {Priya Rani and Atul Kr. Ojha and Girish Nath Jha},
journal= {arXiv preprint arXiv:1804.05095},
year = {2018}
}
Comments
WILDRE-4 2018 Workshop Proceedings under the LREC 2018