English

Shallow Parsing Pipeline for Hindi-English Code-Mixed Social Media Text

Computation and Language 2016-04-13 v1

Abstract

In this study, the problem of shallow parsing of Hindi-English code-mixed social media text (CSMT) has been addressed. We have annotated the data, developed a language identifier, a normalizer, a part-of-speech tagger and a shallow parser. To the best of our knowledge, we are the first to attempt shallow parsing on CSMT. The pipeline developed has been made available to the research community with the goal of enabling better text analysis of Hindi English CSMT. The pipeline is accessible at http://bit.ly/csmt-parser-api .

Keywords

Cite

@article{arxiv.1604.03136,
  title  = {Shallow Parsing Pipeline for Hindi-English Code-Mixed Social Media Text},
  author = {Arnav Sharma and Sakshi Gupta and Raveesh Motlani and Piyush Bansal and Manish Srivastava and Radhika Mamidi and Dipti M. Sharma},
  journal= {arXiv preprint arXiv:1604.03136},
  year   = {2016}
}