In this paper, we present the annotation pipeline and the guidelines we wrote as part of an effort to create a large manually annotated Arabic author profiling dataset from various social media sources covering 16 Arabic countries and 11 dialectal regions. The target size of the annotated ARAP-Tweet corpus is more than 2.4 million words. We illustrate and summarize our general and dialect-specific guidelines for each of the dialectal regions selected. We also present the annotation framework and logistics. We control the annotation quality frequently by computing the inter-annotator agreement during the annotation process. Finally, we describe the issues encountered during the annotation phase, especially those related to the peculiarities of Arabic dialectal varieties as used in social media.
@article{arxiv.1808.07678,
title = {Guidelines and Annotation Framework for Arabic Author Profiling},
author = {Wajdi Zaghouani and Anis Charfi},
journal= {arXiv preprint arXiv:1808.07678},
year = {2018}
}
Comments
Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018), The 3rd Workshop on Open-Source Arabic Corpora and Processing Tools: with ArabicWeb16 Data Challenge. arXiv admin note: text overlap with arXiv:1808.07674