Web 2.0 has brought with it numerous user-produced data revealing one's thoughts, experiences, and knowledge, which are a great source for many tasks, such as information extraction, and knowledge base construction. However, the colloquial nature of the texts poses new challenges for current natural language processing techniques, which are more adapt to the formal form of the language. Ellipsis is a common linguistic phenomenon that some words are left out as they are understood from the context, especially in oral utterance, hindering the improvement of dependency parsing, which is of great importance for tasks relied on the meaning of the sentence. In order to promote research in this area, we are releasing a Chinese dependency treebank of 319 weibos, containing 572 sentences with omissions restored and contexts reserved.
@article{arxiv.1801.06613,
title = {Building an Ellipsis-aware Chinese Dependency Treebank for Web Text},
author = {Xuancheng Ren and Xu Sun and Ji Wen and Bingzhen Wei and Weidong Zhan and Zhiyuan Zhang},
journal= {arXiv preprint arXiv:1801.06613},
year = {2018}
}
Comments
The treebank is available at https://github.com/lancopku/Chinese-Dependency-Treebank-with-Ellipsis