Modeling Language Change in Historical Corpora: The Case of Portuguese
Abstract
This paper presents a number of experiments to model changes in a historical Portuguese corpus composed of literary texts for the purpose of temporal text classification. Algorithms were trained to classify texts with respect to their publication date taking into account lexical variation represented as word n-grams, and morphosyntactic variation represented by part-of-speech (POS) distribution. We report results of 99.8% accuracy using word unigram features with a Support Vector Machines classifier to predict the publication date of documents in time intervals of both one century and half a century. A feature analysis is performed to investigate the most informative features for this task and how they are linked to language change.
Keywords
Cite
@article{arxiv.1610.00030,
title = {Modeling Language Change in Historical Corpora: The Case of Portuguese},
author = {Marcos Zampieri and Shervin Malmasi and Mark Dras},
journal= {arXiv preprint arXiv:1610.00030},
year = {2016}
}
Comments
Proceedings of Language Resources and Evaluation (LREC)