English

Crowdsourcing Dialect Characterization through Twitter

Physics and Society 2014-11-20 v1 Computation and Language Social and Information Networks Machine Learning

Abstract

We perform a large-scale analysis of language diatopic variation using geotagged microblogging datasets. By collecting all Twitter messages written in Spanish over more than two years, we build a corpus from which a carefully selected list of concepts allows us to characterize Spanish varieties on a global scale. A cluster analysis proves the existence of well defined macroregions sharing common lexical properties. Remarkably enough, we find that Spanish language is split into two superdialects, namely, an urban speech used across major American and Spanish citites and a diverse form that encompasses rural areas and small towns. The latter can be further clustered into smaller varieties with a stronger regional character.

Cite

@article{arxiv.1407.7094,
  title  = {Crowdsourcing Dialect Characterization through Twitter},
  author = {Bruno Gonçalves and David Sánchez},
  journal= {arXiv preprint arXiv:1407.7094},
  year   = {2014}
}

Comments

10 pages, 5 figures

R2 v1 2026-06-22T05:13:49.563Z