English

Verifying Heaps' law using Google Books Ngram data

Computation and Language 2020-03-30 v1 Physics and Society

Abstract

This article is devoted to the verification of the empirical Heaps law in European languages using Google Books Ngram corpus data. The connection between word distribution frequency and expected dependence of individual word number on text size is analysed in terms of a simple probability model of text generation. It is shown that the Heaps exponent varies significantly within characteristic time intervals of 60-100 years.

Keywords

Cite

@article{arxiv.1612.09213,
  title  = {Verifying Heaps' law using Google Books Ngram data},
  author = {Vladimir V. Bochkarev and Eduard Yu. Lerner and Anna V. Shevlyakova},
  journal= {arXiv preprint arXiv:1612.09213},
  year   = {2020}
}

Comments

8 pages, 6 figures

R2 v1 2026-06-22T17:37:00.900Z