English

Core Lexicon and Contagious Words

Disordered Systems and Neural Networks 2007-05-23 v1

Abstract

We present the new empirical parameter fcf_c, the most probable usage frequency of a word in a language, computed via the distribution of documents over frequency xx of the word. This parameter allows for filtering the core lexicon of a language from the content words, which tend to be extremely frequent in some texts written in specific genres or by certain authors. Distributions of documents over frequencies for such words display long tails as x>fcx>f_c representing a bunch of documents in which such words are used in abundance. Collections of such documents exhibit a percolation like phase transition as the coarse grain of frequency Δf\Delta f (flattening out the strongly irregular frequency data series) approaches the critical value fcf_c.

Cite

@article{arxiv.cond-mat/0303454,
  title  = {Core Lexicon and Contagious Words},
  author = {Dmitri Volchenkov and Philippe Blanchard and Serge Sharoff},
  journal= {arXiv preprint arXiv:cond-mat/0303454},
  year   = {2007}
}

Comments

RevTex, 4 pages, 2 figures

R2 v1 2026-07-22T10:47:59.472Z