Correct ordering in the Zipf-Poisson ensemble
Methodology
2011-01-14 v1 Statistics Theory
Statistics Theory
Abstract
We consider a Zipf--Poisson ensemble in which for and and integers . As the first random variables have their proper order relative to each other, with probability tending to 1 for up to for an explicit constant . The rate cannot be achieved. The ordering of the first entities does not preclude for some interloping . The first random variables are correctly ordered exclusive of any interlopers, with probability tending to 1 if for . For a Zipf--Poisson model of the British National Corpus, which has a total word count of , our result estimates that the 72 words with the highest counts are properly ordered.
Cite
@article{arxiv.1101.2481,
title = {Correct ordering in the Zipf-Poisson ensemble},
author = {Justin S. Dyer and Art B. Owen},
journal= {arXiv preprint arXiv:1101.2481},
year = {2011}
}