Zipf's law, power laws, and maximum entropy
Abstract
Zipf's law, and power laws in general, have attracted and continue to attract considerable attention in a wide variety of disciplines - from astronomy to demographics to software structure to economics to linguistics to zoology, and even warfare. A recent model of random group formation [RGF] attempts a general explanation of such phenomena based on Jaynes' notion of maximum entropy applied to a particular choice of cost function. In the present article I argue that the cost function used in the RGF model is in fact unnecessarily complicated, and that power laws can be obtained in a much simpler way by applying maximum entropy ideas directly to the Shannon entropy subject only to a single constraint: that the average of the logarithm of the observable quantity is specified.
Cite
@article{arxiv.1212.5567,
title = {Zipf's law, power laws, and maximum entropy},
author = {Matt Visser},
journal= {arXiv preprint arXiv:1212.5567},
year = {2013}
}
Comments
14 pages; V2: 6 references added; V3: 1 more reference added, minor edits; V4: typos fixed, minor edits; this version accepted for publication in New Journal of Physics