English

A Mathematical Analysis of Benford's Law and its Generalization

Methodology 2023-08-16 v1 Probability Statistics Theory Data Analysis, Statistics and Probability Applications Statistics Theory

Abstract

We explain Kossovsky's generalization of Benford's law which is a formula that approximates the distribution of leftmost digits in finite sequences of natural data and apply it to six sequences of data including populations of US cities and towns and times between earthquakes. We model the natural logarithms of these two data sequences as samples of random variables having normal and reflected Gumbel densities respectively. We show that compliance with the general law depends on how nearly constant the periodized density functions are and that the models are generally more compliant than the natural data. This surprising result suggests that the generalized law might be used to improve density estimation which is the basis of statistical pattern recognition, machine learning and data science.

Keywords

Cite

@article{arxiv.2308.07773,
  title  = {A Mathematical Analysis of Benford's Law and its Generalization},
  author = {Alex E. Kossovsky and Wayne M. Lawton},
  journal= {arXiv preprint arXiv:2308.07773},
  year   = {2023}
}

Comments

15 pages, 8 figures