English

Unbiased Estimators for the Parameters of the Binomial and Multinomial Distributions

Statistics Theory 2013-03-18 v2 Statistics Theory

Abstract

The exact expression is derived for the expected value, <pi>< {p_i}> , for the parameter for any bin ii of a histogram following a multinomial distribution derived by sorting NN observations into bins of BB classes, if nin_i of the observations are found to be sorted into bin ii. This expected value is found to be <pi>=ni+1N+B < {p_i}> = \frac {n_i + 1} {N + B}. The expected value for the variance is found to be <pi>(1<pi>)N+B+1\frac{< p_i > (1-< p_i >)}{N+B+1}. A general expression is derived to determine <piz>< {p_i}^z > for arbitrary values of BB and zz. These expressions hold provided there is no \emph{a priori} reason for pip_i associated with any bin to have a value that is exactly equal to 0. For the particular case of the binomial distribution (B=2), these estimators are tested by examining how often the value of ptruep_{true}, the value which is used to generate sets of pseudo-random binomial variates, falls within 1.96 estimated standard deviations of the estimated value <p>< p >. When compared with the results of identical, earlier reported tests for small sample sizes, the unbiased estimators derived here predictably outperform \emph{asymptotically} unbiased estimators

Keywords

Cite

@article{arxiv.1302.5749,
  title  = {Unbiased Estimators for the Parameters of the Binomial and Multinomial Distributions},
  author = {Jonathan M. Friedman},
  journal= {arXiv preprint arXiv:1302.5749},
  year   = {2013}
}

Comments

Withdrawn after classic references were finally found with identical results. Initial literature searches were fruitless and led me to re-derive and test a very old equation. Similar equations are derived more tersely and elegantly in Chapter 18 of E.T. Jaynes: Probability Theory: The Logic of Science