English

Pearson's goodness-of-fit tests for sparse distributions

Methodology 2022-01-03 v2

Abstract

Pearson's chi-squared test is widely used to test the goodness of fit between categorical data and a given discrete distribution function. When the number of sets of the categorical data, say kk, is a fixed integer, Pearson's chi-squared test statistic converges in distribution to a chi-squared distribution with k1k-1 degrees of freedom when the sample size nn goes to infinity. In real applications, the number kk often changes with nn and may be even much larger than nn. By using the martingale techniques, we prove that Pearson's chi-squared test statistic converges to the normal under quite general conditions. We also propose a new test statistic which is more powerful than chi-squared test statistic based on our simulation study. A real application to lottery data is provided to illustrate our methodology.

Keywords

Cite

@article{arxiv.2112.03231,
  title  = {Pearson's goodness-of-fit tests for sparse distributions},
  author = {Shuhua Chang and Deli Li and Yongcheng Qi},
  journal= {arXiv preprint arXiv:2112.03231},
  year   = {2022}
}

Comments

41 pages