中文

Sifting data in the real world

数据分析、统计与概率 2009-11-11 v2 天体物理学 高能物理 - 实验 高能物理 - 唯象学

摘要

In the real world, experimental data are rarely, if ever, distributed as a normal (Gaussian) distribution. As an example, a large set of data--such as the cross sections for particle scattering as a function of energy contained in the archives of the Particle Data Group--is a compendium of all published data, and hence, unscreened. Inspection of similar data sets quickly shows that, for many reasons, these data sets have many outliers--points well beyond what is expected from a normal distribution--thus ruling out the use of conventional χ2\chi^2 techniques. This note suggests an adaptive algorithm that allows a phenomenologist to apply to the data sample a sieve whose mesh is coarse enough to let the background fall through, but fine enough to retain the preponderance of the signal, thus sifting the data. A prescription is given for finding a robust estimate of the best-fit model parameters in the presence of a noisy background, together with a robust estimate of the model parameter errors, as well as a determination of the goodness-of-fit of the data to the theoretical hypothesis. Extensive computer simulations are carried out to test the algorithm for both its accuracy and stability under varying background conditions.

关键词

引用

@article{arxiv.physics/0506010,
  title  = {Sifting data in the real world},
  author = {Martin M. Block},
  journal= {arXiv preprint arXiv:physics/0506010},
  year   = {2009}
}

备注

29 pages, 13 figures. Version to appear in Nucl. Instr. & Meth. A