Measures and Mismeasures of Scientific Quality
Physics and Society
2007-05-23 v2 Data Analysis, Statistics and Probability
Abstract
We present a general Bayesian method for quantifying the statistical reliability of one-dimensional measures of scientific quality based on citation data. Two quality measures used in practice -- ``papers per year'' and ``Hirsch's '' -- are shown to lack the accuracy and precision necessary to be useful. The mean, median and maximum number of citations are on the other hand reliable and permit accurate predictions of future author performance on the basis of as few as 50 publications.
Keywords
Cite
@article{arxiv.physics/0512238,
title = {Measures and Mismeasures of Scientific Quality},
author = {Sune Lehmann and Andrew D. Jackson and Benny E. Lautrup},
journal= {arXiv preprint arXiv:physics/0512238},
year = {2007}
}
Comments
5 pages, 1 figure; typos corrected; supporting online material available at www.imm.dtu.dk/~slj/0512238.suppl.pdf