English

Universality of scholarly impact metrics

Digital Libraries 2013-10-23 v2 Social and Information Networks Physics and Society

Abstract

Given the growing use of impact metrics in the evaluation of scholars, journals, academic institutions, and even countries, there is a critical need for means to compare scientific impact across disciplinary boundaries. Unfortunately, citation-based metrics are strongly biased by diverse field sizes and publication and citation practices. As a result, we have witnessed an explosion in the number of newly proposed metrics that claim to be "universal." However, there is currently no way to objectively assess whether a normalized metric can actually compensate for disciplinary bias. We introduce a new method to assess the universality of any scholarly impact metric, and apply it to evaluate a number of established metrics. We also define a very simple new metric hs, which proves to be universal, thus allowing to compare the impact of scholars across scientific disciplines. These results move us closer to a formal methodology in the measure of scholarly impact.

Keywords

Cite

@article{arxiv.1305.6339,
  title  = {Universality of scholarly impact metrics},
  author = {Jasleen Kaur and Filippo Radicchi and Filippo Menczer},
  journal= {arXiv preprint arXiv:1305.6339},
  year   = {2013}
}

Comments

Accepted in Journal of Informetrics