English

Modelling publication bias and p-hacking

Methodology 2020-02-26 v2 Applications

Abstract

Publication bias and p-hacking are two well-known phenomena that strongly affect the scientific literature and cause severe problems in meta-analyses. Due to these phenomena, the assumptions of meta-analyses are seriously violated and the results of the studies cannot be trusted. While publication bias is almost perfectly captured by the weighting function selection model, p-hacking is much harder to model and no definitive solution has been found yet. In this paper we propose to model both publication bias and p-hacking with selection models. We derive some properties for these models, and we compare them formally and through simulations. Finally, two real data examples are used to show how the models work in practice.

Keywords

Cite

@article{arxiv.1911.12445,
  title  = {Modelling publication bias and p-hacking},
  author = {Jonas Moss and Riccardo De Bin},
  journal= {arXiv preprint arXiv:1911.12445},
  year   = {2020}
}

Comments

21 pager, 6 figures

R2 v1 2026-06-23T12:29:34.530Z