Can the Replication Rate Tell Us About Publication Bias?
General Economics
2022-07-04 v2 Economics
Abstract
A leading explanation for widespread replication failures is publication bias. I show in a simple model of selective publication that, contrary to common perceptions, the replication rate is unaffected by the suppression of insignificant results in the publication process. I show further that the expected replication rate falls below intended power owing to issues with common power calculations. I empirically calibrate a model of selective publication and find that power issues alone can explain the entirety of the gap between the replication rate and intended power in experimental economics. In psychology, these issues explain two-thirds of the gap.
Keywords
Cite
@article{arxiv.2206.15023,
title = {Can the Replication Rate Tell Us About Publication Bias?},
author = {Patrick Vu},
journal= {arXiv preprint arXiv:2206.15023},
year = {2022}
}
Comments
main text (excluding appendix): 19 pages, 2 figures