English

Long run consequence of p-hacking

Theoretical Economics 2024-04-16 v1

Abstract

We study the theoretical consequence of p-hacking on the accumulation of knowledge under the framework of mis-specified Bayesian learning. A sequence of researchers, in turn, choose projects that generate noisy information in a field. In choosing projects, researchers need to carefully balance as projects generates big information are less likely to succeed. In doing the project, a researcher p-hacks at intensity ε\varepsilon so that the success probability of a chosen project increases (unduly) by a constant ε\varepsilon. In interpreting previous results, researcher behaves as if there is no p-hacking because the intensity ε\varepsilon is unknown and presumably small. We show that over-incentivizing information provision leads to the failure of learning as long as ε0\varepsilon\neq 0. If the incentives of information provision is properly provided, learning is correct almost surely as long as ε\varepsilon is small.

Keywords

Cite

@article{arxiv.2404.08984,
  title  = {Long run consequence of p-hacking},
  author = {Xuanye Wang},
  journal= {arXiv preprint arXiv:2404.08984},
  year   = {2024}
}
R2 v1 2026-06-28T15:53:18.973Z