English

Directional replicability: when can the factor of two be omitted

Methodology 2026-02-04 v1

Abstract

Directional replicability addresses the question of whether an effect studied across nn independent studies is present with the same direction in at least rr of them, for r2r \geq 2. When the expected direction of the effect is not specified in advance, the state of the art recommends assessing replicability separately by combining one-sided pp-values for both directions (left and right), and then doubling the smaller of the two resulting combined pp-values to account for multiple testing. In this work, we show that this multiplicative correction is not always necessary, and give conditions under which it can be safely omitted.

Keywords

Cite

@article{arxiv.2510.11273,
  title  = {Directional replicability: when can the factor of two be omitted},
  author = {Vera Djordjilović and Tamar Sofer and Jonathan M. Dreyfuss},
  journal= {arXiv preprint arXiv:2510.11273},
  year   = {2026}
}
R2 v1 2026-07-01T06:33:45.301Z