English

Testing for replicability in a follow-up study when the primary study hypotheses are two-sided

Methodology 2015-03-10 v1

Abstract

When testing for replication of results from a primary study with two-sided hypotheses in a follow-up study, we are usually interested in discovering the features with discoveries in the same direction in the two studies. The direction of testing in the follow-up study for each feature can therefore be decided by the primary study. We prove that in this case the methods suggested in Heller, Bogomolov, and Benjamini (2014) for control over false replicability claims are valid. Specifically, we prove that if we input into the procedures in Heller, Bogomolov, and Benjamini (2014) the one-sided p-values in the directions favoured by the primary study, then we achieve directional control over the desired error measure (family-wise error rate or false discovery rate).

Keywords

Cite

@article{arxiv.1503.02278,
  title  = {Testing for replicability in a follow-up study when the primary study hypotheses are two-sided},
  author = {Ruth Heller and Marina Bogomolov and Yoav Benjamini and Tamar Sofer},
  journal= {arXiv preprint arXiv:1503.02278},
  year   = {2015}
}

Comments

arXiv admin note: text overlap with arXiv:1310.0606

R2 v1 2026-06-22T08:46:56.147Z