English

Bayes Factor Hypothesis Testing in Meta-Analyses: Practical Advantages and Methodological Considerations

Methodology 2026-04-22 v2

Abstract

Bayesian hypothesis testing via Bayes factors offers a principled alternative to classical p-value methods in meta-analysis, particularly suited to its cumulative and sequential nature. Unlike commonly reported p-values for standard null hypothesis significance testing, Bayes factors allow for quantifying support both for and against the existence of an effect, facilitate ongoing evidence monitoring, and maintain coherent long-run behavior as additional studies are incorporated. Recent theoretical developments further show how Bayes factors can flexibly control Type I error rates through connections to e-value theory. Despite these advantages, their use remains limited in the meta-analytic literature. This paper provides a critical overview of their theoretical properties, methodological considerations, such as prior sensitivity, and practical advantages for evidence synthesis. Two illustrative applications are provided: one on statistical learning in individuals with language impairments, and another on seroma incidence following post-operative exercise in breast cancer patients. New tools supporting these methods are available in the open-source R package BFpack.

Keywords

Cite

@article{arxiv.2511.22535,
  title  = {Bayes Factor Hypothesis Testing in Meta-Analyses: Practical Advantages and Methodological Considerations},
  author = {Joris Mulder and Robbie C. M. van Aert},
  journal= {arXiv preprint arXiv:2511.22535},
  year   = {2026}
}

Comments

63 pages, 10 figures

R2 v1 2026-07-01T07:58:11.541Z