English

Large-Scale Multiple Hypothesis Testing with the Normal-Beta Prime Prior

Methodology 2020-07-29 v4

Abstract

We revisit the problem of simultaneously testing the means of nn independent normal observations under sparsity. We take a Bayesian approach to this problem by introducing a scale-mixture prior known as the normal-beta prime (NBP) prior. We first derive new concentration properties when the beta prime density is employed for a scale parameter in Bayesian hierarchical models. To detect signals in our data, we then propose a hypothesis test based on thresholding the posterior shrinkage weight under the NBP prior. Taking the loss function to be the expected number of misclassified tests, we show that our test procedure asymptotically attains the optimal Bayes risk when the signal proportion pp is known. When pp is unknown, we introduce an empirical Bayes variant of our test which also asymptotically attains the Bayes Oracle risk in the entire range of sparsity parameters pnϵ,ϵ(0,1)p \propto n^{-\epsilon}, \epsilon \in (0, 1). Finally, we also consider restricted marginal maximum likelihood (REML) and hierarchical Bayes approaches for estimating a key hyperparameter in the NBP prior and examine multiple testing under these frameworks.

Keywords

Cite

@article{arxiv.1807.02421,
  title  = {Large-Scale Multiple Hypothesis Testing with the Normal-Beta Prime Prior},
  author = {Ray Bai and Malay Ghosh},
  journal= {arXiv preprint arXiv:1807.02421},
  year   = {2020}
}

Comments

39 pages, 6 figures, 1 table. New Section (Section 5.3) was added with new figures for mean squared error and false discovery rate (FDR). arXiv admin note: text overlap with arXiv:1710.04369

R2 v1 2026-06-23T02:53:00.137Z