English

On Large-Scale Multiple Testing Over Networks: An Asymptotic Approach

Methodology 2024-03-19 v4 Machine Learning Systems and Control Signal Processing Systems and Control

Abstract

This work concerns developing communication- and computation-efficient methods for large-scale multiple testing over networks, which is of interest to many practical applications. We take an asymptotic approach and propose two methods, proportion-matching and greedy aggregation, tailored to distributed settings. The proportion-matching method achieves the global BH performance yet only requires a one-shot communication of the (estimated) proportion of true null hypotheses as well as the number of p-values at each node. By focusing on the asymptotic optimal power, we go beyond the BH procedure by providing an explicit characterization of the asymptotic optimal solution. This leads to the greedy aggregation method that effectively approximates the optimal rejection regions at each node, while computation efficiency comes from the greedy-type approach naturally. Moreover, for both methods, we provide the rate of convergence for both the FDR and power. Extensive numerical results over a variety of challenging settings are provided to support our theoretical findings.

Keywords

Cite

@article{arxiv.2211.16059,
  title  = {On Large-Scale Multiple Testing Over Networks: An Asymptotic Approach},
  author = {Mehrdad Pournaderi and Yu Xiang},
  journal= {arXiv preprint arXiv:2211.16059},
  year   = {2024}
}

Comments

Published in the IEEE Transactions on Signal and Information Processing over Networks

R2 v1 2026-06-28T07:16:29.355Z