English

Hypothesis Testing of One-Sample Mean Vector in Distributed Frameworks

Methodology 2021-10-07 v1

Abstract

Distributed frameworks are widely used to handle massive data, where sample size nn is very large, and data are often stored in kk different machines. For a random vector XRpX\in \mathbb{R}^p with expectation μ\mu, testing the mean vector H0:μ=μ0H_0: \mu=\mu_0 vs H1:μμ0H_1: \mu\ne \mu_0 for a given vector μ0\mu_0 is a basic problem in statistics. The centralized test statistics require heavy communication costs, which can be a burden when pp or kk is large. To reduce the communication cost, distributed test statistics are proposed in this paper for this problem based on the divide and conquer technique, a commonly used approach for distributed statistical inference. Specifically, we extend two commonly used centralized test statistics to the distributed ones, that apply to low and high dimensional cases, respectively. Comparing the power of centralized test statistics and the distributed ones, it is observed that there is a fundamental tradeoff between communication costs and the powers of the tests. This is quite different from the application of the divide and conquer technique in many other problems such as estimation, where the associated distributed statistics can be as good as the centralized ones. Numerical results confirm the theoretical findings.

Keywords

Cite

@article{arxiv.2110.02588,
  title  = {Hypothesis Testing of One-Sample Mean Vector in Distributed Frameworks},
  author = {Bin Du and Junlong Zhao},
  journal= {arXiv preprint arXiv:2110.02588},
  year   = {2021}
}
R2 v1 2026-06-24T06:39:43.964Z