English

Communication Complexity of Distributed High Dimensional Correlation Testing

Information Theory 2020-05-22 v1 math.IT

Abstract

Two parties observe independent copies of a dd-dimensional vector and a scalar. They seek to test if their data is correlated or not, namely they seek to test if the norm ρ2\|\rho\|_2 of the correlation vector ρ\rho between their observations exceeds τ\tau or is it 00. To that end, they communicate interactively and declare the output of the test. We show that roughly order d/τ2d/\tau^2 bits of communication are sufficient and necessary for resolving the distributed correlation testing problem above. Furthermore, we establish a lower bound of roughly d2/τ2d^2/\tau^2 bits for communication needed for distributed correlation estimation, rendering the estimate-and-test approach suboptimal in communication required for distributed correlation testing. For the one-dimensional case with one-way communication, our bounds are tight even in the constant and provide a precise dependence of communication complexity on the probabilities of error of two types.

Keywords

Cite

@article{arxiv.2005.10571,
  title  = {Communication Complexity of Distributed High Dimensional Correlation Testing},
  author = {K. R. Sahasranand and Himanshu Tyagi},
  journal= {arXiv preprint arXiv:2005.10571},
  year   = {2020}
}

Comments

30 pages, 1 figure

R2 v1 2026-06-23T15:42:45.552Z