English

Optimal rates for independence testing via $U$-statistic permutation tests

Statistics Theory 2020-11-09 v2 Methodology Machine Learning Statistics Theory

Abstract

We study the problem of independence testing given independent and identically distributed pairs taking values in a σ\sigma-finite, separable measure space. Defining a natural measure of dependence D(f)D(f) as the squared L2L^2-distance between a joint density ff and the product of its marginals, we first show that there is no valid test of independence that is uniformly consistent against alternatives of the form {f:D(f)ρ2}\{f: D(f) \geq \rho^2 \}. We therefore restrict attention to alternatives that impose additional Sobolev-type smoothness constraints, and define a permutation test based on a basis expansion and a UU-statistic estimator of D(f)D(f) that we prove is minimax optimal in terms of its separation rates in many instances. Finally, for the case of a Fourier basis on [0,1]2[0,1]^2, we provide an approximation to the power function that offers several additional insights. Our methodology is implemented in the R package USP.

Keywords

Cite

@article{arxiv.2001.05513,
  title  = {Optimal rates for independence testing via $U$-statistic permutation tests},
  author = {Thomas B. Berrett and Ioannis Kontoyiannis and Richard J. Samworth},
  journal= {arXiv preprint arXiv:2001.05513},
  year   = {2020}
}

Comments

58 pages, 4 figures

R2 v1 2026-06-23T13:12:21.315Z