English

Private High-Dimensional Hypothesis Testing

Data Structures and Algorithms 2022-07-26 v2 Cryptography and Security Information Theory Machine Learning math.IT Statistics Theory Statistics Theory

Abstract

We provide improved differentially private algorithms for identity testing of high-dimensional distributions. Specifically, for dd-dimensional Gaussian distributions with known covariance Σ\Sigma, we can test whether the distribution comes from N(μ,Σ)\mathcal{N}(\mu^*, \Sigma) for some fixed μ\mu^* or from some N(μ,Σ)\mathcal{N}(\mu, \Sigma) with total variation distance at least α\alpha from N(μ,Σ)\mathcal{N}(\mu^*, \Sigma) with (ε,0)(\varepsilon, 0)-differential privacy, using only O~(d1/2α2+d1/3α4/3ε2/3+1αε)\tilde{O}\left(\frac{d^{1/2}}{\alpha^2} + \frac{d^{1/3}}{\alpha^{4/3} \cdot \varepsilon^{2/3}} + \frac{1}{\alpha \cdot \varepsilon}\right) samples if the algorithm is allowed to be computationally inefficient, and only O~(d1/2α2+d1/4αε)\tilde{O}\left(\frac{d^{1/2}}{\alpha^2} + \frac{d^{1/4}}{\alpha \cdot \varepsilon}\right) samples for a computationally efficient algorithm. We also provide a matching lower bound showing that our computationally inefficient algorithm has optimal sample complexity. We also extend our algorithms to various related problems, including mean testing of Gaussians with bounded but unknown covariance, uniformity testing of product distributions over {1,1}d\{-1, 1\}^d, and tolerant testing. Our results improve over the previous best work of Canonne et al.~\cite{CanonneKMUZ20} for both computationally efficient and inefficient algorithms, and even our computationally efficient algorithm matches the optimal \emph{non-private} sample complexity of O(dα2)O\left(\frac{\sqrt{d}}{\alpha^2}\right) in many standard parameter settings. In addition, our results show that, surprisingly, private identity testing of dd-dimensional Gaussians can be done with fewer samples than private identity testing of discrete distributions over a domain of size dd \cite{AcharyaSZ18}, which refutes a conjectured lower bound of~\cite{CanonneKMUZ20}.

Keywords

Cite

@article{arxiv.2203.01537,
  title  = {Private High-Dimensional Hypothesis Testing},
  author = {Shyam Narayanan},
  journal= {arXiv preprint arXiv:2203.01537},
  year   = {2022}
}

Comments

48 pages. Published in Conference on Learning Theory (COLT), 2022

R2 v1 2026-06-24T10:00:18.772Z