English

How Hard Is Robust Mean Estimation?

Computational Complexity 2019-06-05 v2 Data Structures and Algorithms Statistics Theory Statistics Theory

Abstract

Robust mean estimation is the problem of estimating the mean μRd\mu \in \mathbb{R}^d of a dd-dimensional distribution DD from a list of independent samples, an ϵ\epsilon-fraction of which have been arbitrarily corrupted by a malicious adversary. Recent algorithmic progress has resulted in the first polynomial-time algorithms which achieve \emph{dimension-independent} rates of error: for instance, if DD has covariance II, in polynomial-time one may find μ^\hat{\mu} with μμ^O(ϵ)\|\mu - \hat{\mu}\| \leq O(\sqrt{\epsilon}). However, error rates achieved by current polynomial-time algorithms, while dimension-independent, are sub-optimal in many natural settings, such as when DD is sub-Gaussian, or has bounded 44-th moments. In this work we give worst-case complexity-theoretic evidence that improving on the error rates of current polynomial-time algorithms for robust mean estimation may be computationally intractable in natural settings. We show that several natural approaches to improving error rates of current polynomial-time robust mean estimation algorithms would imply efficient algorithms for the small-set expansion problem, refuting Raghavendra and Steurer's small-set expansion hypothesis (so long as PNPP \neq NP). We also give the first direct reduction to the robust mean estimation problem, starting from a plausible but nonstandard variant of the small-set expansion problem.

Keywords

Cite

@article{arxiv.1903.07870,
  title  = {How Hard Is Robust Mean Estimation?},
  author = {Samuel B. Hopkins and Jerry Li},
  journal= {arXiv preprint arXiv:1903.07870},
  year   = {2019}
}

Comments

Conference on Learning Theory (COLT) 2019

R2 v1 2026-06-23T08:12:30.431Z