English

Testing Halfspaces over Rotation-Invariant Distributions

Data Structures and Algorithms 2018-11-02 v1 Machine Learning

Abstract

We present an algorithm for testing halfspaces over arbitrary, unknown rotation-invariant distributions. Using O~(nϵ7)\tilde O(\sqrt{n}\epsilon^{-7}) random examples of an unknown function ff, the algorithm determines with high probability whether ff is of the form f(x)=sign(iwixit)f(x) = sign(\sum_i w_ix_i-t) or is ϵ\epsilon-far from all such functions. This sample size is significantly smaller than the well-known requirement of Ω(n)\Omega(n) samples for learning halfspaces, and known lower bounds imply that our sample size is optimal (in its dependence on nn) up to logarithmic factors. The algorithm is distribution-free in the sense that it requires no knowledge of the distribution aside from the promise of rotation invariance. To prove the correctness of this algorithm we present a theorem relating the distance between a function and a halfspace to the distance between their centers of mass, that applies to arbitrary distributions.

Keywords

Cite

@article{arxiv.1811.00139,
  title  = {Testing Halfspaces over Rotation-Invariant Distributions},
  author = {Nathaniel Harms},
  journal= {arXiv preprint arXiv:1811.00139},
  year   = {2018}
}

Comments

36 pages, 2 figures, to appear in SODA 2019

R2 v1 2026-06-23T04:59:52.896Z