English

Downsampling for Testing and Learning in Product Distributions

Data Structures and Algorithms 2021-11-17 v2 Computational Complexity Machine Learning

Abstract

We study distribution-free property testing and learning problems where the unknown probability distribution is a product distribution over Rd\mathbb{R}^d. For many important classes of functions, such as intersections of halfspaces, polynomial threshold functions, convex sets, and kk-alternating functions, the known algorithms either have complexity that depends on the support size of the distribution, or are proven to work only for specific examples of product distributions. We introduce a general method, which we call downsampling, that resolves these issues. Downsampling uses a notion of "rectilinear isoperimetry" for product distributions, which further strengthens the connection between isoperimetry, testing, and learning. Using this technique, we attain new efficient distribution-free algorithms under product distributions on Rd\mathbb{R}^d: 1. A simpler proof for non-adaptive, one-sided monotonicity testing of functions [n]d{0,1}[n]^d \to \{0,1\}, and improved sample complexity for testing monotonicity over unknown product distributions, from O(d7)O(d^7) [Black, Chakrabarty, & Seshadhri, SODA 2020] to O~(d3)\widetilde O(d^3). 2. Polynomial-time agnostic learning algorithms for functions of a constant number of halfspaces, and constant-degree polynomial threshold functions. 3. An exp(O(dlog(dk)))\exp(O(d \log(dk)))-time agnostic learning algorithm, and an exp(O(dlog(dk)))\exp(O(d \log(dk)))-sample tolerant tester, for functions of kk convex sets; and a 2O~(d)2^{\widetilde O(d)} sample-based one-sided tester for convex sets. 4. An exp(O~(kd))\exp(\widetilde O(k \sqrt d))-time agnostic learning algorithm for kk-alternating functions, and a sample-based tolerant tester with the same complexity.

Keywords

Cite

@article{arxiv.2007.07449,
  title  = {Downsampling for Testing and Learning in Product Distributions},
  author = {Nathaniel Harms and Yuichi Yoshida},
  journal= {arXiv preprint arXiv:2007.07449},
  year   = {2021}
}

Comments

48 pages, 1 figure. Updated to include some new results; in particular the monotonicity tester now has 1-sided error

R2 v1 2026-06-23T17:07:43.416Z