English

Testing Shape Restrictions of Discrete Distributions

Data Structures and Algorithms 2016-01-22 v3 Computational Complexity Probability Statistics Theory Statistics Theory

Abstract

We study the question of testing structured properties (classes) of discrete distributions. Specifically, given sample access to an arbitrary distribution DD over [n][n] and a property P\mathcal{P}, the goal is to distinguish between DPD\in\mathcal{P} and 1(D,P)>ε\ell_1(D,\mathcal{P})>\varepsilon. We develop a general algorithm for this question, which applies to a large range of "shape-constrained" properties, including monotone, log-concave, tt-modal, piecewise-polynomial, and Poisson Binomial distributions. Moreover, for all cases considered, our algorithm has near-optimal sample complexity with regard to the domain size and is computationally efficient. For most of these classes, we provide the first non-trivial tester in the literature. In addition, we also describe a generic method to prove lower bounds for this problem, and use it to show our upper bounds are nearly tight. Finally, we extend some of our techniques to tolerant testing, deriving nearly-tight upper and lower bounds for the corresponding questions.

Keywords

Cite

@article{arxiv.1507.03558,
  title  = {Testing Shape Restrictions of Discrete Distributions},
  author = {Clément L. Canonne and Ilias Diakonikolas and Themis Gouleakis and Ronitt Rubinfeld},
  journal= {arXiv preprint arXiv:1507.03558},
  year   = {2016}
}
R2 v1 2026-06-22T10:10:58.340Z