English

Learning mixtures of structured distributions over discrete domains

Machine Learning 2012-10-03 v1 Data Structures and Algorithms Statistics Theory Statistics Theory

Abstract

Let C\mathfrak{C} be a class of probability distributions over the discrete domain [n]={1,...,n}.[n] = \{1,...,n\}. We show that if C\mathfrak{C} satisfies a rather general condition -- essentially, that each distribution in C\mathfrak{C} can be well-approximated by a variable-width histogram with few bins -- then there is a highly efficient (both in terms of running time and sample complexity) algorithm that can learn any mixture of kk unknown distributions from C.\mathfrak{C}. We analyze several natural types of distributions over [n][n], including log-concave, monotone hazard rate and unimodal distributions, and show that they have the required structural property of being well-approximated by a histogram with few bins. Applying our general algorithm, we obtain near-optimally efficient algorithms for all these mixture learning problems.

Keywords

Cite

@article{arxiv.1210.0864,
  title  = {Learning mixtures of structured distributions over discrete domains},
  author = {Siu-on Chan and Ilias Diakonikolas and Rocco A. Servedio and Xiaorui Sun},
  journal= {arXiv preprint arXiv:1210.0864},
  year   = {2012}
}

Comments

preliminary full version of soda'13 paper