English

Learning Mixtures of Permutations: Groups of Pairwise Comparisons and Combinatorial Method of Moments

Statistics Theory 2022-03-07 v2 Data Structures and Algorithms Machine Learning Machine Learning Statistics Theory

Abstract

In applications such as rank aggregation, mixture models for permutations are frequently used when the population exhibits heterogeneity. In this work, we study the widely used Mallows mixture model. In the high-dimensional setting, we propose a polynomial-time algorithm that learns a Mallows mixture of permutations on nn elements with the optimal sample complexity that is proportional to logn\log n, improving upon previous results that scale polynomially with nn. In the high-noise regime, we characterize the optimal dependency of the sample complexity on the noise parameter. Both objectives are accomplished by first studying demixing permutations under a noiseless query model using groups of pairwise comparisons, which can be viewed as moments of the mixing distribution, and then extending these results to the noisy Mallows model by simulating the noiseless oracle.

Keywords

Cite

@article{arxiv.2009.06784,
  title  = {Learning Mixtures of Permutations: Groups of Pairwise Comparisons and Combinatorial Method of Moments},
  author = {Cheng Mao and Yihong Wu},
  journal= {arXiv preprint arXiv:2009.06784},
  year   = {2022}
}

Comments

55 pages, 1 figure