English

Distributed Partial Clustering

Data Structures and Algorithms 2017-06-06 v3

Abstract

Recent years have witnessed an increasing popularity of algorithm design for distributed data, largely due to the fact that massive datasets are often collected and stored in different locations. In the distributed setting communication typically dominates the query processing time. Thus it becomes crucial to design communication efficient algorithms for queries on distributed data. Simultaneously, it has been widely recognized that partial optimizations, where we are allowed to disregard a small part of the data, provide us significantly better solutions. The motivation for disregarded points often arise from noise and other phenomena that are pervasive in large data scenarios. In this paper we focus on partial clustering problems, kk-center, kk-median and kk-means, in the distributed model, and provide algorithms with communication sublinear of the input size. As a consequence we develop the first algorithms for the partial kk-median and means objectives that run in subquadratic running time. We also initiate the study of distributed algorithms for clustering uncertain data, where each data point can possibly fall into multiple locations under certain probability distribution.

Keywords

Cite

@article{arxiv.1703.01539,
  title  = {Distributed Partial Clustering},
  author = {Sudipto Guha and Yi Li and Qin Zhang},
  journal= {arXiv preprint arXiv:1703.01539},
  year   = {2017}
}

Comments

A preliminary version is to appear in the Proceedings of SPAA 2017