English

Reducing over-clustering via the powered Chinese restaurant process

Machine Learning 2018-02-16 v1 Machine Learning

Abstract

Dirichlet process mixture (DPM) models tend to produce many small clusters regardless of whether they are needed to accurately characterize the data - this is particularly true for large data sets. However, interpretability, parsimony, data storage and communication costs all are hampered by having overly many clusters. We propose a powered Chinese restaurant process to limit this kind of problem and penalize over clustering. The method is illustrated using some simulation examples and data with large and small sample size including MNIST and the Old Faithful Geyser data.

Keywords

Cite

@article{arxiv.1802.05392,
  title  = {Reducing over-clustering via the powered Chinese restaurant process},
  author = {Jun Lu and Meng Li and David Dunson},
  journal= {arXiv preprint arXiv:1802.05392},
  year   = {2018}
}
R2 v1 2026-06-23T00:23:04.257Z