English
Related papers

Related papers: Model based clustering of multinomial count data

200 papers

Finite mixture models have become a popular tool for clustering. Amongst other uses, they have been applied for clustering longitudinal data and clustering high-dimensional data. In the latter case, a latent Gaussian mixture model is…

Methodology · Statistics 2018-04-17 Vanessa S. E. Bierling , Paul D. McNicholas

In recent years, there has been a growing demand to discern clusters of subjects in datasets characterized by a large set of features. Often, these clusters may be highly variable in size and present partial hierarchical structures. In this…

Methodology · Statistics 2024-07-01 Lorenzo Schiavon , Mattia Stival

In this paper, we first study the fundamental limit of clustering networks when a multi-layer network is present. Under the mixture multi-layer stochastic block model (MMSBM), we show that the minimax optimal network clustering error rate,…

Statistics Theory · Mathematics 2023-11-28 Zhongyuan Lyu , Ting Li , Dong Xia

Unsupervised learning, and more specifically clustering, suffers from the need for expertise in the field to be of use. Researchers must make careful and informed decisions on which algorithm to use with which set of hyperparameters for a…

Machine Learning · Computer Science 2021-12-28 Antoine Zambelli

Mixture models provide a flexible representation of heterogeneity in a finite number of latent classes. From the Bayesian point of view, Markov Chain Monte Carlo methods provide a way to draw inferences from these models. In particular,…

Methodology · Statistics 2020-05-06 Carolina Valani Cavalcante , Kelly Cristina Mota Gonçalves

Clustering is a widely used technique with a long and rich history in a variety of areas. However, most existing algorithms do not scale well to large datasets, or are missing theoretical guarantees of convergence. This paper introduces a…

Machine Learning · Statistics 2024-10-16 Yijia Zhou , Kyle A. Gallivan , Adrian Barbu

Multivariate normal mixtures provide a flexible model for high-dimensional data. They are widely used in statistical genetics, statistical finance, and other disciplines. Due to the unboundedness of the likelihood function, classical…

Statistics Theory · Mathematics 2008-05-27 Jiahua Chen , Xianming Tan

Choosing appropriate hyperparameters for unsupervised clustering algorithms in an optimal way depending on the problem under study is a long standing challenge, which we tackle while adapting clustering algorithms for immune disorder…

Quantitative Methods · Quantitative Biology 2020-09-25 A. Carpio , A. Simón , L. F. Villa

We address the problem of data clustering by introducing an unsupervised, parameter free approach based on maximum likelihood principle. Starting from the observation that data sets belonging to the same cluster share a common information,…

Statistical Mechanics · Physics 2009-11-07 Lorenzo Giada , Matteo Marsili

Bayesian nonparametric mixture models are common for modeling complex data. While these models are well-suited for density estimation, recent results proved posterior inconsistency of the number of clusters when the true number of…

Statistics Theory · Mathematics 2024-05-31 Louise Alamichel , Daria Bystrova , Julyan Arbel , Guillaume Kon Kam King

In mixture model-based clustering applications, it is common to fit several models from a family and report clustering results from only the `best' one. In such circumstances, selection of this best model is achieved using a model selection…

Methodology · Statistics 2017-10-09 Yuhong Wei , Paul D. McNicholas

In this paper, a scale mixture of Normal distributions model is developed for classification and clustering of data having outliers and missing values. The classification method, based on a mixture model, focuses on the introduction of…

Machine Learning · Statistics 2017-11-23 G. Revillon , A. Djafari , C. Enderli

While several Gaussian mixture models-based biclustering approaches currently exist in the literature for continuous data, approaches to handle discrete data have not been well researched. A multivariate Poisson-lognormal (MPLN) model-based…

Methodology · Statistics 2025-03-13 Caitlin Kral , Evan Chance , Ryan Browne , Sanjeena Subedi

We develop clustering procedures for longitudinal trajectories based on a continuous-time hidden Markov model (CTHMM) and a generalized linear observation model. Specifically in this paper, we carry out finite and infinite mixture…

Methodology · Statistics 2021-12-08 Yu Luo , David A. Stephens , David L. Buckeridge

As in other estimation scenarios, likelihood based estimation in the normal mixture set-up is highly non-robust against model misspecification and presence of outliers (apart from being an ill-posed optimization problem). A robust…

Methodology · Statistics 2023-12-20 Soumya Chakraborty , Ayanendranath Basu , Abhik Ghosh

In online clustering problems, there is often a large amount of uncertainty over possible cluster assignments that cannot be resolved until more data are observed. This difficulty is compounded when clusters follow complex distributions, as…

Machine Learning · Statistics 2026-04-17 Connie Trojan , Pavel Myshkov , Paul Fearnhead , James Hensman , Tom Minka , Christopher Nemeth

This paper is concerned with an important issue in finite mixture modelling, the selection of the number of mixing components. We propose a new penalized likelihood method for model selection of finite multivariate Gaussian mixture models.…

Methodology · Statistics 2013-01-17 Tao Huang , Heng Peng , Kun Zhang

As a kind of basic machine learning method, clustering algorithms group data points into different categories based on their similarity or distribution. We present a clustering algorithm by finding hyper-planes to distinguish the data…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Luhong Diao , Jinying Gao1 , Manman Deng

We consider an extension of model-based clustering to the semi-supervised case, where some of the data are pre-labeled. We provide a derivation of the Bayesian Information Criterion (BIC) approximation to the Bayes factor in this setting.…

Methodology · Statistics 2016-04-28 Jordan Yoder , Carey E. Priebe

The hidden Markov model (HMM) is a generative model that treats sequential data under the assumption that each observation is conditioned on the state of a discrete hidden variable that evolves in time as a Markov chain. In this paper, we…

Artificial Intelligence · Computer Science 2011-09-07 Emanuele Coviello , Antoni B. Chan , Gert R. G. Lanckriet