English
Related papers

Related papers: Sharp optimal recovery in the two-component Gaussi…

200 papers

Structural matrix-variate observations routinely arise in diverse fields such as multi-layer network analysis and brain image clustering. While data of this type have been extensively investigated with fruitful outcomes being delivered, the…

Statistics Theory · Mathematics 2022-01-25 Zhongyuan Lyu , Dong Xia

The Expectation-Maximization (EM) algorithm is a widely used method for maximum likelihood estimation in models with latent variables. For estimating mixtures of Gaussians, its iteration can be viewed as a soft version of the k-means…

Machine Learning · Statistics 2017-06-06 Constantinos Daskalakis , Christos Tzamos , Manolis Zampetakis

This paper studies the optimal rate of estimation in a finite Gaussian location mixture model in high dimensions without separation conditions. We assume that the number of components $k$ is bounded and that the centers lie in a ball of…

Statistics Theory · Mathematics 2021-07-27 Natalie Doss , Yihong Wu , Pengkun Yang , Harrison H. Zhou

Clustering high-dimensional data is especially challenging when cluster distributions are heavy tailed and only approximately elliptical. Existing high-dimensional methods are largely built for Gaussian or other light-tailed models, whereas…

Methodology · Statistics 2026-05-12 Long Feng , Dan Zhuang

We study statistical and computational limits of clustering when the means of the centres are sparse and their dimension is possibly much larger than the sample size. Our theoretical analysis focuses on the model $X_i = z_i \theta +…

Statistics Theory · Mathematics 2021-03-23 Matthias Löffler , Alexander S. Wein , Afonso S. Bandeira

Maxima of the linear density field form a point process that can be used to understand the spatial distribution of virialized halos that collapsed from initially overdense regions. However, owing to the peak constraint, clustering…

Cosmology and Nongalactic Astrophysics · Physics 2013-05-30 Vincent Desjacques

We propose and analyze a generic method for community recovery in stochastic block models and degree corrected block models. This approach can exactly recover the hidden communities with high probability when the expected node degrees are…

Machine Learning · Statistics 2019-10-01 Jing Lei , Lingxue Zhu

Community detection in graphs that are generated according to stochastic block models (SBMs) has received much attention lately. In this paper, we focus on the binary symmetric SBM -- in which a graph of $n$ vertices is randomly generated…

Optimization and Control · Mathematics 2021-09-28 Peng Wang , Zirui Zhou , Anthony Man-Cho So

We consider two problems of estimation in high-dimensional Gaussian models. The first problem is that of estimating a linear functional of the means of $n$ independent $p$-dimensional Gaussian vectors, under the assumption that most of…

Statistics Theory · Mathematics 2018-11-12 Olivier Collier , Arnak S. Dalalyan

Latent class models are widely used for identifying unobserved subgroups from multivariate categorical data in social sciences, with binary data as a particularly popular example. However, accurately recovering individual latent class…

Methodology · Statistics 2026-02-25 Zhongyuan Lyu , Yuqi Gu

We investigate the convergence properties of the EM algorithm when applied to overspecified Gaussian mixture models -- that is, when the number of components in the fitted model exceeds that of the true underlying distribution. Focusing on…

Machine Learning · Statistics 2025-06-16 Zhenisbek Assylbekov , Alan Legg , Artur Pak

Model-based clustering defines population level clusters relative to a model that embeds notions of similarity. Algorithms tailored to such models yield estimated clusters with a clear statistical interpretation. We take this view here and…

Methodology · Statistics 2018-12-14 Florentina Bunea , Christophe Giraud , Xi Luo , Martin Royer , Nicolas Verzelen

We consider the problem of clustering data points in high dimensions, i.e. when the number of data points may be much smaller than the number of dimensions. Specifically, we consider a Gaussian mixture model (GMM) with non-spherical…

Statistics Theory · Mathematics 2014-06-10 Martin Azizyan , Aarti Singh , Larry Wasserman

The expectation-maximization (EM) algorithm is an iterative method for finding maximum likelihood estimates when data are incomplete or are treated as being incomplete. The EM algorithm and its variants are commonly used for parameter…

Computation · Statistics 2013-06-26 Ryan P. Browne , Sanjeena Subedi , Paul McNicholas

Partially recorded data are frequently encountered in many applications and usually clustered by first removing incomplete cases or features with missing values, or by imputing missing values, followed by application of a clustering…

Methodology · Statistics 2021-10-20 Emily M. Goren , Ranjan Maitra

We have studied electron correlations in the doped two-dimensional (2D) Hubbard model by using the coupled-cluster method (CCM) to investigate whether or not the method can be applied to correct the independent particle approximations…

Strongly Correlated Electrons · Physics 2009-10-31 Yoshihiro Asai , Hideki Katagiri

We consider the exact recovery problem in the hypergraph stochastic block model (HSBM) with $k$ blocks of equal size. More precisely, we consider a random $d$-uniform hypergraph $H$ with $n$ vertices partitioned into $k$ clusters of size $s…

Machine Learning · Computer Science 2020-08-11 Sam Cole , Yizhe Zhu

In the context of high-dimensional linear regression models, we propose an algorithm of exact support recovery in the setting of noisy compressed sensing where all entries of the design matrix are independent and identically distributed…

Statistics Theory · Mathematics 2019-10-23 Mohamed Ndaoud , Alexandre B. Tsybakov

We study the problem of clustering $T$ trajectories of length $H$, each generated by one of K unknown ergodic Markov chains over a finite state space of size $S$. We derive an instance-dependent, high-probability lower bound on the…

Machine Learning · Statistics 2026-03-18 Junghyun Lee , Yassir Jedra , Alexandre Proutière , Se-Young Yun

The emerging problem of joint community detection and group synchronization, with applications in signal processing and machine learning, has been extensively studied in recent years. Previous research has predominantly focused on a…

Information Theory · Computer Science 2025-06-06 Yifeng Fan , Zhizhen Zhao