English
Related papers

Related papers: Sharp optimal recovery in the two-component Gaussi…

200 papers

Gaussian Mixture Models are a powerful tool in Data Science and Statistics that are mainly used for clustering and density approximation. The task of estimating the model parameters is in practice often solved by the Expectation…

Machine Learning · Statistics 2022-08-25 Lena Sembach , Jan Pablo Burgard , Volker H. Schulz

High-order clustering aims to identify heterogeneous substructures in multiway datasets that arise commonly in neuroimaging, genomics, social network studies, etc. The non-convex and discontinuous nature of this problem pose significant…

Methodology · Statistics 2022-10-11 Rungang Han , Yuetian Luo , Miaoyan Wang , Anru R. Zhang

Principal Component Analysis (PCA) is a powerful tool in statistics and machine learning. While existing study of PCA focuses on the recovery of principal components and their associated eigenvalues, there are few precise characterizations…

Statistics Theory · Mathematics 2022-04-12 Emmanuel Abbe , Jianqing Fan , Kaizheng Wang

The paper presents the algorithm for clustering a dataset by grouping the optimal, from the point of view of the BIC criterion, number of Gaussian clusters into the optimal, from the point of view of their statistical separability,…

Machine Learning · Computer Science 2023-10-31 Oleg I. Berngardt

We investigate the problem of recovering a partially observed high-rank matrix whose columns obey a nonlinear structure such as a union of subspaces, an algebraic variety or grouped in clusters. The recovery problem is formulated as the…

Machine Learning · Statistics 2022-12-12 Florentin Goyens , Coralia Cartis , Armin Eftekhari

Subspace clustering becomes inherently difficult near intersections, where points from different subspaces are barely separated. Most existing theoretical results address this issue by imposing separation or sampling assumptions that limit…

Statistics Theory · Mathematics 2026-04-08 Kalle Alaluusua , Konstantin Avrachenkov , B. R. Vinay Kumar , Lasse Leskelä

The double sparse linear model, which has both group-wise and element-wise sparsity in regression coefficients, has attracted lots of attention recently. This paper establishes the sufficient and necessary relationship between the exact…

Statistics Theory · Mathematics 2025-12-02 Shixiang Liu , Zhifan Li , Yanhang Zhang , Jianxin Yin

Gaussian mixture models are widely used to study clustering problems. These model-based clustering methods require an accurate estimation of the unknown data density by Gaussian mixtures. In Maugis and Michel (2009), a penalized maximum…

Statistics Theory · Mathematics 2015-03-19 Maugis Cathy , Michel Bertrand

We consider the problem of center-based clustering in low-dimensional Euclidean spaces under the perturbation stability assumption. An instance is $\alpha$-stable if the underlying optimal clustering continues to remain optimal even when…

Data Structures and Algorithms · Computer Science 2020-10-01 Pankaj K. Agarwal , Hsien-Chih Chang , Kamesh Munagala , Erin Taylor , Emo Welzl

We study the design of efficient approximation algorithms for the $\ell$-center clustering and minimum-diameter $\ell$-clustering problems in high dimensional Euclidean and Hamming spaces. Our main tool is randomized dimension reduction.…

Data Structures and Algorithms · Computer Science 2025-12-04 Mirosław Kowaluk , Andrzej Lingas , Mia Persson

Clustering is a fundamental technique in data analysis and machine learning, used to group similar data points together. Among various clustering methods, the Minimum Sum-of-Squares Clustering (MSSC) is one of the most widely used. MSSC…

Optimization and Control · Mathematics 2025-10-08 Anna Livia Croella , Veronica Piccialli , Antonio M. Sudoso

We study mixed models with a single grouping factor, where inference about unknown parameters requires optimizing a marginal likelihood defined by an intractable integral. Low-dimensional numerical integration techniques are regularly used…

Methodology · Statistics 2025-01-22 Alex Stringer , Blair Bilodeau , Yanbo Tang

Community detection in hypergraphs is explored. Under a generative hypergraph model called "d-wise hypergraph stochastic block model" (d-hSBM) which naturally extends the Stochastic Block Model from graphs to d-uniform hypergraphs, the…

Information Theory · Computer Science 2018-02-06 I Chien , Chung-Yi Lin , I-Hsiang Wang

We consider a sparse linear regression model Y=X\beta^{*}+W where X has a Gaussian entries, W is the noise vector with mean zero Gaussian entries, and \beta^{*} is a binary vector with support size (sparsity) k. Using a novel conditional…

Machine Learning · Statistics 2019-09-26 David Gamarnik , Ilias Zadik

Finite mixture models are frequently used to uncover latent structures in high-dimensional datasets (e.g.\ identifying clusters of patients in electronic health records). The inference of such structures can be performed in a Bayesian…

In this paper, we study the problem of exact community recovery in the symmetric stochastic block model, where a graph of $n$ vertices is randomly generated by partitioning the vertices into $K \ge 2$ equal-sized communities and then…

Optimization and Control · Mathematics 2021-06-11 Peng Wang , Huikang Liu , Zirui Zhou , Anthony Man-Cho So

We study Bayesian estimation of finite mixture models in a general setup where the number of components is unknown and allowed to grow with the sample size. An assumption on growing number of components is a natural one as the degree of…

Statistics Theory · Mathematics 2022-03-18 Ilsang Ohn , Lizhen Lin

Highly size-asymmetrical fluid mixtures arise in a variety of physical contexts, notably in suspensions of colloidal particles to which much smaller particles have been added in the form of polymers or nanoparticles. Conventional schemes…

Soft Condensed Matter · Physics 2011-01-14 Douglas J. Ashton , Jiwen Liu , Erik Luijten , Nigel B. Wilding

We consider the problem of clustering (or reconstruction) in the stochastic block model, in the regime where the average degree is constant. For the case of two clusters with equal sizes, recent results by Mossel, Neeman and Sly, and by…

Probability · Mathematics 2014-04-28 Joe Neeman , Praneeth Netrapalli

Motivated by community detection, we characterise the spectrum of the non-backtracking matrix $B$ in the Degree-Corrected Stochastic Block Model. Specifically, we consider a random graph on $n$ vertices partitioned into two equal-sized…

Probability · Mathematics 2017-05-19 Lennart Gulikers , Marc Lelarge , Laurent Massoulié