English
Related papers

Related papers: Spectral graph clustering via the Expectation-Solu…

200 papers

In this paper, we study convergence properties of the gradient Expectation-Maximization algorithm \cite{lange1995gradient} for Gaussian Mixture Models for general number of clusters and mixing coefficients. We derive the convergence rate…

Statistics Theory · Mathematics 2017-12-05 Bowei Yan , Mingzhang Yin , Purnamrita Sarkar

This paper shows that graph spectral embedding using the random walk Laplacian produces vector representations which are completely corrected for node degree. Under a generalised random dot product graph, the embedding provides uniformly…

Methodology · Statistics 2021-05-05 Alexander Modell , Patrick Rubin-Delanchy

The Degree-Corrected Stochastic Block Model (DCSBM) is a popular model to generate random graphs with community structure given an expected degree sequence. The standard approach of community detection based on the DCSBM is to search for…

Social and Information Networks · Computer Science 2021-05-05 Breno Serrano , Thibaut Vidal

Significant progress has been made recently on theoretical analysis of estimators for the stochastic block model (SBM). In this paper, we consider the multi-graph SBM, which serves as a foundation for many application settings including…

Methodology · Statistics 2016-07-11 Qiuyi Han , Kevin S. Xu , Edoardo M. Airoldi

This paper presents a novel spectral algorithm with additive clustering designed to identify overlapping communities in networks. The algorithm is based on geometric properties of the spectrum of the expected adjacency matrix in a random…

Machine Learning · Statistics 2017-11-07 Emilie Kaufmann , Thomas Bonald , Marc Lelarge

Graph clustering is a fundamental task in unsupervised learning with broad real-world applications. While spectral clustering methods for undirected graphs are well-established and guided by a minimum cut optimization consensus, their…

Machine Learning · Statistics 2025-06-04 Ning Zhang , Xiaowen Dong , Mihai Cucuringu

We study here a Gaussian Mixture Model (GMM) with rare events data. In this case, the commonly used Expectation-Maximization (EM) algorithm exhibits extremely slow numerical convergence rate. To theoretically understand this phenomenon, we…

Methodology · Statistics 2024-05-28 Xuetong Li , Jing Zhou , Hansheng Wang

Finite mixtures of skew distributions provide a flexible tool for modelling heterogeneous data with asymmetric distributional features. However, parameter estimation via the Expectation-Maximization (EM) algorithm can become very…

Computation · Statistics 2016-08-10 Sharon X Lee , Kaleb L Leemaqz , Geoffrey J McLachlan

Data clustering has received a lot of attention and numerous methods, algorithms and software packages are available. Among these techniques, parametric finite-mixture models play a central role due to their interesting mathematical…

Computer Vision and Pattern Recognition · Computer Science 2017-01-31 Israel D. Gebru , Xavier Alameda-Pineda , Florence Forbes , Radu Horaud

In this work, we propose an original method for aggregating multiple clustering coming from different sources of information. Each partition is encoded by a co-membership matrix between observations. Our approach uses a mixture of…

Machine Learning · Computer Science 2024-01-10 Kylliann De Santiago , Marie Szafranski , Christophe Ambroise

We study the gradient Expectation-Maximization (EM) algorithm for Gaussian Mixture Models (GMM) in the over-parameterized setting, where a general GMM with $n>1$ components learns from data that are generated by a single ground truth…

Machine Learning · Computer Science 2025-06-03 Weihang Xu , Maryam Fazel , Simon S. Du

The contextual stochastic block model (cSBM) was proposed for unsupervised community detection on attributed graphs where both the graph and the high-dimensional node information correlate with node labels. In the context of machine…

Social and Information Networks · Computer Science 2024-07-22 O. Duranthon , L. Zdeborová

The stochastic block model (SBM) is a random graph model in which the edges are generated according to the underlying cluster structure on the vertices. The (ferromagnetic) Ising model, on the other hand, assigns $\pm 1$ labels to vertices…

Probability · Mathematics 2020-10-15 Min Ye

We systematically study various network Expectation-Maximization (EM) algorithms for the Gaussian mixture model within the framework of decentralized federated learning. Our theoretical investigation reveals that directly extending the…

Machine Learning · Statistics 2024-11-11 Shuyuan Wu , Bin Du , Xuetong Li , Hansheng Wang

This paper considers a joint multi-graph inference and clustering problem for simultaneous inference of node centrality and association of graph signals with their graphs. We study a mixture model of filtered low pass graph signals with…

Machine Learning · Statistics 2023-02-15 Yiran He , Hoi-To Wai

Stochastic Block Models (SBMs) are a popular approach to modeling single real-world graphs. The key idea of SBMs is to partition the vertices of the graph into blocks with similar edge densities within, as well as between different blocks.…

Social and Information Networks · Computer Science 2024-12-23 Iiro Kumpulainen , Sebastian Dalleiger , Jilles Vreeken , Nikolaj Tatti

This paper proposes a novel scalable community-based neural framework for graph learning. The framework learns the graph topology through the task of community detection and link prediction by optimizing with our proposed joint SBM loss…

Social and Information Networks · Computer Science 2020-05-19 Zheng Chen , Xinli Yu , Yuan Ling , Xiaohua Hu

We recently proposed a new ensemble clustering algorithm for graphs (ECG) based on the concept of consensus clustering. We validated our approach by replicating a study comparing graph clustering algorithms over benchmark graphs, showing…

Machine Learning · Computer Science 2021-02-17 Valérie Poulin , François Théberge

Directed graphs have asymmetric connections, yet the current graph clustering methodologies cannot identify the potentially global structure of these asymmetries. We give a spectral algorithm called di-sim that builds on a dual measure of…

Machine Learning · Statistics 2015-01-09 Karl Rohe , Tai Qin , Bin Yu

Spectral embedding of network adjacency matrices often produces node representations living approximately around low-dimensional submanifold structures. In particular, hidden substructure is expected to arise when the graph is generated…

Machine Learning · Statistics 2022-06-27 Francesco Sanna Passino , Nicholas A. Heard