English
Related papers

Related papers: Bad local minima exist in the stochastic block mod…

200 papers

We study the stochastic block model with two communities where vertices contain side information in the form of a vertex label. These vertex labels may have arbitrary label distributions, depending on the community memberships. We analyze a…

Machine Learning · Statistics 2019-05-24 Clara Stegehuis , Laurent Massoulié

The problem of finding overlapping communities in networks has gained much attention recently. Optimization-based approaches use non-negative matrix factorization (NMF) or variants, but the global optimum cannot be provably attained in…

Machine Learning · Statistics 2017-06-26 Xueyu Mao , Purnamrita Sarkar , Deepayan Chakrabarti

Bayesian learning in undirected graphical models|computing posterior distributions over parameters and predictive quantities is exceptionally difficult. We conjecture that for general undirected models, there are no tractable MCMC (Markov…

Machine Learning · Computer Science 2012-07-19 Iain Murray , Zoubin Ghahramani

The stochastic block model is one of the oldest and most ubiquitous models for studying clustering and community detection. In an exciting sequence of developments, motivated by deep but non-rigorous ideas from statistical physics, Decelle…

Data Structures and Algorithms · Computer Science 2016-03-23 Ankur Moitra , William Perry , Alexander S. Wein

We propose to estimate the number of communities in degree-corrected stochastic block models based on a pseudo likelihood ratio statistic. To this end, we introduce a method that combines spectral clustering with binary segmentation. This…

Methodology · Statistics 2019-07-31 Shujie Ma , Liangjun Su , Yichong Zhang

Community detection in multi-layer networks has emerged as a crucial area of modern network analysis. However, conventional approaches often assume that nodes belong exclusively to a single community, which fails to capture the complex…

Social and Information Networks · Computer Science 2024-09-13 Huan Qing

Community detection is a fundamental task in graph analysis, with methods often relying on fitting models like the Stochastic Block Model (SBM) to observed networks. While many algorithms can accurately estimate SBM parameters when the…

Machine Learning · Statistics 2025-06-05 Leonardo Martins Bianco , Christine Keribin , Zacharie Naulet

Variable selection techniques have become increasingly popular amongst statisticians due to an increased number of regression and classification applications involving high-dimensional data where we expect some predictors to be unimportant.…

Methodology · Statistics 2010-09-20 Anthony Lee , Francois Caron , Arnaud Doucet , Chris Holmes

We study the problem of community recovery from coarse measurements of a graph. In contrast to the problem of community recovery of a fully observed graph, one often encounters situations when measurements of a graph are made at…

Statistics Theory · Mathematics 2021-03-02 Nafiseh Ghoroghchian , Gautam Dasarathy , Stark C. Draper

This chapter provides a self-contained introduction to the use of Bayesian inference to extract large-scale modular structures from network data, based on the stochastic blockmodel (SBM), as well as its degree-corrected and overlapping…

Machine Learning · Statistics 2023-03-23 Tiago P. Peixoto

We develop new methods based on graph motifs for graph clustering, allowing more efficient detection of communities within networks. We focus on triangles within graphs, but our techniques extend to other clique motifs as well. Our…

Data Structures and Algorithms · Computer Science 2017-02-07 Charalampos Tsourakakis , Jakub Pachocki , Michael Mitzenmacher

Mixture models are probabilistic models aimed at uncovering and representing latent subgroups within a population. In the realm of network data analysis, the latent subgroups of nodes are typically identified by their connectivity…

Methodology · Statistics 2020-05-27 Giacomo De Nicola , Benjamin Sischka , Göran Kauermann

We consider community detection in Degree-Corrected Stochastic Block Models (DC-SBM). We propose a spectral clustering algorithm based on a suitably normalized adjacency matrix. We show that this algorithm consistently recovers the…

Probability · Mathematics 2017-02-09 Lennart Gulikers , Marc Lelarge , Laurent Massoulié

The posterior in probabilistic programs with stochastic support decomposes as a weighted sum of the local posterior distributions associated with each possible program path. We show that making predictions with this full posterior…

Machine Learning · Computer Science 2024-04-15 Tim Reichelt , Luke Ong , Tom Rainforth

In this paper, we introduce a hierarchical extension of the stochastic blockmodel to identify multilevel community structures in networks. We also present a Markov chain Monte Carlo (MCMC) and a variational Bayes algorithm to fit the model…

Methodology · Statistics 2024-10-07 Pedro Regueiro , Abel Rodríguez , Juan Sosa

The stochastic block model (SBM) is a generalization of the Erd\H{o}s--R\'enyi model of random graphs that describes the interaction of a finite number of distinct communities. In sparse Erd\H{o}s--R\'enyi graphs, it is known that a…

Data Structures and Algorithms · Computer Science 2024-03-05 Anna Brandenberger , Byron Chin , Nathan S. Sheffield , Divya Shyamal

Spectral algorithms are classic approaches to clustering and community detection in networks. However, for sparse networks the standard versions of these algorithms are suboptimal, in some cases completely failing to detect communities even…

Social and Information Networks · Computer Science 2014-01-20 Florent Krzakala , Cristopher Moore , Elchanan Mossel , Joe Neeman , Allan Sly , Lenka Zdeborová , Pan Zhang

We analyze the performance of spectral clustering for community extraction in stochastic block models. We show that, under mild conditions, spectral clustering applied to the adjacency matrix of the network can consistently recover hidden…

Statistics Theory · Mathematics 2014-12-31 Jing Lei , Alessandro Rinaldo

In this paper, we proposed a novel two-stage optimization method for network community partition, which is based on inherent network structure information. The introduced optimization approach utilizes the new network centrality measure of…

Social and Information Networks · Computer Science 2019-07-16 Yiguang Bai , Sanyang Liu , Ke Yin , Jing Yuan

We present an asymptotically exact analysis of the problem of detecting communities in sparse random networks. Our results are also applicable to detection of functional modules, partitions, and colorings in noisy planted models. Using a…

Statistical Mechanics · Physics 2011-08-04 Aurelien Decelle , Florent Krzakala , Cristopher Moore , Lenka Zdeborová