English
Related papers

Related papers: When random initializations help: a study of varia…

200 papers

Bayesian neural networks (BNNs) have recently regained a significant amount of attention in the deep learning community due to the development of scalable approximate Bayesian inference techniques. There are several advantages of using a…

Machine Learning · Statistics 2023-05-02 Aliaksandr Hubin , Geir Storvik

The most widely used techniques for community detection in networks, including methods based on modularity, statistical inference, and information theoretic arguments, all work by optimizing objective functions that measure the quality of…

Social and Information Networks · Computer Science 2020-05-13 Maria A. Riolo , M. E. J. Newman

Clustering of single-cell RNA sequencing (scRNA-seq) datasets can give key insights into the biological functions of cells. Therefore, it is not surprising that network-based community detection methods (one of the better clustering…

Methodology · Statistics 2026-02-17 Chetkar Jha , Mingyao Li , Ian Barnett

Variational Bayes methods are popular due to their computational efficiency and adaptability to diverse applications. In specifying the variational family, mean-field classes are commonly used, which enables efficient algorithms such as…

Statistics Theory · Mathematics 2025-11-26 Shitao Fan , Ilsang Ohn , David Dunson , Lizhen Lin

Network attacks have been very prevalent as their rate is growing tremendously. Both organization and individuals are now concerned about their confidentiality, integrity and availability of their critical information which are often…

Machine Learning · Computer Science 2020-08-07 MohammadNoor Injadat , Fadi Salo , Ali Bou Nassif , Aleksander Essex , Abdallah Shami

We study the community detection and recovery problem in partially-labeled stochastic block models (SBM). We develop a fast linearized message-passing algorithm to reconstruct labels for SBM (with $n$ nodes, $k$ blocks, $p,q$ intra and…

Statistics Theory · Mathematics 2016-03-23 T. Tony Cai , Tengyuan Liang , Alexander Rakhlin

A principled approach to characterize the hidden structure of networks is to formulate generative models, and then infer their parameters from data. When the desired structure is composed of modules or "communities", a suitable choice for…

Data Analysis, Statistics and Probability · Physics 2018-08-23 Tiago P. Peixoto

Semidefinite programs have recently been developed for the problem of community detection, which may be viewed as a special case of the stochastic blockmodel. Here, we develop a semidefinite program that can be tailored to other instances…

Statistics Theory · Mathematics 2016-11-17 David Choi

Motivated by multi-subject experiments in neuroimaging studies, we develop a modeling framework for joint community detection in a group of related networks, which can be considered as a sample from a population of networks. The proposed…

Applications · Statistics 2020-03-24 Subhadeep Paul , Yuguo Chen

We exploit the observation that stochastic variational inference (SVI) is a form of annealing and present a modified SVI approach -- applicable to both large and small datasets -- that allows the amount of annealing done by SVI to be tuned.…

Machine Learning · Computer Science 2025-11-17 John Paisley , Ghazal Fazelnia , Brian Barr

Motivated by the connections between collaborative filtering and network clustering, we consider a network-based approach to improving rating prediction in recommender systems. We propose a novel Bipartite Mixed-Membership Stochastic Block…

Methodology · Statistics 2023-05-10 Jie Liu , Zifeng Ye , Kun Chen , Panpan Zhang

In this paper, we consider the community detection problem under either the stochastic block model (SBM) assumption or the degree-correlated stochastic block model (DCSBM) assumption. The modularity maximization formulation for the…

Optimization and Control · Mathematics 2017-08-04 Junyu Zhang , Haoyang Liu , Zaiwen Wen , Shuzhong Zhang

\cite{bickel2009nonparametric} developed a general framework to establish consistency of community detection in stochastic block model (SBM). In most applications of this framework, the community label is discrete. For example, in…

Methodology · Statistics 2017-10-17 Lu Liu , Lili Wang , Qingsong Xu

Most leading implementations of black-box variational inference (BBVI) are based on optimizing a stochastic evidence lower bound (ELBO). But such approaches to BBVI often converge slowly due to the high variance of their gradient estimates…

We propose a new hierarchy of semidefinite programming relaxations for inference problems. As test cases, we consider the problem of community detection in block models. The vertices are partitioned into $k$ communities, and a graph is…

Data Structures and Algorithms · Computer Science 2020-09-22 Jess Banks , Sidhanth Mohanty , Prasad Raghavendra

We propose a general formalism of iterated random functions with semigroup property, under which exact and approximate Bayesian posterior updates can be viewed as specific instances. A convergence theory for iterated random functions is…

Machine Learning · Statistics 2013-11-05 Arash A. Amini , XuanLong Nguyen

One of the core problems of modern statistics is to approximate difficult-to-compute probability densities. This problem is especially important in Bayesian statistics, which frames all inference about unknown quantities as a calculation…

Computation · Statistics 2018-05-11 David M. Blei , Alp Kucukelbir , Jon D. McAuliffe

We propose a novel network generative model extended from the standard stochastic block model by concurrently utilizing observed node-level information and accounting for network-enabled nodal heterogeneity. The proposed model is so…

Methodology · Statistics 2025-11-24 Sydney Louit , Evan Clark , Alexander Gelbard , Niketna Vivek , Jun Yan , Panpan Zhang

Community detection or clustering is a fundamental task in the analysis of network data. Many real networks have a bipartite structure which makes community detection challenging. In this paper, we consider a model which allows for matched…

Social and Information Networks · Computer Science 2017-03-16 Zahra S. Razaee , Arash A. Amini , Jingyi Jessica Li

We give upper and lower bounds on the information-theoretic threshold for community detection in the stochastic block model. Specifically, consider the symmetric stochastic block model with $q$ groups, average degree $d$, and connection…

Probability · Mathematics 2016-07-07 Jess Banks , Cristopher Moore , Joe Neeman , Praneeth Netrapalli