English
Related papers

Related papers: Adjusted chi-square test for degree-corrected bloc…

200 papers

This is the first of two complementary works in which we analyze the connected components of the degree-corrected stochastic block model (DCSBM). Our model is a random graph with an underlying community structure and degree in-homogeneity.…

Probability · Mathematics 2024-09-30 David Clancy , Vitalii Konarovskyi , Vlada Limic

The Degree-Corrected Stochastic Block Model (DCSBM) is a popular model to generate random graphs with community structure given an expected degree sequence. The standard approach of community detection based on the DCSBM is to search for…

Social and Information Networks · Computer Science 2021-05-05 Breno Serrano , Thibaut Vidal

For community detection problem, spectral clustering is a widely used method for detecting clusters in networks. In this paper, we propose an improved spectral clustering (ISC) approach under the degree corrected stochastic block model…

Machine Learning · Statistics 2020-11-13 Huan Qing , Jingli Wang

We consider the goodness-of-fit testing problem of distinguishing whether the data are drawn from a specified distribution, versus a composite alternative separated from the null in the total variation metric. In the discrete case, we…

Statistics Theory · Mathematics 2017-07-03 Sivaraman Balakrishnan , Larry Wasserman

Pearson's chi-squared test is widely used to test the goodness of fit between categorical data and a given discrete distribution function. When the number of sets of the categorical data, say $k$, is a fixed integer, Pearson's chi-squared…

Methodology · Statistics 2022-01-03 Shuhua Chang , Deli Li , Yongcheng Qi

Community detection in large social networks is affected by degree heterogeneity of nodes. The D-SCORE algorithm for directed networks was introduced to reduce this effect by taking the element-wise ratios of the singular vectors of the…

Machine Learning · Statistics 2021-06-01 Zhe Wang , Yingbin Liang , Pengsheng Ji

Distance correlation has gained much recent attention in the data science community: the sample statistic is straightforward to compute and asymptotically equals zero if and only if independence, making it an ideal choice to discover any…

Machine Learning · Statistics 2024-06-27 Cencheng Shen , Sambit Panda , Joshua T. Vogelstein

Community detection is a central problem of network data analysis. Given a network, the goal of community detection is to partition the network nodes into a small number of clusters, which could often help reveal interesting structures. The…

Statistics Theory · Mathematics 2016-07-26 Chao Gao , Zongming Ma , Anderson Y. Zhang , Harrison H. Zhou

The objective of goodness-of-fit testing is to assess whether a dataset of observations is likely to have been drawn from a candidate probability distribution. This paper presents a rank-based family of goodness-of-fit tests that is…

Statistics Theory · Mathematics 2019-04-18 Feras A. Saad , Cameron E. Freer , Nathanael L. Ackerman , Vikash K. Mansinghka

We consider community detection in Degree-Corrected Stochastic Block Models (DC-SBM). We propose a spectral clustering algorithm based on a suitably normalized adjacency matrix. We show that this algorithm consistently recovers the…

Probability · Mathematics 2017-02-09 Lennart Gulikers , Marc Lelarge , Laurent Massoulié

This paper considers the problem of modeling and estimating community memberships of nodes in a directed network where every row (column) node is associated with a vector determining its membership in each row (column) community. To model…

Machine Learning · Statistics 2021-11-01 Huan Qing

In this paper we consider the uniformity testing problem for high-dimensional discrete distributions (multinomials) under sparse alternatives. More precisely, we derive sharp detection thresholds for testing, based on $n$ samples, whether a…

Statistics Theory · Mathematics 2022-02-17 Bhaswar B. Bhattacharya , Rajarshi Mukherjee

New phase transition phenomena have recently been discovered for the stochastic block model, for the special case of two non-overlapping symmetric communities. This gives raise in particular to new algorithmic challenges driven by the…

Probability · Mathematics 2015-04-07 Emmanuel Abbe , Colin Sandon

Mixed membership problem for undirected network has been well studied in network analysis recent years. However, the more general case of mixed membership for directed network in which nodes can belong to multiple communities remains a…

Machine Learning · Statistics 2022-09-14 Huan Qing , Jingli Wang

We study the problem of community recovery and detection in multi-layer stochastic block models, focusing on the critical network density threshold for consistent community structure inference. Using a prototypical two-block model, we…

Statistics Theory · Mathematics 2023-11-15 Jing Lei , Anru R. Zhang , Zihan Zhu

The stochastic block model is able to generate different network partitions, ranging from traditional assortative communities to disassortative structures. Since the degree-corrected stochastic block model does not specify which mixing…

Social and Information Networks · Computer Science 2019-09-16 Xiaoyan Lu , Boleslaw K. Szymanski

In applications of group testing in networks, e.g. identifying individuals who are infected by a disease spread over a network, exploiting correlation among network nodes provides fundamental opportunities in reducing the number of tests…

Information Theory · Computer Science 2023-03-21 Hesam Nikpey , Jungyeol Kim , Xingran Chen , Saswati Sarkar , Shirin Saeedi Bidokhti

We propose a simple test for moment inequalities that has exact size in normal models with known variance and has uniformly asymptotically exact size more generally. The test compares the quasi-likelihood ratio statistic to a chi-squared…

Econometrics · Economics 2020-08-19 Gregory Cox , Xiaoxia Shi

A valued stochastic blockmodel (SBM) is a general way to view networked data in which nodes are grouped into blocks and links between them are measured by counts or labels. This family allows for varying dyad sampling schemes, thereby…

We consider the problem of evaluating dynamic consistency in discrete time probabilistic filters that approximate stochastic system state densities with Gaussian mixtures. Dynamic consistency means that the estimated probability…

Methodology · Statistics 2024-03-18 Nisar Ahmed , Luke Burks , Kailah Cabral , Alyssa Bekai Rose