English
Related papers

Related papers: Two-sample test of sparse stochastic block models

200 papers

In this paper we consider testing the equality of probability vectors of two independent multinomial distributions in high dimension. The classical chi-square test may have some drawbacks in this case since many of cell counts may be zero…

Statistics Theory · Mathematics 2017-11-16 Amanda Plunkett , Junyong Park

This paper investigates a statistical procedure for testing the equality of two independently estimated covariance matrices when the number of potentially dependent data vectors is large and proportional to the size of the vectors, that is,…

Methodology · Statistics 2020-07-13 Rémy Mariétan , Stephan Morgenthaler

Community structures detection in complex network is important for understanding not only the topological structures of the network, but also the functions of it. Stochastic block model and nonnegative matrix factorization are two widely…

Social and Information Networks · Computer Science 2017-07-11 Zhong-Yuan Zhang , Yujie Gai , Yu-Fei Wang , Hui-Min Cheng , Xin Liu

Community detection in multi-layer networks is a fundamental task in complex network analysis across various areas like social, biological, and computer sciences. However, most existing algorithms assume that the number of communities is…

Methodology · Statistics 2026-02-26 Huan Qing

Community structures represent a crucial aspect of network analysis, and various methods have been developed to identify these communities. However, a common hurdle lies in determining the number of communities K, a parameter that often…

Methodology · Statistics 2024-06-10 Zhixuan Shao , Can M. Le

Two-sample testing is a fundamental problem in statistics. Despite its long history, there has been renewed interest in this problem with the advent of high-dimensional and complex data. Specifically, in the machine learning literature,…

Methodology · Statistics 2019-11-19 Ilmun Kim , Ann B. Lee , Jing Lei

In this paper, we consider testing the homogeneity of risk differences in independent binomial distributions especially when data are sparse. We point out some drawback of existing tests in either controlling a nominal size or obtaining…

Methodology · Statistics 2018-05-31 Junyong Park , Iris Ivy Gauran

The recent success of generative adversarial networks and variational learning suggests training a classifier network may work well in addressing the classical two-sample problem. Network-based tests have the computational advantage that…

Machine Learning · Statistics 2022-06-01 Xiuyuan Cheng , Alexander Cloninger

We construct a procedure to test the stochastic order of two samples of interval-valued data. We propose a test statistic which belongs to U-statistic and derive its asymptotic distribution under the null hypothesis. We compare the…

Methodology · Statistics 2019-12-05 Hyejeong Choi , Johan Lim , Minjung Kwak , Seongoh Park

Network data is prevalent in many contemporary big data applications in which a common interest is to unveil important latent links between different pairs of nodes. Yet a simple fundamental question of how to precisely quantify the…

Methodology · Statistics 2021-08-31 Jianqing Fan , Yingying Fan , Xiao Han , Jinchi Lv

We propose novel methodology for testing equality of model parameters between two high-dimensional populations. The technique is very general and applicable to a wide range of models. The method is based on sample splitting: the data is…

Methodology · Statistics 2013-01-17 Nicolas Städler , Sach Mukherjee

We show posterior convergence for the community structure in the planted bi-section model, for several interesting priors. Examples include where the label on each vertex is iid Bernoulli distributed, with some parameter $r\in(0,1)$. The…

Statistics Theory · Mathematics 2021-08-16 J. van Waaij , B. J. K. Kleijn

Most real-world networks are too large to be measured or studied directly and there is substantial interest in estimating global network properties from smaller sub-samples. One of the most important global properties is the number of…

Machine Learning · Statistics 2016-10-27 Lin Chen , Amin Karbasi , Forrest W. Crawford

The bipartite network appears in various areas, such as biology, sociology, physiology, and computer science. \cite{rohe2016co} proposed Stochastic co-Blockmodel (ScBM) as a tool for detecting community structure of binary bipartite graph…

Machine Learning · Statistics 2023-05-31 Huan Qing , Jingli Wang

In this paper, we introduce a new method for testing the stationarity of time series, where the test statistic is obtained from measuring and maximising the difference in the second-order structure over pairs of randomly drawn intervals.…

Methodology · Statistics 2016-11-29 Haeran Cho

Group testing was conceived during World War II to identify soldiers infected with syphilis using as few tests as possible, and it has attracted renewed interest during the COVID-19 pandemic. A long-standing assumption in the probabilistic…

Social and Information Networks · Computer Science 2022-11-18 Surin Ahn , Wei-Ning Chen , Ayfer Ozgur

We study the hierarchy of communities in real-world networks under a generic stochastic block model, in which the connection probabilities are structured in a binary tree. Under such model, a standard recursive bi-partitioning algorithm is…

Statistics Theory · Mathematics 2021-11-19 Lihua Lei , Xiaodong Li , Xingmei Lou

In this paper, we propose an inferential framework testing the general community combinatorial properties of the stochastic block model. Instead of estimating the community assignments, we aim to test the hypothesis on whether a certain…

Statistics Theory · Mathematics 2020-11-02 Shuting Shen , Junwei Lu

The study of networks leads to a wide range of high dimensional inference problems. In many practical applications, one needs to draw inference from one or few large sparse networks. The present paper studies hypothesis testing of graphs in…

A new strategy is introduced for estimating population size and networked population characteristics. Sample selection is based on a multi-wave snowball sampling design. A generalized stochastic block model is posited for the population's…

Methodology · Statistics 2019-07-30 Kyle Vincent , Steve Thompson