English
Related papers

Related papers: Rate-Distortion Function of the Stochastic Block M…

200 papers

This paper introduces the notion of soft bits to address the rate-distortion optimization for learning-based image compression. Recent methods for such compression train an autoencoder end-to-end with an objective to strike a balance…

Image and Video Processing · Electrical Eng. & Systems 2019-05-02 David Alexandre , Chih-Peng Chang , Wen-Hsiao Peng , Hsueh-Ming Hang

Community detection is a fundamental task in graph analysis, with methods often relying on fitting models like the Stochastic Block Model (SBM) to observed networks. While many algorithms can accurately estimate SBM parameters when the…

Machine Learning · Statistics 2025-06-05 Leonardo Martins Bianco , Christine Keribin , Zacharie Naulet

Community detection, discovering the underlying communities within a network from observed connections, is a fundamental problem in network analysis, yet it remains underexplored for signed networks. In signed networks, both edge connection…

Methodology · Statistics 2026-02-17 Yichao Chen , Weijing Tang , Ji Zhu

We derive a simple general parametric representation of the rate-distortion function of a memoryless source, where both the rate and the distortion are given by integrals whose integrands include the minimum mean square error (MMSE) of the…

Information Theory · Computer Science 2010-04-30 Neri Merhav

Modeling relations between individuals is a classical question in social sciences, ecology, etc. In order to uncover a latent structure in the data, a popular approach consists in clustering individuals according to the observed patterns of…

Methodology · Statistics 2020-02-28 Avner Bar-Hen , Pierre Barbillon , Sophie Donnet

Living organisms rely on internal models of the world to act adaptively. These models, because of resource limitations, cannot encode every detail and hence need to compress information. From a cognitive standpoint, information compression…

Neurons and Cognition · Quantitative Biology 2025-02-18 Leo D'Amato , Gian Luca Lancia , Giovanni Pezzulo

We propose a new hierarchy of semidefinite programming relaxations for inference problems. As test cases, we consider the problem of community detection in block models. The vertices are partitioned into $k$ communities, and a graph is…

Data Structures and Algorithms · Computer Science 2020-09-22 Jess Banks , Sidhanth Mohanty , Prasad Raghavendra

Weighted networks encode not only the presence of interactions but also their strength. Existing methods for weighted network community detection often rely on Poisson models, which can be restrictive for overdispersed data and make…

Methodology · Statistics 2026-04-28 Fumiya Iwashige

We consider the problem of identifying underlying community-like structures in graphs. Towards this end we study the Stochastic Block Model (SBM) on $k$-clusters: a random model on $n=km$ vertices, partitioned in $k$ equal sized clusters,…

Data Structures and Algorithms · Computer Science 2015-07-10 Naman Agarwal , Afonso S. Bandeira , Konstantinos Koiliaris , Alexandra Kolla

The stochastic block model (SBM) is a fundamental tool for community detection in networks, yet the finite-sample performance of inference methods remains underexplored. We evaluate key algorithms-spectral methods, variational inference,…

Social and Information Networks · Computer Science 2024-12-06 Tianjun Ke , Zhiyu Xu

Analysis of the topology of a graph, regular or bipartite one, can be done by clustering for regular ones or co-clustering for bipartite ones. The Stochastic Block Model and the Latent Block Model are two models, which are very similar for…

Computation · Statistics 2016-02-25 Jean-Benoist Leger

Modeling relations between individuals is a classical question in social sciences and clustering individuals according to the observed patterns of interactions allows to uncover a latent structure in the data. Stochastic block model (SBM)…

Methodology · Statistics 2015-01-27 Pierre Barbillon , Sophie Donnet , Emmanuel Lazega , Avner Bar-Hen

We study the neural network (NN) compression problem, viewing the tension between the compression ratio and NN performance through the lens of rate-distortion theory. We choose a distortion metric that reflects the effect of NN compression…

Machine Learning · Computer Science 2022-02-11 Berivan Isik , Tsachy Weissman , Albert No

In this article we use rate-distortion theory, a branch of information theory devoted to the problem of lossy compression, to shed light on an important problem in latent variable modeling of data: is there room to improve the model? One…

Machine Learning · Computer Science 2019-04-17 Luis A. Lastras

The stochastic block model (SBM) has been widely used to analyze network data. Various goodness-of-fit tests have been proposed to assess the adequacy of model structures. To the best of our knowledge, however, none of the existing…

Methodology · Statistics 2025-07-23 Yujia Wu , Wei Lan , Long Feng , Chih-Ling Tsai

We derive rigorous bounds for well-defined community structure in complex networks for a stochastic block model (SBM) benchmark. In particular, we analyze the effect of inter-community "noise" (inter-community edges) on any "community…

Statistical Mechanics · Physics 2014-07-14 Richard K. Darst , David R. Reichman , Peter Ronhovde , Zohar Nussinov

The stochastic block model (SBM) is a generalization of the Erd\H{o}s--R\'enyi model of random graphs that describes the interaction of a finite number of distinct communities. In sparse Erd\H{o}s--R\'enyi graphs, it is known that a…

Data Structures and Algorithms · Computer Science 2024-03-05 Anna Brandenberger , Byron Chin , Nathan S. Sheffield , Divya Shyamal

We discuss a variant of `blind' community detection, in which we aim to partition an unobserved network from the observation of a (dynamical) graph signal defined on the network. We consider a scenario where our observed graph signals are…

Social and Information Networks · Computer Science 2019-04-29 Michael T. Schaub , Santiago Segarra , Hoi-To Wai

Block modeling is widely used in studies on complex networks. The cornerstone model is the stochastic block model (SBM), widely used over the past decades. However, the SBM is limited in analyzing complex networks as the model is, in…

Social and Information Networks · Computer Science 2020-11-03 Wenning Zhang , Ryohei Hisano , Takaaki Ohnishi , Takayuki Mizuno

Stochastic Block Models (SBMs) are a popular approach to modeling single real-world graphs. The key idea of SBMs is to partition the vertices of the graph into blocks with similar edge densities within, as well as between different blocks.…

Social and Information Networks · Computer Science 2024-12-23 Iiro Kumpulainen , Sebastian Dalleiger , Jilles Vreeken , Nikolaj Tatti