English
Related papers

Related papers: Graph Entropy, Network Coding and Guessing games

200 papers

Graph convolutional networks (GCNs) are a widely used method for graph representation learning. To elucidate the capabilities and limitations of GCNs, we investigate their power, as a function of their number of layers, to distinguish…

Machine Learning · Statistics 2020-05-14 Abram Magner , Mayank Baranwal , Alfred O. Hero

We introduce a broad class of equations that are described by a graph, which includes many well-studied systems. For these, we show that the number of solutions (or the dimension of the solution set) can be bounded by studying certain…

Combinatorics · Mathematics 2024-10-10 Eddie Nijholt , Davide Sclosa

The recent extension of permutation entropy and its derivatives to graph signals has opened up new horizons for the analysis of complex, high-dimensional systems evolving on networks. However, these measures are all fundamentally rooted in…

Signal Processing · Electrical Eng. & Systems 2026-04-08 Mei-San Maggie Lei , John Stewart Fabila Carrasco , Javier Escudero

The spectral theory of graphs provides a bridge between classical signal processing and the nascent field of graph signal processing. In this paper, a spectral graph analogy to Heisenberg's celebrated uncertainty principle is developed.…

Information Theory · Computer Science 2013-08-02 Ameya Agaskar , Yue M. Lu

Shearer's inequality bounds the sum of joint entropies of random variables in terms of the total joint entropy. We give another lower bound for the same sum in terms of the individual entropies when the variables are functions of…

Probability · Mathematics 2021-03-23 Endre Csóka , Viktor Harangi , Bálint Virág

In information theory, one major goal is to find useful functions that summarize the amount of information contained in the interaction of several random variables. Specifically, one can ask how the classical Shannon entropy, mutual…

Information Theory · Computer Science 2025-02-14 Leon Lang , Pierre Baudot , Rick Quax , Patrick Forré

We analyze complexity in spatial network ensembles through the lens of graph entropy. Mathematically, we model a spatial network as a soft random geometric graph, i.e., a graph with two sources of randomness, namely nodes located randomly…

Physics and Society · Physics 2018-05-02 Justin P. Coon , Carl P. Dettmann , Orestis Georgiou

An identifying code is a subset of vertices of a graph such that each vertex is uniquely determined by its neighbourhood within the identifying code. If $\M(G)$ denotes the minimum size of an identifying code of a graph $G$, it was…

Discrete Mathematics · Computer Science 2012-09-24 Florent Foucaud , Guillem Perarnau

In this paper, we present a new multi-scale information content calculation method based on Shannon information (and Shannon entropy). The original method described by Claude E. Shannon and based on the logarithm of the probability of…

Information Theory · Computer Science 2023-05-23 Zsolt Pocze

In general the problem of finding a miminum spanning tree for a weighted directed graph is difficult but solvable. There are a lot of differences between problems for directed and undirected graphs, therefore the algorithms for undirected…

Discrete Mathematics · Computer Science 2008-01-16 V. A. Buslov , V. A. Khudobakhshov

Entropy is a classical measure to quantify the amount of information or complexity of a system. Various entropy-based measures such as functional and spectral entropies have been proposed in brain network analysis. However, they are less…

Neurons and Cognition · Quantitative Biology 2018-03-08 Hyekyoung Lee , Eunkyung Kim , Hyejin Kang , Youngmin Huh , Youngjo Lee , Seonhee Lim , Dong Soo Lee

How efficiently can we find an unknown graph using distance or shortest path queries between its vertices? Let $G = (V,E)$ be an unweighted, connected graph of bounded degree. The edge set $E$ is initially unknown, and the graph can be…

Data Structures and Algorithms · Computer Science 2015-02-19 Sampath Kannan , Claire Mathieu , Hang Zhou

In this paper, we study the problem of graph compression with side information at the decoder. The focus is on the situation when an unlabelled graph (which is also referred to as a structure) is to be compressed or is available as side…

Information Theory · Computer Science 2025-01-20 Praneeth Kumar Vippathalla , Mihai-Alin Badiu , Justin P. Coon

A new method is proposed for analyzing complexity and studying the information in random geometric networks using Tsallis entropy tool. Tsallis entropy of the ensemble of random geometric networks is calculated based on the components of…

Statistical Mechanics · Physics 2025-02-20 O. K. Kazemi , S. M. Taheri

In an earlier paper the authors proved that limits of convergent graph sequences can be described by various structures, including certain 2-variable real functions called graphons, random graph models satisfying certain consistency…

Combinatorics · Mathematics 2009-02-10 László Lovász , Balázs Szegedy

The Shannon entropy is a widely used summary statistic, for example, network traffic measurement, anomaly detection, neural computations, spike trains, etc. This study focuses on estimating Shannon entropy of data streams. It is known that…

Data Structures and Algorithms · Computer Science 2009-10-09 Ping Li

Network or graph structures are ubiquitous in the study of complex systems. Often, we are interested in complexity trends of these system as it evolves under some dynamic. An example might be looking at the complexity of a food web as…

Information Theory · Computer Science 2007-07-16 Russell K. Standish

We propose the notion of {\it resistance of a graph} as an accompanying notion of the structure entropy to measure the force of the graph to resist cascading failure of strategic virus attacks. We show that for any connected network $G$,…

Discrete Mathematics · Computer Science 2018-01-11 Angsheng Li , Yicheng Pan

We study the richness of the ensemble of graphical structures (i.e., unlabeled graphs) of the one-dimensional random geometric graph model defined by $n$ nodes randomly scattered in $[0,1]$ that connect if they are within the connection…

Information Theory · Computer Science 2022-06-24 Mihai-Alin Badiu , Justin P. Coon

Recovering the random graph model from an observed collection of networks is known to present significant challenges in the setting, where the networks do not share a common node set and have different sizes. More specifically, the goal is…

Methodology · Statistics 2026-03-17 Roland Boniface Sogan , Tabea Rebafka