English
Related papers

Related papers: Entropy and Distributed Source Coding of Connected…

200 papers

We establish limit theorems that describe the asymptotic local and global geometric behaviour of random enriched trees considered up to symmetry. We apply these general results to random unlabelled weighted rooted graphs and uniform random…

Probability · Mathematics 2016-12-15 Benedikt Stufler

A generalization of the random geometric graph (RGG) model is proposed by considering a set of points uniformly and independently distributed on a rectangle of unit area instead of on a unit square [0,1]^2. The topological properties of the…

Physics and Society · Physics 2015-05-20 Ernesto Estrada , Matthew Sheerin

A temporal random geometric graph is a random geometric graph in which all edges are endowed with a uniformly random time-stamp, representing the time of interaction between vertices. In such graphs, paths with increasing time stamps…

Probability · Mathematics 2025-02-24 Anna Brandenberger , Serte Donderwinkel , Céline Kerriou , Gábor Lugosi , Rivka Mitchell

We introduce a graph-signal generalisation of Sample Entropy, denoted SampEn$_{G}$, to quantify irregularity of graph signals on a continuous state space, complementing existing methods on symbolic dynamics. Our approach replaces the…

Signal Processing · Electrical Eng. & Systems 2026-04-23 Mei-San Maggie Lei , John Stewart Fabila Carrasco , Javier Escudero

Conditional graph entropy is known to be the minimal rate for a natural functional compression problem with side information at the receiver. In this paper we show that it can be formulated as an alternating minimization problem, which…

Information Theory · Computer Science 2023-09-12 Viktor Harangi , Xueyan Niu , Bo Bai

We prove a robust version of a graph embedding theorem of Sauer and Spencer. To state this sparser analogue, we define $G(p)$ to be a random subgraph of $G$ obtained by retaining each edge of $G$ independently with probability $p \in…

Combinatorics · Mathematics 2025-07-08 Peter Allen , Julia Böttcher , Yoshiharu Kohayakawa , Mihir Neve

We introduce and develop a theory of limits for sequences of sparse graphs based on $L^p$ graphons, which generalizes both the existing $L^\infty$ theory of dense graph limits and its extension by Bollob\'as and Riordan to sparse graphs…

Combinatorics · Mathematics 2019-08-19 Christian Borgs , Jennifer T. Chayes , Henry Cohn , Yufei Zhao

We consider the problem of lossless compression of individual sequences using finite-state (FS) machines, from the perspective of the best achievable empirical cumulant generating function (CGF) of the code length, i.e., the normalized…

Information Theory · Computer Science 2016-05-05 Neri Merhav

Consider~\(n\) nodes~\(\{X_i\}_{1 \leq i \leq n}\) independently distributed in the unit square~\(S,\) each according to a distribution~\(f.\) Nodes~\(X_i\) and~\(X_j\) are joined by an edge if the Euclidean distance~\(d(X_i,X_j)\) is less…

Probability · Mathematics 2021-03-02 Ghurumuruhan Ganesan

We consider Slepian-Wolf code design based on LDPC (low-density parity-check) coset codes for memoryless source-side information pairs. A density evolution formula, equipped with a concentration theorem, is derived for Slepian- Wolf coding…

Information Theory · Computer Science 2007-07-13 Jun Chen , Da-ke He , Ashish Jagmohan

We introduce graph wedgelets - a tool for data compression on graphs based on the representation of signals by piecewise constant functions on adaptively generated binary graph partitionings. The adaptivity of the partitionings, a key…

Signal Processing · Electrical Eng. & Systems 2022-11-28 Wolfgang Erb

We present an analytical approach for describing spectrally constrained maximum entropy ensembles of finitely connected regular loopy graphs, valid in the regime of weak loop-loop interactions. We derive an expression for the leading two…

Disordered Systems and Neural Networks · Physics 2020-02-19 Fabian Aguirre Lopez , Anthony CC Coolen

Several studies have identified a significant amount of redundancy in the network traffic. For example, it is demonstrated that there is a great amount of redundancy within the content of a server over time. This redundancy can be leveraged…

Information Theory · Computer Science 2016-11-18 Mohsen Sardari , Ahmad Beirami , Faramarz Fekri

Various graphs such as web or social networks may contain up to trillions of edges. Compressing such datasets can accelerate graph processing by reducing the amount of I/O accesses and the pressure on the memory subsystem. Yet, selecting a…

Data Structures and Algorithms · Computer Science 2019-04-30 Maciej Besta , Torsten Hoefler

We calculate explicit formulae for the Shannon entropies of several families of tailored random graph ensembles for which no such formulae were as yet available, in leading orders in the system size. These include bipartite graph ensembles…

Disordered Systems and Neural Networks · Physics 2014-04-24 Ekaterina Roberts , Ton Coolen

In this work we introduce Dynamic Random Geometric Graphs as a basic rough model for mobile wireless sensor networks, where communication distances are set to the known threshold for connectivity of static random geometric graphs. We…

Discrete Mathematics · Computer Science 2007-05-23 Josep Diaz , Dieter Mitsche , Xavier Perez

We consider the problem of learned transform compression where we learn both, the transform as well as the probability distribution over the discrete codes. We utilize a soft relaxation of the quantization operation to allow for…

Machine Learning · Computer Science 2021-05-05 Magda Gregorová , Marc Desaules , Alexandros Kalousis

Relative entropy coding (REC) algorithms encode a sample from a target distribution $Q$ using a proposal distribution $P$ using as few bits as possible. Unlike entropy coding, REC does not assume discrete distributions or require…

Information Theory · Computer Science 2023-09-28 Gergely Flamich , Stratis Markou , Jose Miguel Hernandez Lobato

In this paper, we consider a class of multiterminal source coding problems, each subject to distortion constraints computed using a specific, entropy-based, distortion measure. We provide the achievable rate distortion region for two cases…

Information Theory · Computer Science 2011-06-02 Thomas Courtade , Richard Wesel

The spectral density of random graphs with topological constraints is analysed using the replica method. We consider graph ensembles featuring generalised degree-degree correlations, as well as those with a community structure. In each case…

Disordered Systems and Neural Networks · Physics 2011-04-08 Tim Rogers , Conrad Pérez Vicente , Koujin Takeda , Isaac Pérez Castillo