English
Related papers

Related papers: Assembly Theory is an approximation to algorithmic…

200 papers

Shannon entropy, a cornerstone of information theory, statistical physics and inference methods, is uniquely identified by the Shannon-Khinchin or Shore-Johnson axioms. Generalizations of Shannon entropy, motivated by the study of…

Data Analysis, Statistics and Probability · Physics 2026-04-20 Andrea Somazzi , Diego Garlaschelli

The Shannon entropy is a fundamental measure for quantifying diversity and model complexity in fields such as information theory, ecology, and genetics. However, many existing studies assume that the number of species is known, an…

Methodology · Statistics 2026-02-23 Takato Hashino , Koji Tsukuda

Shannon's entropy is a clear lower bound for statistical compression. The situation is not so well understood for dictionary-based compression. A plausible lower bound is $b$, the least number of phrases of a general bidirectional parse of…

Data Structures and Algorithms · Computer Science 2019-10-29 Gonzalo Navarro , Carlos Ochoa , Nicola Prezza

We prove a lower estimate on the increase in entropy when two copies of a conditional random variable $X | Y$, with $X$ supported on $\mathbb{Z}_q=\{0,1,\dots,q-1\}$ for prime $q$, are summed modulo $q$. Specifically, given two i.i.d copies…

Information Theory · Computer Science 2014-11-27 Venkatesan Guruswami , Ameya Velingker

We have used information theory analogue of entropy, Shannon entropy, for estimating the variations during the isotropic and anisotropic AuNP fractal growth process. We have firstly applied the Shannon entropy on the simulated fractal…

Atomic and Molecular Clusters · Physics 2018-12-21 Anurag Singh , Anushree Roy , Amar Nath Gupta

We investigate the properties of a Block Decomposition Method (BDM), which extends the power of a Coding Theorem Method (CTM) that approximates local estimations of algorithmic complexity based upon Solomonoff-Levin's theory of algorithmic…

Information Theory · Computer Science 2018-06-20 Hector Zenil , Santiago Hernández-Orozco , Narsis A. Kiani , Fernando Soler-Toscano , Antonio Rueda-Toicen

We propose a compression-based version of the empirical entropy of a finite string over a finite alphabet. Whereas previously one considers the naked entropy of (possibly higher order) Markov processes, we consider the sum of the…

Information Theory · Computer Science 2011-04-05 Paul M. B. Vitányi

Linking the properties of galaxies to the assembly history of their dark matter haloes is a central aim of galaxy evolution theory. This paper introduces a dimensionless parameter $s\in[0,1]$, the "tree entropy", to parametrise the geometry…

Astrophysics of Galaxies · Physics 2020-02-14 Danail Obreschkow , Pascal J. Elahi , Claudia del P. Lagos , Rhys J. J. Poulton , Aaron D. Ludlow

The Shannon entropy of a random variable has much behaviour analogous to a signed measure. Previous work has explored this connection by defining a signed measure on abstract sets, which are taken to represent the information that different…

Information Theory · Computer Science 2025-05-28 Keenan J. A. Down , Pedro A. M. Mediano

This paper considers the estimation of Shannon entropy for discrete distributions with countably infinite support. While minimax rates for finite-support distributions are established, infinite-support distributions present distinct…

Statistics Theory · Mathematics 2025-12-03 Octavio César Mesner

We discuss algorithms for estimating the Shannon entropy h of finite symbol sequences with long range correlations. In particular, we consider algorithms which estimate h from the code lengths produced by some compression algorithm. Our…

Statistical Mechanics · Physics 2017-04-24 Thomas Schürmann , Peter Grassberger

From the output produced by a memoryless deletion channel from a uniformly random input of known length $n$, one obtains a posterior distribution on the channel input. The difference between the Shannon entropy of this distribution and that…

Information Theory · Computer Science 2018-08-01 Arash Atashpendar , David Mestel , A. W. Roscoe , Peter Y. A. Ryan

We compare the elementary theories of Shannon information and Kolmogorov complexity, the extent to which they have a common purpose, and where they are fundamentally different. We discuss and relate the basic notions of both theories:…

Information Theory · Computer Science 2020-07-21 Peter Grunwald , Paul Vitanyi

Neural networks achieve remarkable performance through superposition: encoding multiple features as overlapping directions in activation space rather than dedicating individual neurons to each feature. This challenges interpretability, yet…

Machine Learning · Computer Science 2025-12-16 Leonard Bereska , Zoe Tzifa-Kratira , Reza Samavi , Efstratios Gavves

For a broad class of input-output maps, arguments based on the coding theorem from algorithmic information theory (AIT) predict that simple (low Kolmogorov complexity) outputs are exponentially more likely to occur upon uniform random…

Data Analysis, Statistics and Probability · Physics 2019-10-03 Kamaludin Dingle , Guillermo Valle Pérez , Ard A. Louis

Shannon's entropy is a definitive lower bound for statistical compression. Unfortunately, no such clear measure exists for the compressibility of repetitive strings. Thus, ad hoc measures are employed to estimate the repetitiveness of…

Data Structures and Algorithms · Computer Science 2023-11-16 Giulia Bernardini , Gabriele Fici , Paweł Gawrychowski , Solon P. Pissis

In estimating the complexity of objects, in particular of graphs, it is common practice to rely on graph- and information-theoretic measures. Here, using integer sequences with properties such as Borel normality, we explain how these…

Information Theory · Computer Science 2017-07-12 Hector Zenil , Narsis Kiani , Jesper Tegnér

For statistical systems that violate one of the four Shannon-Khinchin axioms, entropy takes a more general form than the Boltzmann-Gibbs entropy. The framework of superstatistics allows one to formulate a maximum entropy principle with…

Classical Physics · Physics 2012-11-13 Rudolf Hanel , Stefan Thurner , Murray Gell-Mann

We consider the problem of approximating the empirical Shannon entropy of a high-frequency data stream under the relaxed strict-turnstile model, when space limitations make exact computation infeasible. An equivalent measure of entropy is…

Computation · Statistics 2013-04-18 Peter Clifford , Ioana Ada Cosma

We show that the essential properties of entropy (monotonicity, additivity and subadditivity) are consequences of entropy being a monoidal natural transformation from the under category functor $-/\mathsf{LProb}_{\rho}$ (where…

Category Theory · Mathematics 2024-04-16 Cheuk Ting Li