English
Related papers

Related papers: Entropy Bounds for Grammar-Based Tree Compressors

200 papers

We consider the problem of computing the measure of a regular language of infinite binary trees. While the general case remains unsolved, we show that the measure of a language defined by a first-order formula with no descendant relation or…

Logic in Computer Science · Computer Science 2018-09-11 Marcin Przybyłko

This paper studies the entropy of tree-shifts of finite type with and without boundary conditions. We demonstrate that computing the entropy of a tree-shift of finite type is equivalent to solving a system of nonlinear recurrence equations.…

Dynamical Systems · Mathematics 2017-03-07 Jung-Chao Ban , Chih-Hung Chang

Bounds on the entropy of patterns of sequences generated by independently identically distributed (i.i.d.) sources are derived. A pattern is a sequence of indices that contains all consecutive integer indices in increasing order of first…

Information Theory · Computer Science 2007-07-13 Gil I. Shamir

A common meadow is an enrichment of a field with a partial division operation that is made total by assuming that division by zero takes the a default value, a special element $\bot$ adjoined to the field. To a common meadow of real numbers…

Information Theory · Computer Science 2025-02-12 Jan A Bergstra , John V Tucker

In this paper, we study the entanglement entropy in string theory in the simplest setup of dividing the nine dimensional space into two halves. This corresponds to the leading quantum correction to the horizon entropy in string theory on…

High Energy Physics - Theory · Physics 2015-01-07 Song He , Tokiro Numasawa , Tadashi Takayanagi , Kento Watanabe

This paper proposes a novel entropy encoding technique for lossless data compression. Representing a message string by its lexicographic index in the permutations of its symbols results in a compressed version matching Shannon entropy of…

Information Theory · Computer Science 2017-03-24 Abu Bakar Siddique

The notion of tree-shifts constitutes an intermediate class in between one-sided shift spaces and multidimensional ones. This paper proposes an algorithm for computing of the entropy of a tree-shift of finite type. Meanwhile, the entropy of…

Dynamical Systems · Mathematics 2022-07-20 Jung-Chao Ban , Chih-Hung Chang

We use reinforcement learning to learn tree-structured neural networks for computing representations of natural language sentences. In contrast with prior work on tree-structured models in which the trees are either provided as input or…

Computation and Language · Computer Science 2016-11-29 Dani Yogatama , Phil Blunsom , Chris Dyer , Edward Grefenstette , Wang Ling

We study the problem of indexing and compressing tries using a BWT-based approach. Specifically, we consider a succinct and compressed representation of the XBWT of Ferragina et al.\ [FOCS '05, JACM '09] corresponding to the analogous of…

Data Structures and Algorithms · Computer Science 2025-07-04 Lorenzo Carfagna , Carlo Tosoni

We briefly survey some concepts related to empirical entropy -- normal numbers, de Bruijn sequences and Markov processes -- and investigate how well it approximates Kolmogorov complexity. Our results suggest $\ell$th-order empirical entropy…

Information Theory · Computer Science 2007-07-16 Travis Gagie

Rank/Select dictionaries are data structures for an ordered set $S \subset \{0,1,...,n-1\}$ to compute $\rank(x,S)$ (the number of elements in $S$ which are no greater than $x$), and $\select(i,S)$ (the $i$-th smallest element in $S$),…

Data Structures and Algorithms · Computer Science 2007-05-23 Daisuke Okanohara , Kunihiko Sadakane

We discuss a notion of convergence for binary trees that is based on subtree sizes. In analogy to recent developments in the theory of graphs, posets and permutations we investigate some general aspects of the topology, such as a…

Combinatorics · Mathematics 2024-02-14 Rudolf Grübel

Kolmogorov complexity of a finite binary word reflects both algorithmic structure and the empirical distribution of symbols appearing in the word. Words with symbol frequencies far from one half have smaller combinatorial richness and…

Computation · Statistics 2025-12-25 Brani Vidakovic

Entanglement entropy for spatial subregions is difficult to define in string theory because of the extended nature of strings. Here we propose a definition for Bosonic open strings using the framework of string field theory. The key…

High Energy Physics - Theory · Physics 2018-04-04 Vijay Balasubramanian , Onkar Parrikar

In signal analysis and synthesis, linear approximation theory considers a linear decomposition of any given signal in a set of atoms, collected into a so-called dictionary. Relevant sparse representations are obtained by relaxing the…

Information Theory · Computer Science 2014-11-04 Paul Honeine

We provide formulas for the entropy of free-string states depending on their mass, charges and size, both in bosonic and superstring theory (IIA or IIB). We properly define these quantities in full-fledged string theory. We then investigate…

High Energy Physics - Theory · Physics 2007-11-13 Diego Chialva

This work addresses the problem of computing measures of recognisable sets of infinite trees. An algorithm is provided to compute the probability measure of a tree language recognisable by a weak alternating automaton, or equivalently…

Formal Languages and Automata Theory · Computer Science 2025-12-22 Damian Niwiński , Marcin Przybyłko , Michał Skrzypczak

We give a definition of topological entropy for tree shifts, prove that the limit in the definition exists, and show that it dominates the topological entropy of the associated one-dimensional shift of finite type when the labeling of the…

Dynamical Systems · Mathematics 2018-05-29 Karl Petersen , Ibrahim Salama

We consider random binary trees that appear as the output of certain standard algorithms for sorting and searching if the input is random. We introduce the subtree size metric on search trees and show that the resulting metric spaces…

Probability · Mathematics 2014-05-06 Rudolf Grübel

It has been demonstrated that excitable media with a tree structure performed better than other network topologies, it is natural to consider neural networks defined on Cayley trees. The investigation of a symbolic space called tree-shift…

Dynamical Systems · Mathematics 2018-02-28 Jung-Chao Ban , Chih-Hung Chang , Nai-Zhu Huang