English
Related papers

Related papers: A Separation Between Run-Length SLPs and LZ77

200 papers

Shannon's entropy is a clear lower bound for statistical compression. The situation is not so well understood for dictionary-based compression. A plausible lower bound is $b$, the least number of phrases of a general bidirectional parse of…

Data Structures and Algorithms · Computer Science 2019-10-29 Gonzalo Navarro , Carlos Ochoa , Nicola Prezza

We consider the communication complexity of the Hamming distance of two strings. Bille et al. [SPIRE 2018] considered the communication complexity of the longest common prefix (LCP) problem in the setting where the two parties have their…

Data Structures and Algorithms · Computer Science 2021-04-02 Shiori Mitsuya , Yuto Nakashima , Shunsuke Inenaga , Hideo Bannai , Masayuki Takeda

We propose algorithms computing the semi-greedy Lempel-Ziv 78 (LZ78), the Lempel-Ziv Double (LZD), and the Lempel-Ziv-Miller-Wegman (LZMW) factorizations in linear time for integer alphabets. For LZD and LZMW, we additionally propose data…

Data Structures and Algorithms · Computer Science 2024-09-24 Dominik Köppl

We present a novel bit-parallel representation, based on the run-length encoding, of the nondeterministic KMP and suffix automata for a string $P$ with at least two distinct symbols. Our method is targeted to the case of long strings over…

Formal Languages and Automata Theory · Computer Science 2014-12-18 Emanuele Giaquinta

The work takes another look at the number of runs that a string might contain and provides an alternative proof for the bound. We also propose another stronger conjecture that states that, for a fixed order on the alphabet, within every…

Discrete Mathematics · Computer Science 2015-12-24 Maxime Crochemore , Robert Mercas

The well-known dictionary-based algorithms of the Lempel-Ziv (LZ) 77 family are the basis of several universal lossless compression techniques. These algorithms are asymmetric regarding encoding/decoding time and memory requirements, with…

Data Structures and Algorithms · Computer Science 2009-12-31 Artur Ferreira , Arlindo Oliveira , Mario Figueiredo

Unlike in statistical compression, where Shannon's entropy is a definitive lower bound, no such clear measure exists for the compressibility of repetitive sequences. Since statistical entropy does not capture repetitiveness, ad-hoc measures…

Data Structures and Algorithms · Computer Science 2021-01-18 Tomasz Kociumaka , Gonzalo Navarro , Nicola Prezza

Our objective is to provide an upper bound for the length $\ell_N$ of the longest run of consecutive integers smaller than $N$ which have the same number of divisors. We prove in an elementary way that $\log\ell_N\ll(\log N\log\log…

Number Theory · Mathematics 2024-08-12 Vlad-Titus Spătaru

We define an algorithm that parses multidimensional arrays sequentially into mainly unrepeated but nested multidimensional sub-arrays of increasing size, and show that the resulting sub-block pointer encoder compresses almost every…

Information Theory · Computer Science 2014-08-20 Tyll Krueger , Guido Montufar , Ruedi Seiler , Rainer Siegmund-Schultze

Let G be a context-free grammar (CFG) in Chomsky normal form. We take the number of rules in G to be the size of G. We also assume all CFGs are in Chomsky normal form. We consider the question of, given a string w of length n, what is the…

Formal Languages and Automata Theory · Computer Science 2024-06-04 Lance Fortnow , William Gasarch

Zipf's law is a fundamental paradigm in the statistics of written and spoken natural language as well as in other communication systems. We raise the question of the elementary units for which Zipf's law should hold in the most natural way,…

Physics and Society · Physics 2015-07-14 Alvaro Corral , Gemma Boleda , Ramon Ferrer-i-Cancho

We introduce the first self-index based on the Lempel-Ziv 1977 compression format (LZ77). It is particularly competitive for highly repetitive text collections such as sequence databases of genomes of related species, software repositories,…

Data Structures and Algorithms · Computer Science 2011-01-24 Sebastian Kreft , Gonzalo Navarro

Based on the Breslauer-Italiano online suffix tree construction algorithm (2013) with double logarithmic worst-case guarantees on the update time per letter, we develop near-real-time algorithms for several classical problems on strings,…

Data Structures and Algorithms · Computer Science 2026-02-18 Dominik Köppl , Gregory Kucherov

It was recently proved that any SLP generating a given string $w$ can be transformed in linear time into an equivalent balanced SLP of the same asymptotic size. We show that this result also holds for RLSLPs, which are SLPs extended with…

Data Structures and Algorithms · Computer Science 2022-06-28 Gonzalo Navarro , Francisco Olivares , Cristian Urbina

Despite consistently yielding the best compression on repetitive text collections, the Lempel-Ziv parsing has resisted all attempts at offering relevant guarantees on the cost to access an arbitrary symbol. This makes it less attractive for…

Data Structures and Algorithms · Computer Science 2024-04-24 Zsuzsanna Lipták , Francesco Masillo , Gonzalo Navarro

Simple and fast decoding is one of the main advantages of LZ77-type text encoding used in many popular file compressors such as gzip and 7zip. With the recent introduction of external memory algorithms for Lempel-Ziv factorization there is…

Data Structures and Algorithms · Computer Science 2020-12-11 Djamal Belazzougui , Juha Kärkkäinen , Dominik Kempa , Simon J. Puglisi

We derive upper and lower bounds on the overall compression ratio of the 1978 Lempel-Ziv (LZ78) algorithm, applied independently to $k$-blocks of a finite individual sequence. Both bounds are given in terms of normalized empirical entropies…

Information Theory · Computer Science 2025-06-17 Neri Merhav

We relate binary words with a given number of subsequences to continued fractions of rational numbers with a given denominator. We deduce that there are binary strings of length $O(\log n \log \log n)$ with exactly $n$ subsequences; this…

Combinatorics · Mathematics 2022-10-04 Radosław Żak

We answer the following question of R. L. Graham: What is the discrepancy of the lexicographically-least binary de Bruijn sequence? Here, "discrepancy" refers to the maximum (absolute) difference between the number of ones and the number of…

Combinatorics · Mathematics 2009-03-24 Joshua Cooper , Christine Heitsch

We study the length of the gaps between consecutive members in the sumset sA when A is a pseudo s-th power sequence, with s>1. We show that, almost surely, limsup (b_{n+1}-b_{n})/log (b_n) = s^s s!/\Gamma^s(1/s), where b_n are the elements…

Number Theory · Mathematics 2014-05-07 Javier Cilleruelo , Jean-Marc Deshouillers