English
Related papers

Related papers: At the Roots of Dictionary Compression: String Att…

200 papers

The Lempel-Ziv 77 (LZ77) factorization is a fundamental compression scheme widely used in text processing and data compression. In this work, we investigate the time complexity of maintaining the LZ77 factorization of a dynamic string. By…

Data Structures and Algorithms · Computer Science 2025-10-28 Itai Boneh , Shay Golan , Matan Kraus

In the Shortest-Superstring problem, we are given a set of strings S and want to find a string that contains all strings in S as substrings and has minimum length. This is a classical problem in approximation and the best known…

Data Structures and Algorithms · Computer Science 2016-11-11 Marcin Mucha

In many real-world database systems, a large fraction of the data is represented by strings: sequences of letters over some alphabet. This is because strings can easily encode data arising from different sources. It is often crucial to…

Data Structures and Algorithms · Computer Science 2024-07-17 Lorraine A. K. Ayad , Grigorios Loukides , Solon P. Pissis

Recent technological advancements have led to the generation of huge amounts of data over the web, such as text, image, audio and video. Most of this data is high dimensional and sparse, for e.g., the bag-of-words representation used for…

Information Theory · Computer Science 2017-08-17 Rameshwar Pratap , Ishan Sohony , Raghav Kulkarni

We consider compact representations of collections of similar strings that support random access queries. The collection of strings is given by a rooted tree where edges are labeled by an edit operation (inserting, deleting, or replacing a…

Data Structures and Algorithms · Computer Science 2021-02-12 Philip Bille , Inge Li Gørtz

Language prediction is constrained by informational entropy intrinsic to language, such that there exists a limit to how accurate any language model can become and equivalently a lower bound to language compression. The most efficient…

Computation and Language · Computer Science 2025-11-14 Benjamin L. Badger , Matthew Neligeorge

Grammar-based compression is a widely-accepted model of string compression that allows for efficient and direct manipulations on the compressed data. Most, if not all, such manipulations rely on the primitive \emph{random access} queries, a…

Data Structures and Algorithms · Computer Science 2024-07-12 Alan M. Cleary , Joseph Winjum , Jordan Dood , Shunsuke Inenaga

Data deduplication saves storage space by identifying and removing repeats in the data stream. Compared with traditional compression methods, data deduplication schemes are more time efficient and are thus widely used in large scale storage…

Information Theory · Computer Science 2022-05-30 Hao Lou , Farzad Farnoud

In this paper, we propose a dictionary screening method for embedding compression in text classification tasks. The key purpose of this method is to evaluate the importance of each keyword in the dictionary. To this end, we first train a…

Computation and Language · Computer Science 2022-11-24 Jing Zhou , Xinru Jing , Muyu Liu , Hansheng Wang

Unlike the matrix case, computing low-rank approximations of tensors is NP-hard and numerically ill-posed in general. Even the best rank-1 approximation of a tensor is NP-hard. In this paper, we use convex optimization to develop…

Statistics Theory · Mathematics 2016-09-14 Anil Aswani

Learned image compression methods have attracted great research interest and exhibited superior rate-distortion performance to the best classical image compression standards of the present. The entropy model plays a key role in learned…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Jingbo Lu , Leheng Zhang , Xingyu Zhou , Mu Li , Wen Li , Shuhang Gu

We propose a novel, lightweight supervised dictionary learning framework for text classification based on data compression and representation. This two-phase algorithm initially employs the Lempel-Ziv-Welch (LZW) algorithm to construct a…

Computation and Language · Computer Science 2024-05-06 Li Wan , Tansu Alpcan , Margreta Kuijper , Emanuele Viterbo

We present a development of parts of rate-distortion theory and pattern- matching algorithms for lossy data compression, centered around a lossy version of the Asymptotic Equipartition Property (AEP). This treatment closely parallels the…

Probability · Mathematics 2007-07-16 A. Dembo , I. Kontoyiannis

We derive upper and lower bounds on the overall compression ratio of the 1978 Lempel-Ziv (LZ78) algorithm, applied independently to $k$-blocks of a finite individual sequence. Both bounds are given in terms of normalized empirical entropies…

Information Theory · Computer Science 2025-06-17 Neri Merhav

Physics concepts have often been borrowed and independently developed by other fields of science. In this perspective a significant example is that of entropy in Information Theory. The aim of this paper is to provide a short and…

Physics Education · Physics 2007-05-23 Andrea Baronchelli , Emanuele Caglioti , Vittorio Loreto

The efficient sparse coding and reconstruction of signal vectors via linear observations has received a tremendous amount of attention over the last decade. In this context, the automated learning of a suitable basis or overcomplete…

Information Theory · Computer Science 2015-06-19 Andreas M. Tillmann

Sublinear time quantum algorithms have been established for many fundamental problems on strings. This work demonstrates that new, faster quantum algorithms can be designed when the string is highly compressible. We focus on two popular and…

Data Structures and Algorithms · Computer Science 2023-02-15 Daniel Gibney , Sharma V. Thankachan

We study the approximation hardness of the Shortest Superstring, the Maximal Compression and the Maximum Asymmetric Traveling Salesperson (MAX-ATSP) problem. We introduce a new reduction method that produces strongly restricted instances of…

Computational Complexity · Computer Science 2012-08-28 Marek Karpinski , Richard Schmied

We consider the problem of {\em restructuring} compressed texts without explicit decompression. We present algorithms which allow conversions from compressed representations of a string $T$ produced by any grammar-based compression…

Data Structures and Algorithms · Computer Science 2011-07-15 Keisuke Goto , Shirou Maruyama , Shunsuke Inenaga , Hideo Bannai , Hiroshi Sakamoto , Masayuki Takeda

Motivated by mass-spectrometry protein sequencing, we consider a simply-stated problem of reconstructing a string from the multiset of its substring compositions. We show that all strings of length 7, one less than a prime, or one less than…

Discrete Mathematics · Computer Science 2014-03-12 Jayadev Acharya , Hirakendu Das , Olgica Milenkovic , Alon Orlitsky , Shengjun Pan