English
Related papers

Related papers: Lossy Compression in Near-Linear Time via Efficien…

200 papers

Data used for analytics and machine learning often take the form of tables with categorical entries. We introduce a family of lossless compression algorithms for such data that proceed in four steps: $(i)$ Estimate latent variables…

Information Theory · Computer Science 2023-02-21 Andrea Montanari , Eric Weiner

We present a framework facilitating the implementation and comparison of text compression algorithms. We evaluate its features by a case study on two novel compression algorithms based on the Lempel-Ziv compression schemes that perform well…

Data Structures and Algorithms · Computer Science 2021-04-23 Patrick Dinklage , Johannes Fischer , Dominik Köppl , Marvin Löbel , Kunihiko Sadakane

Relative Lempel-Ziv (RLZ) is a popular algorithm for compressing databases of genomes from individuals of the same species when fast random access is desired. With Kuruppu et al.'s (SPIRE 2010) original implementation, a reference genome is…

Data Structures and Algorithms · Computer Science 2016-05-17 Anthony J. Cox , Andrea Farruggia , Travis Gagie , Simon J. Puglisi , Jouni Sirén

The LZ-End parsing [Kreft & Navarro, 2011] of an input string yields compression competitive with the popular Lempel-Ziv 77 scheme, but also allows for efficient random access. Kempa and Kosolobov showed that the parsing can be computed in…

Data Structures and Algorithms · Computer Science 2024-09-18 Patrick Dinklage

Relative Lempel-Ziv (RLZ) parsing is a dictionary compression method in which a string $S$ is compressed relative to a second string $R$ (called the reference) by parsing $S$ into a sequence of substrings that occur in $R$. RLZ is…

Data Structures and Algorithms · Computer Science 2022-08-25 Philip Bille , Inge Li Gørtz , Simon J. Puglisi , Simon R. Tarnow

We consider lossy compression of an information source when the decoder has lossless access to a correlated one. This setup, also known as the Wyner-Ziv problem, is a special case of distributed source coding. To this day, practical…

Information Theory · Computer Science 2024-05-22 Ezgi Ozyilkan , Johannes Ballé , Elza Erkip

Despite consistently yielding the best compression on repetitive text collections, the Lempel-Ziv parsing has resisted all attempts at offering relevant guarantees on the cost to access an arbitrary symbol. This makes it less attractive for…

Data Structures and Algorithms · Computer Science 2024-04-24 Zsuzsanna Lipták , Francesco Masillo , Gonzalo Navarro

Recently deep learning-based image compression methods have achieved significant achievements and gradually outperformed traditional approaches including the latest standard Versatile Video Coding (VVC) in both PSNR and MS-SSIM metrics. Two…

Image and Video Processing · Electrical Eng. & Systems 2024-02-13 Haisheng Fu , Feng Liang , Jianping Lin , Bing Li , Mohammad Akbari , Jie Liang , Guohe Zhang , Dong Liu , Chengjie Tu , Jingning Han

As deep learning models grow and deployment becomes more widespread, reducing the storage and transmission costs of neural network weights has become increasingly important. While prior work such as ZipNN has shown that lossless compression…

Machine Learning · Computer Science 2025-08-28 Anat Heilper , Doron Singer

This article gives a self-contained analysis of the performance of the Lempel-Ziv compression algorithm on (hidden) Markovian sources. Specifically we include a full proof of the assertion that the compression rate approaches the entropy…

Information Theory · Computer Science 2019-10-03 Madhu Sudan , David Xiang

Learning-based probabilistic models can be combined with an entropy coder for data compression. However, due to the high complexity of learning-based models, their practical application as text compressors has been largely overlooked. To…

Computation and Language · Computer Science 2024-12-25 Junxuan Zhang , Zhengxue Cheng , Yan Zhao , Shihao Wang , Dajiang Zhou , Guo Lu , Li Song

Consider the problem of predicting the next symbol given a sample path of length n, whose joint distribution belongs to a distribution class that may have long-term memory. The goal is to compete with the conditional predictor that knows…

Statistics Theory · Mathematics 2024-04-25 Yanjun Han , Tianze Jiang , Yihong Wu

This paper delves into recent hardware implementations of the Lempel-Ziv 4 (LZ4) algorithm, highlighting two key factors that limit the throughput of single-kernel compressors. Firstly, the actual parallelism exhibited in single-kernel…

Hardware Architecture · Computer Science 2024-09-20 Tao Chen , Suwen Song , Zhongfeng Wang

Hypergraphs provide a natural representation for many-to-many relationships in data-intensive applications, yet their scalability is often hindered by high memory consumption. While prior work has improved computational efficiency, reducing…

Data Structures and Algorithms · Computer Science 2025-06-23 Tianyu Zhao , Dongfang Zhao , Luanzheng Guo , Nathan Tallent

We present a development of parts of rate-distortion theory and pattern- matching algorithms for lossy data compression, centered around a lossy version of the Asymptotic Equipartition Property (AEP). This treatment closely parallels the…

Probability · Mathematics 2007-07-16 A. Dembo , I. Kontoyiannis

Error-bounded lossy compression has been a critical technique to significantly reduce the sheer amounts of simulation datasets for high-performance computing (HPC) scientific applications while effectively controlling the data distortion…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-23 Tripti Agarwal , Sheng Di , Jiajun Huang , Yafan Huang , Ganesh Gopalakrishnan , Robert Underwood , Kai Zhao , Xin Liang , Guanpeng Li , Franck Cappello

The pressing need for eficient compression schemes for XML documents has recently been focused on stack computation [6, 9], and in particular calls for a formulation of information-lossless stack or pushdown compressors that allows a formal…

Information Theory · Computer Science 2007-09-17 Pilar Albert , Elvira Mayordomo , Philippe Moser , Sylvain Perifel

Large Language Models (LLMs) possess a theoretical capability to model information density far beyond the limits of classical statistical methods (e.g., Lempel-Ziv). However, utilizing this capability for lossless compression involves…

Information Theory · Computer Science 2026-03-27 Marcus Armstrong , ZiWei Qiu , Huy Q. Vo , Arjun Mukherjee

Lempel-Ziv (LZ77 or, briefly, LZ) is one of the most effective and widely-used compressors for repetitive texts. However, the existing efficient methods computing the exact LZ parsing have to use linear or close to linear space to index the…

Data Structures and Algorithms · Computer Science 2020-05-12 Dmitry Kosolobov , Daniel Valenzuela , Gonzalo Navarro , Simon J. Puglisi

The massive volume of data generated by LiDAR sensors in autonomous vehicles creates a bottleneck for real-time processing and vehicle-to-everything (V2X) transmission. Existing lossless compression methods often force a trade-off: industry…

Robotics · Computer Science 2026-03-25 Aditya Shibu , Kayvan Karim , Claudio Zito