English

Compression with the tudocomp Framework

Data Structures and Algorithms 2021-04-23 v2
Authors: Patrick Dinklage , Johannes Fischer , Dominik Köppl , Marvin Löbel , Kunihiko Sadakane
View on arXiv ↗ PDF ↗ DOI ↗

Abstract

We present a framework facilitating the implementation and comparison of text compression algorithms. We evaluate its features by a case study on two novel compression algorithms based on the Lempel-Ziv compression schemes that perform well on highly repetitive texts.

Keywords

image compression source coding

Cite

@article{arxiv.1702.07577,
  title  = {Compression with the tudocomp Framework},
  author = {Patrick Dinklage and Johannes Fischer and Dominik Köppl and Marvin Löbel and Kunihiko Sadakane},
  journal= {arXiv preprint arXiv:1702.07577},
  year   = {2021}
}

Related papers

View all related →
Data Structures and Algorithms · Computer Science
LZ-Compressed String Dictionaries
Julian Arz, Johannes Fischer
2013-05-06
Information Theory · Computer Science
Pushdown Compression
Pilar Albert, Elvira Mayordomo, Philippe Moser, Sylvain Perifel
2007-09-17
Computational Complexity · Computer Science
Polylog space compression, pushdown compression, and Lempel-Ziv are incomparable
Elvira Mayordomo, Philippe Moser, Sylvain Perifel
2009-03-25
Data Structures and Algorithms · Computer Science
Sublinear Algorithms for Approximating String Compressibility
Sofya Raskhodnikova, Dana Ron, Ronitt Rubinfeld, Adam Smith
2007-06-11
Data Structures and Algorithms · Computer Science
Improved Approximate String Matching and Regular Expression Matching on Ziv-Lempel Compressed Texts
Philip Bille, Rolf Fagerberg, Inge Li Goertz
2007-05-23
Computation and Language · Computer Science
Lightweight Conceptual Dictionary Learning for Text Classification Using Information Compression
Li Wan, Tansu Alpcan, Margreta Kuijper, Emanuele Viterbo
2024-05-06
Information Theory · Computer Science
A Self-contained Analysis of the Lempel-Ziv Compression Algorithm
Madhu Sudan, David Xiang
2019-10-03
Data Structures and Algorithms · Computer Science
Approximating Optimal Bidirectional Macro Schemes
Luís M. S. Russo, Ana D. Correia, Gonzalo Navarro, Alexandre P. Francisco
2020-03-06
Data Structures and Algorithms · Computer Science
LZD-style Compression Scheme with Truncation and Repetitions
Linus Götz, Dominik Köppl
2025-05-05
Hardware Architecture · Computer Science
A High-Throughput Hardware Accelerator for Lempel-Ziv 4 Compression Algorithm
Tao Chen, Suwen Song, Zhongfeng Wang
2024-09-20
Information Theory · Computer Science
Lossy Compression in Near-Linear Time via Efficient Random Codebooks and Databases
Chris Gioran, Ioannis Kontoyiannis
2009-04-23
Information Retrieval · Computer Science
Universal Indexes for Highly Repetitive Document Collections
Francisco Claude, Antonio Fariña, Miguel A. Martínez-Prieto, Gonzalo Navarro
2016-05-25
Data Structures and Algorithms · Computer Science
Relative Lempel-Ziv Factorization for Efficient Storage and Retrieval of Web Collections
Christopher Hoobin, Simon J. Puglisi, Justin Zobel
2015-03-19
Multimedia · Computer Science
A study for Image compression using Re-Pair algorithm
Pasquale De Luca, Vincenzo Maria Russiello, Raffaele Ciro Sannino, Lorenzo Valente
2019-02-14
Computation and Language · Computer Science
zip2zip: Inference-Time Adaptive Tokenization via Online Compression
Saibo Geng, Nathan Ranchin, Yunzhen yao, Maxime Peyrard +3
2025-10-27
Information Theory · Computer Science
AlphaZip: Neural Network-Enhanced Lossless Text Compression
Swathi Shree Narashiman, Nitin Chandrachoodan
2024-09-24
Information Theory · Computer Science
IDBE - An Intelligent Dictionary Based Encoding Algorithm for Text Data Compression for High Speed Data Transmission Over Internet
B. S. Shajee Mohan, V. K. Govindan
2007-07-13
Data Structures and Algorithms · Computer Science
Time and Memory Efficient Lempel-Ziv Compression Using Suffix Arrays
Artur Ferreira, Arlindo Oliveira, Mario Figueiredo
2009-12-31
Computation and Language · Computer Science
MultiTok: Variable-Length Tokenization for Efficient LLMs Adapted from LZW Compression
Noel Elias, Homa Esfahanizadeh, Kaan Kale, Sriram Vishwanath +1
2026-04-27
Data Structures and Algorithms · Computer Science
Substring Compression Variations and LZ78-Derivates
Dominik Köppl
2024-09-24
Data Structures and Algorithms · Computer Science
$O(n \log n)$-time text compression by LZ-style longest first substitution
Akihiro Nishi, Yuto Nakashima, Shunsuke Inenaga, Hideo Bannai +1
2018-06-14
Data Structures and Algorithms · Computer Science
RLZAP: Relative Lempel-Ziv with Adaptive Pointers
Anthony J. Cox, Andrea Farruggia, Travis Gagie, Simon J. Puglisi +1
2016-05-17
Data Structures and Algorithms · Computer Science
Bit-Optimal Lempel-Ziv compression
Paolo Ferragina, Igor Nitto, Rossano Venturini
2008-02-07
Data Structures and Algorithms · Computer Science
Lempel-Ziv-like Parsing in Small Space
Dmitry Kosolobov, Daniel Valenzuela, Gonzalo Navarro, Simon J. Puglisi
2020-05-12
Computation and Language · Computer Science
An Enhanced Text Compression Approach Using Transformer-based Language Models
Chowdhury Mofizur Rahman, Mahbub E Sobhani, Anika Tasnim Rodela, Swakkhar Shatabda
2024-12-23