English
Related papers

Related papers: Optimal Universal Lossless Compression with Side I…

200 papers

Text compression for large language model (LLM) systems is usually framed as token deletion, retrieval, summarization, or exact reconstruction. We study a more aggressive but explicitly lossy setting: compress text into compact codes that…

Machine Learning · Computer Science 2026-05-26 Natalia Trukhina , Vadim Vashkelis

Communication compression has become a key strategy to speed up distributed optimization. However, existing decentralized algorithms with compression mainly focus on compressing DGD-type algorithms. They are unsatisfactory in terms of…

Machine Learning · Computer Science 2021-03-22 Xiaorui Liu , Yao Li , Rongrong Wang , Jiliang Tang , Ming Yan

Computing the LZ factorization (or LZ77 parsing) of a string is a computational bottleneck in many diverse applications, including data compression, text indexing, and pattern discovery. We describe new linear time LZ factorization…

Data Structures and Algorithms · Computer Science 2020-12-11 Juha Kärkkäinen , Dominik Kempa , Simon J. Puglisi

We present an algorithm that constructs the LZ-End parsing (a variation of LZ77) of a given string of length $n$ in $O(n\log\ell)$ expected time and $O(z + \ell)$ space, where $z$ is the number of phrases in the parsing and $\ell$ is the…

Data Structures and Algorithms · Computer Science 2020-12-15 Dominik Kempa , Dmitry Kosolobov

In this paper, we develop a Localized Orthogonal Decomposition (LOD) method for the two-dimensional time-dependent nonlinear Schr\"{o}dinger equation with a wave operator. We prove that our method preserves conservation laws and admits a…

Numerical Analysis · Mathematics 2026-03-24 Hanzhang Hu , Zetao Ma , Lei Zhang

Today's scientific high performance computing (HPC) applications or advanced instruments are producing vast volumes of data across a wide range of domains, which introduces a serious burden on data transfer and storage. Error-bounded lossy…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-01 Xiaodong Yu , Sheng Di , Kai Zhao , jiannan Tian , Dingwen Tao , Xin Liang , Franck Cappello

Soft compression is a lossless image compression method, which is committed to eliminating coding redundancy and spatial redundancy at the same time by adopting locations and shapes of codebook to encode an image from the perspective of…

Information Theory · Computer Science 2020-12-14 Gangtao Xin , Pingyi Fan

Data compression is a well-studied (and well-solved) problem in the setup of long coding blocks. But important emerging applications need to compress data to memory words of small fixed widths. This new setup is the subject of this paper.…

Information Theory · Computer Science 2017-01-12 Ori Rottenstreich , Yuval Cassuto

This paper studies distributed stochastic nonconvex optimization problems with compressed communication and differential privacy, in which each agent aims to minimize the sum of all agents' cost functions by using local compressed…

Optimization and Control · Mathematics 2026-03-24 Antai Xie , Xiaoqiang Ren , Xinlei Yi , Tao Yang , Xiaofan Wang

We consider source coding with fixed lag side information at the decoder. We focus on the special case of perfect side information with unit lag corresponding to source coding with feedforward (the dual of channel coding with feedback)…

Information Theory · Computer Science 2007-07-16 Emin Martinian , Gregory W. Wornell

Many modern applications involve accessing and processing graphical data, i.e. data that is naturally indexed by graphs. Examples come from internet graphs, social networks, genomics and proteomics, and other sources. The typically large…

Information Theory · Computer Science 2023-01-18 Payam Delgosha , Venkat Anantharam

Today's scientific simulations require a significant reduction of data volume because of extremely large amounts of data they produce and the limited I/O bandwidth and storage space. Error-bounded lossy compressor has been considered one of…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-15 Xin Liang , Kai Zhao , Sheng Di , Sihuan Li , Robert Underwood , Ali M. Gok , Jiannan Tian , Junjing Deng , Jon C. Calhoun , Dingwen Tao , Zizhong Chen , Franck Cappello

In this paper, the problem of developing universal algorithms for compressed sensing of stochastic processes is studied. First, R\'enyi's notion of information dimension (ID) is generalized to analog stationary processes. This provides a…

Information Theory · Computer Science 2016-01-27 Shirin Jalali , H. Vincent Poor

The paper introduces a new technique for compressing Binary Decision Diagrams in those cases where random access is not required. Using this technique, compression and decompression can be done in linear time in the size of the BDD and…

Artificial Intelligence · Computer Science 2008-12-18 Esben Rune Hansen , S. Srinivasa Rao , Peter Tiedemann

Large multimodal models (LMMs) have advanced significantly by integrating visual encoders with extensive language models, enabling robust reasoning capabilities. However, compressing LMMs for deployment on edge devices remains a critical…

Artificial Intelligence · Computer Science 2025-07-29 Te Zhang , Yuheng Li , Junxiang Wang , Lujun Li

Lossy image compression networks aim to minimize the latent entropy of images while adhering to specific distortion constraints. However, optimizing the neural network can be challenging due to its nature of learning quantized latent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Yingwen Zhang , Meng Wang , Xihua Sheng , Peilin Chen , Junru Li , Li Zhang , Shiqi Wang

A likelihood encoder is studied in the context of lossy source compression. The analysis of the likelihood encoder is based on the soft-covering lemma. It is demonstrated that the use of a likelihood encoder together with the soft-covering…

Information Theory · Computer Science 2016-04-07 Eva C. Song , Paul Cuff , H. Vincent Poor

We present a new algorithm for computing the Lempel-Ziv Factorization (LZ77) of a given string of length $N$ in linear time, that utilizes only $N\log N + O(1)$ bits of working space, i.e., a single integer array, for constant size integer…

Data Structures and Algorithms · Computer Science 2013-10-08 Keisuke Goto , Hideo Bannai

A multiterminal lossy coding problem, which includes various problems such as the Wyner-Ziv problem and the complementary delivery problem as special cases, is considered. It is shown that any point in the achievable rate-distortion region…

Information Theory · Computer Science 2010-04-20 Shigeaki Kuzuoka , Akisato Kimura , Tomohiko Uyematsu

Traditional lossless text compression preserves every byte, but its gains on natural language are often modest in realistic operating regimes. We study \emph{lossy semantic text compression}, where the encoder strategically deletes parts of…

Computation and Language · Computer Science 2026-05-29 Yuchun Zou , Junhong Tong , Jun Li