English
Related papers

Related papers: Compression in the Space of Permutations

200 papers

Learned image compression codecs have recently achieved impressive compression performances surpassing the most efficient image coding architectures. However, most approaches are trained to minimize rate and distortion which often leads to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Daniele Mari , Simone Milani

We study the neural network (NN) compression problem, viewing the tension between the compression ratio and NN performance through the lens of rate-distortion theory. We choose a distortion metric that reflects the effect of NN compression…

Machine Learning · Computer Science 2022-02-11 Berivan Isik , Tsachy Weissman , Albert No

Rate distortion theory was developed for optimizing lossy compression of data, but it also has a lot of applications in statistics. In this paper we will see how rate distortion theory can be used to analyze a complicated data set involving…

Applications · Statistics 2023-03-22 Peter Harremoës

Visual data compression is shifting from human-centered reconstruction to machine-oriented representation coding. In this setting, an image is often mapped to a compact semantic embedding, which is then compressed and transmitted for…

Image and Video Processing · Electrical Eng. & Systems 2026-04-30 Andriy Enttsel , Vincent Corlay

We consider the computational aspects of lossy data compression problem, where the compression error is determined by a cover of the data space. We propose an algorithm which reduces the number of partitions needed to find the entropy with…

Information Theory · Computer Science 2012-04-03 Marek Śmieja , Jacek Tabor

We establish two strong senses of universality of logarithmic loss as a distortion criterion in lossy compression: For any fixed length lossy compression problem under an arbitrary distortion criterion, we show that there is an equivalent…

Information Theory · Computer Science 2017-09-04 Albert No , Tsachy Weissman

We present a new universal source code for distributions of unlabeled binary and ordinal trees that achieves optimal compression to within lower order terms for all tree sources covered by existing universal codes. At the same time, it…

Data Structures and Algorithms · Computer Science 2021-09-06 J. Ian Munro , Patrick K. Nicholson , Louisa Seelbach Benkner , Sebastian Wild

Motivated by questions in lossy data compression and by theoretical considerations, we examine the problem of estimating the rate-distortion function of an unknown (not necessarily discrete-valued) source from empirical data. Our focus is…

Information Theory · Computer Science 2013-01-18 M. T. Harrison , I. Kontoyiannis

Real-world data typically contain repeated and periodic patterns. This suggests that they can be effectively represented and compressed using only a few coefficients of an appropriate basis (e.g., Fourier, Wavelets, etc.). However, distance…

Machine Learning · Statistics 2014-05-26 Michail Vlachos , Nikolaos Freris , Anastasios Kyrillidis

Neural image compression methods have seen increasingly strong performance in recent years. However, they suffer orders of magnitude higher computational complexity compared to traditional codecs, which hinders their real-world deployment.…

Image and Video Processing · Electrical Eng. & Systems 2023-11-13 Yibo Yang , Stephan Mandt

We consider low-distortion embeddings for subspaces under \emph{entrywise nonlinear transformations}. In particular we seek embeddings that preserve the norm of all vectors in a space $S = \{y: y = f(x)\text{ for }x \in Z\}$, where $Z$ is a…

Machine Learning · Computer Science 2020-10-09 Aarshvi Gajjar , Cameron Musco

The Shannon Noiseless coding theorem (the data-compression principle) asserts that for an information source with an alphabet $\mathcal X=\{0,\ldots ,\ell -1\}$ and an asymptotic equipartition property, one can reduce the number of stored…

Information Theory · Computer Science 2016-04-26 Yuri Suhov , Izabella Stuhl

Camera sensors have been widely used in intelligent robotic systems. Developing camera sensors with high sensing efficiency has always been important to reduce the power, memory, and other related resources. Inspired by recent success on…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Bowen Zhang , Zhijin Qin , Geoffrey Ye Li

Perception-aware lossy source coding has attracted significant recent interest. It augments the classical distortion criterion with an explicit perception constraint, thereby enabling more refined control over fidelity and perceptual…

Information Theory · Computer Science 2026-04-22 Ali Hussein , Jun Chen , Chao Tian , S. Sandeep Pradhan

Recent interest on permutation rank modulation shows the Kendall tau metric as an important distance metric. This note documents our first efforts to obtain upper bounds on optimal code sizes (for said metric) ala Delsarte's approach. For…

Information Theory · Computer Science 2012-06-07 Fabian Lim , Manabu Hagiwara

Rate-distortion (R-D) function, a key quantity in information theory, characterizes the fundamental limit of how much a data source can be compressed subject to a fidelity criterion, by any compression algorithm. As researchers push for…

Information Theory · Computer Science 2022-03-14 Yibo Yang , Stephan Mandt

We establish the first information-theoretic limits for multimodal retrieval. Casting ranking as lossy source coding, we derive a single-letter rate-distortion function $R(D)$ for reciprocal-rank distortion and prove a converse bound that…

Information Theory · Computer Science 2025-09-16 Thomas Y. Chen

We formulate the problem of performing optimal data compression under the constraints that compressed data can be used for accurate classification in machine learning. We show that this translates to a problem of minimizing the mutual…

Signal Processing · Electrical Eng. & Systems 2022-11-04 Jingchao Gao , Ao Tang , Weiyu Xu

In lossy compression, the classical tradeoff between compression rate and reconstruction distortion has traditionally guided algorithm design. However, Blau and Michaeli [5] introduced a generalized framework, known as the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Nam Nguyen

Learning-based lossy image compression usually involves the joint optimization of rate-distortion performance. Most existing methods adopt spatially invariant bit length allocation and incorporate discrete entropy approximation to constrain…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Mu Li , Wangmeng Zuo , Shuhang Gu , Jane You , David Zhang