English
Related papers

Related papers: Low density codes achieve the rate-distortion boun…

200 papers

We investigate weakly constrained codes, in which specific patterns occur with prescribed frequencies rather than being strictly forbidden as in conventional constrained coding. We propose a capacity-achieving construction of a weakly…

Information Theory · Computer Science 2026-05-22 Prachi Mishra , Sidharth Jaggi , Navin Kashyap , Michael Langberg

We consider the problem of constructing deletion correcting codes over a binary alphabet and take a graph theoretic view. An $n$-bit $s$-deletion correcting code is an independent set in a particular graph. We propose constructing such a…

Information Theory · Computer Science 2012-11-20 Daniel Cullina , Ankur A. Kulkarni , Negar Kiyavash

We determine the rate region of the Gaussian scalar-help-vector source-coding problem under a covariance matrix distortion constraint. The rate region is achieved by a Gaussian achievable scheme. We introduce a novel outer bounding…

Information Theory · Computer Science 2010-01-27 Md Saifur Rahman , Aaron B. Wagner

We study lossy source coding under a distortion measure defined by the negative log-likelihood induced by a prescribed conditional distribution $P_{X|U}$. This \emph{log-likelihood distortion} models compression settings in which the…

Information Theory · Computer Science 2026-01-26 Anuj Kumar Yadav , Dan Song , Yanina Shkel , Ayfer Özgür

The three-node multiterminal lossy source coding problem is investigated. We derive an inner bound to the general rate-distortion region of this problem which is a natural extension of the seminal work by Kaspi'85 on the interactive…

Information Theory · Computer Science 2016-01-19 Leonardo Rey Vega , Pablo Piantanida , Alfred Hero

Since Shannon's foundational work, rate-distortion theory has defined the fundamental limits of lossy compression. Classical results, derived for memoryless and stationary ergodic sources in the asymptotic regime, have shaped both transform…

Information Theory · Computer Science 2026-03-11 Sujata Sinha , Vishwas Rao , Robert Underwood , David Lenz , Sheng Di , Franck Cappello , Lingjia Liu

We investigate the optimal performance of dense sensor networks by studying the joint source-channel coding problem. The overall goal of the sensor network is to take measurements from an underlying random process, code and transmit those…

Information Theory · Computer Science 2007-07-13 Nan Liu , Sennur Ulukus

The problem of side-information scalable (SI-scalable) source coding is considered in this work, where the encoder constructs a progressive description, such that the receiver with high quality side information will be able to truncate the…

Information Theory · Computer Science 2007-08-01 Chao Tian , Suhas N. Diggavi

We consider the variable-to-fixed length lossy source coding (VFSC) problem. The optimal compression rate of the average length of variable-to-fixed source coding, allowing a non-vanishing probability of excess-distortion $\varepsilon$, is…

Information Theory · Computer Science 2018-03-20 Lan V. Truong , Vincent Y. F. Tan

We describe message-passing and decimation approaches for lossy source coding using low-density generator matrix (LDGM) codes. In particular, this paper addresses the problem of encoding a Bernoulli(0.5) source: for randomly generated LDGM…

Information Theory · Computer Science 2007-07-13 Martin J. Wainwright , Elitza Maneva

By a locally recoverable code (LRC), we will in this paper, mean a linear code in which a given code symbol can be recovered by taking a linear combination of at most $r$ other code symbols with $r << k$. A natural extension is to the local…

Information Theory · Computer Science 2018-12-07 S. B. Balaji , Ganesh R. Kini , P. Vijay Kumar

A fundamental question in designing lossy data compression schemes is how well one can do in comparison with the rate-distortion function, which describes the known theoretical limits of lossy compression. Motivated by the empirical success…

Information Theory · Computer Science 2024-03-05 Eric Lei , Hamed Hassani , Shirin Saeedi Bidokhti

End-to-end optimized neural image compression (NIC) has obtained superior lossy compression performance recently. In this paper, we consider the problem of rate-distortion (R-D) characteristic analysis and modeling for NIC. We make efforts…

Image and Video Processing · Electrical Eng. & Systems 2022-01-14 Chuanmin Jia , Ziqing Ge , Shanshe Wang , Siwei Ma , Wen Gao

In this paper we consider the rate distortion problem of discrete-time, ergodic, and stationary sources with feed forward at the receiver. We derive a sequence of achievable and computable rates that converge to the feed-forward rate…

Information Theory · Computer Science 2011-06-07 Iddo Naiss , Haim Permuter

An effective 'on-the-fly' mechanism for stochastic lossy coding of Markov sources using string matching techniques is proposed in this paper. Earlier work has shown that the rate-distortion bound can be asymptotically achieved by a 'natural…

Information Theory · Computer Science 2023-01-18 Ahmed Elshafiy , Kenneth Rose

Non-binary low-density parity-check codes are robust to various channel impairments. However, based on the existing decoding algorithms, the decoder implementations are expensive because of their excessive computational complexity and…

Information Theory · Computer Science 2016-11-18 Chung-Li Wang , Xiaoheng Chen , Zongwang Li , Shaohua Yang

We consider the multi-user lossy source-coding problem for continuous alphabet sources. In a previous work, Ziv proposed a single-user universal coding scheme which uses uniform quantization with dither, followed by a lossless source…

Information Theory · Computer Science 2014-11-14 Avraham Reani , Neri Merhav

Locally Decodable Codes (LDCs) are error-correcting codes $C\colon\Sigma^n\rightarrow \Sigma^m,$ encoding \emph{messages} in $\Sigma^n$ to \emph{codewords} in $\Sigma^m$, with super-fast decoding algorithms. They are important mathematical…

Information Theory · Computer Science 2026-03-03 Alexander R. Block , Jeremiah Blocki , Kuan Cheng , Elena Grigorescu , Xin Li , Yu Zheng , Minshen Zhu

We discuss, in terms of rate-distortion theory, the fitness of molecular codes as the problem of designing an optimal information channel. The fitness is governed by an interplay between the cost and quality of the channel, which induces…

Molecular Networks · Quantitative Biology 2010-07-26 Tsvi Tlusty

Secure codes are widely-studied combinatorial structures which were introduced for traitor tracing in broadcast encryption. To determine the maximum size of such structures is the main research objective. In this paper, we investigate the…

Information Theory · Computer Science 2021-08-24 Bingchen Qian , Xin Wang , Gennian Ge