English
Related papers

Related papers: Local Decoding in Distributed Compression

200 papers

We extend Ziv and Lempel's model of finite-state encoders to the realm of lossy compression of individual sequences. In particular, the model of the encoder includes a finite-state reconstruction codebook followed by an information lossless…

Information Theory · Computer Science 2024-01-04 Neri Merhav

We derive upper and lower bounds for the error exponents of lossless streaming compression of two correlated sources under the blockwise and symbolwise settings. We consider the linear scaling regime in which the delay is a scalar multiple…

Information Theory · Computer Science 2016-02-24 Lin Zhou , Vincent Yan Fu Tan , Mehul Motani

This paper investigates the error probability of several decoding methods for a source code with decoder side information, where the decoding methods are: 1) symbol-wise maximum a posteriori decoding, 2) successive-cancellation decoding,…

Information Theory · Computer Science 2019-04-11 Jun Muramatsu

This paper concerns itself with the question of list decoding for general adversarial channels, e.g., bit-flip ($\textsf{XOR}$) channels, erasure channels, $\textsf{AND}$ ($Z$-) channels, $\textsf{OR}$ channels, real adder channels, noisy…

Information Theory · Computer Science 2019-09-11 Yihan Zhang , Amitalok J. Budkuley , Sidharth Jaggi

In this paper, we study the use of GF(q)-quantized LDGM codes for binary source coding. By employing quantization, it is possible to obtain binary codewords with a non-uniform distribution. The obtained statistics is hence suitable for…

Information Theory · Computer Science 2010-07-09 Lorenzo Cappellari

In 2009, a lossless compression algorithm based on 1D chaotic maps known as Generalized Lur\"{o}th Series (or GLS) has been proposed. This algorithm (GLS-coding) encodes the input message as a symbolic sequence on an appropriate 1D chaotic…

Information Theory · Computer Science 2013-08-13 Nithin Nagaraj

We consider visible compression for discrete memoryless sources of mixed quantum states when only classical information can be sent from Alice to Bob. We assume that Bob knows the source statistics, and that Alice and Bob have identical…

Quantum Physics · Physics 2007-05-23 Emina Soljanin

This paper studies the joint data and semantics lossy compression problem, i.e., an extension of the hidden lossy source coding problem that entails recovering both the hidden and observable sources. We aim to study the nonasymptotic and…

Information Theory · Computer Science 2024-08-20 Huiyuan Yang , Yuxuan Shi , Shuo Shao , Xiaojun Yuan

According to Kolmogorov complexity, every finite binary string is compressible to a shortest code -- its information content -- from which it is effectively recoverable. We investigate the extent to which this holds for infinite binary…

Information Theory · Computer Science 2019-01-23 George Barmpalias , Andrew Lewis-Pye

Prevalent predictive coding-based video compression methods rely on a heavy encoder to reduce temporal redundancy, which makes it challenging to deploy them on resource-constrained devices. Since the 1970s, distributed source coding theory…

Image and Video Processing · Electrical Eng. & Systems 2023-04-04 Xinjie Zhang , Jiawei Shao , Jun Zhang

The DNA storage channel is considered, in which a codeword is comprised of $M$ unordered DNA molecules. At reading time, $N$ molecules are sampled with replacement, and then each molecule is sequenced. A coded-index concatenated-coding…

Information Theory · Computer Science 2022-05-23 Nir Weinberger

The following critical phenomenon was recently discovered. When a memoryless source is compressed using a variable-length fixed-distortion code, the fastest convergence rate of the (pointwise) compression ratio to the optimal $R(D)$…

Probability · Mathematics 2007-07-13 Amir Dembo , Ioannis Kontoyiannis

Jointly Gaussian memoryless sources are observed at N distinct terminals. The goal is to efficiently encode the observations in a distributed fashion so as to enable reconstruction of any one of the observations, say the first one, at the…

Information Theory · Computer Science 2008-05-14 Saurabha Tavildar , Pramod Viswanath , Aaron B. Wagner

Transfer of nonlocal two-mode squeezed vacuum state through symmetrical and asymmetrical lossy channel is analysed and we demonstrate that the nonlocality is more robust against losses, than it has been previously suggested. It can be…

Quantum Physics · Physics 2007-05-23 Radim Filip , L. Mista

In this paper we consider the variable-length lossless source coding for discrete memoryless sources. We proposes a new encryption framework for securely transmitting codewords over a noiseless channel. The proposed source encryption…

Information Theory · Computer Science 2026-05-26 Yasutada Oohama , Bagus Santoso

As conventional communication systems based on classic information theory have closely approached the limits of Shannon channel capacity, semantic communication has been recognized as a key enabling technology for the further improvement of…

Information Theory · Computer Science 2023-06-06 Jiancheng Tang , Qianqian Yang , Zhaoyang Zhang

We devise achievable encoding schemes for distributed source compression for computing inner products, symmetric matrix products, and more generally, square matrix products, which are a class of nonlinear transformations. To that end, our…

Information Theory · Computer Science 2024-05-21 Derya Malak

Lossy image compression is generally formulated as a joint rate-distortion optimization to learn encoder, quantizer, and decoder. However, the quantizer is non-differentiable, and discrete entropy estimation usually is required for rate…

Computer Vision and Pattern Recognition · Computer Science 2017-09-20 Mu Li , Wangmeng Zuo , Shuhang Gu , Debin Zhao , David Zhang

We study lossy source coding under a distortion measure defined by the negative log-likelihood induced by a prescribed conditional distribution $P_{X|U}$. This \emph{log-likelihood distortion} models compression settings in which the…

Information Theory · Computer Science 2026-01-26 Anuj Kumar Yadav , Dan Song , Yanina Shkel , Ayfer Özgür

We consider the rate distortion problem with side information at the decoder posed and investigated by Wyner and Ziv. The rate distortion function indicating the trade-off between the rate on the data compression and the quality of data…

Information Theory · Computer Science 2016-04-27 Yasutada Oohama