English
Related papers

Related papers: Local Decoding in Distributed Compression

200 papers

We present a Deep Image Compression neural network that relies on side information, which is only available to the decoder. We base our algorithm on the assumption that the image available to the encoder and the image available to the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Sharon Ayzik , Shai Avidan

This paper considers the problem of variable-length lossy source coding. The performance criteria are the excess distortion probability and the cumulant generating function of codeword lengths. We derive a non-asymptotic fundamental limit…

Information Theory · Computer Science 2023-12-29 Shota Saito , Toshiyasu Matsushima

The problem of joint detection and lossless source coding is considered. We derive asymptotically optimal decision rules for deciding whether or not a sequence of observations has emerged from a desired information source, and to compress…

Information Theory · Computer Science 2016-11-17 Neri Merhav

We consider a variable-length source coding problem subject to local decodability constraints. In particular, we investigate the blocklength scaling behavior attainable by encodings of $r$-sparse binary sequences, under the constraint that…

Information Theory · Computer Science 2015-04-09 Ashwin Pananjady , Thomas A. Courtade

A lossy source coding problem is studied in which a source encoder communicates with two decoders, one with and one without correlated side information with an additional constraint on the privacy of the side information at the uninformed…

Information Theory · Computer Science 2011-06-13 Ravi Tandon , Lalitha Sankar , H. Vincent Poor

This work considers the problem of transmitting multiple compressible sources over a network at minimum cost. The aim is to find the optimal rates at which the sources should be compressed and the network flows using which they should be…

Information Theory · Computer Science 2009-08-13 Aditya Ramamoorthy

Distributed source coding is traditionally viewed in the block coding context -- all the source symbols are known in advance at the encoders. This paper instead considers a streaming setting in which iid source symbol pairs are revealed to…

Information Theory · Computer Science 2007-07-13 Cheng Chang , Stark Draper , Anant Sahai

In the literature there exists analytical expressions for the probability of a receiver decoding a transmitted source message that has been encoded using random linear network coding. In this work, we look into the probability that the…

Information Theory · Computer Science 2022-03-08 Jessica Claridge , Ioannis Chatzigeorgiou

This paper shows the strong converse and the dispersion of memoryless channels with cost constraints and performs refined analysis of the third order term in the asymptotic expansion of the maximum achievable channel coding rate, showing…

Information Theory · Computer Science 2015-10-09 Victoria Kostina , Sergio Verdú

flip is an extremely simple and maximally local classical decoder which has been used to great effect in certain classes of classical codes. When applied to quantum codes there exist constant-weight errors (such as half of a stabiliser)…

Quantum Physics · Physics 2023-08-30 T. R. Scruby , K. Nemoto

In this paper we consider data storage from a probabilistic point of view and obtain bounds for efficient storage in the presence of feature selection and undersampling, both of which are important from the data science perspective. First,…

Information Theory · Computer Science 2023-09-26 Ghurumuruhan Ganesan

Machine learning has had a major impact on data compression over the last decade and inspired many new, exciting theoretical and applied questions. This paper describes one such direction -- relative entropy coding -- which focuses on…

Information Theory · Computer Science 2026-02-10 Gergely Flamich , Deniz Gündüz

Classical source polar codes require the construction of frozen sets for given sources. While this scheme offers excellent theoretical performance, it faces challenges in practical data compression systems, including sensitivity to the…

Information Theory · Computer Science 2025-01-23 Zichang Ren , Yuping Zhao

We consider a network of two nodes separated by a noisy channel, in which the input and output signals have to be coordinated with the source and its reconstruction. In the case of strictly causal encoding and non-causal decoding, we prove…

Information Theory · Computer Science 2018-10-15 Giulia Cervia , Laura Luzzi , Maël Le Treust , Matthieu R. Bloch

This work studies distributed compression for the uplink of a cloud radio access network where multiple multi-antenna base stations (BSs) are connected to a central unit, also referred to as cloud decoder, via capacity-constrained backhaul…

Information Theory · Computer Science 2012-06-19 Seok-Hwan Park , Osvaldo Simeone , Onur Sahin , Shlomo Shamai

Over discrete memoryless channels (DMC), linear decoders (maximizing additive metrics) afford several nice properties. In particular, if suitable encoders are employed, the use of decoding algorithm with manageable complexities is…

Information Theory · Computer Science 2008-10-01 Emmanuel Abbe , Lizhong Zheng

We study a quantum analogue of locally decodable error-correcting codes. A q-query locally decodable quantum code encodes n classical bits in an m-qubit state, in such a way that each of the encoded bits can be recovered with high…

Quantum Physics · Physics 2008-06-13 Jop Briët , Ronald de Wolf

The exponential strong converse for a coding problem states that, if a coding rate is beyond the theoretical limit, the correct probability converges to zero exponentially. For the lossy source coding with side-information, also known as…

Information Theory · Computer Science 2025-04-24 Shun Watanabe

The problem of the universal compression of a sequence from a library of several small to moderate length sequences from similar context arises in many practical scenarios, such as the compression of the storage data and the Internet…

Information Theory · Computer Science 2015-03-20 Ahmad Beirami , Faramarz Fekri

A lossy source code $\mathcal{C}$ with rate $R$ for a discrete memoryless source $S$ is called subset-universal if for every $0<R'< R$, almost every subset of $2^{nR'}$ of its codewords achieves average distortion close to the source's…

Information Theory · Computer Science 2015-03-13 Or Ordentlich , Ofer Shayevitz