English
Related papers

Related papers: A Dichotomy of Functions in Distributed Coding: An…

200 papers

We propose a model for deterministic distributed function computation by a network of identical and anonymous nodes, with bounded computation and storage capabilities that do not scale with the network size. Our goal is to characterize the…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-07-28 Julien M. Hendrickx , Alex Olshevsky , John N. Tsitsiklis

Under the paradigm of caching, partial data is delivered before the actual requests of users are known. In this paper, this problem is modeled as a canonical distributed source coding problem with side information, where the side…

Information Theory · Computer Science 2016-11-17 Chien-Yi Wang , Sung Hoon Lim , Michael Gastpar

We study the following semi-deterministic setting of the joint source-channel coding problem: a deterministic source sequence (a.k.a. individual sequence) is transmitted via a memoryless channel, using delay-limited encoder and decoder,…

Information Theory · Computer Science 2021-09-29 Neri Merhav

This paper studies the random-coding exponent of joint source-channel coding for a scheme where source messages are assigned to disjoint subsets (referred to as classes), and codewords are independently generated according to a distribution…

Information Theory · Computer Science 2014-02-19 Adrià Tauste Campo , Gonzalo Vazquez-Vilar , Albert Guillén i Fàbregas , Tobias Koch , Alfonso Martinez

We consider a noisy Slepian-Wolf problem where two correlated sources are separately encoded (using codes of fixed rate) and transmitted over two independent binary memoryless symmetric channels. The capacity of each channel is…

Information Theory · Computer Science 2012-01-04 Arvind Yedla , Henry D. Pfister , Krishna R. Narayanan

In distributed multilevel diversity coding, $K$ correlated sources (each with $K$ components) are encoded in a distributed manner such that, given the outputs from any $\alpha$ encoders, the decoder can reconstruct the first $\alpha$…

Information Theory · Computer Science 2015-05-04 Zhiqing Xiao , Jun Chen , Yunzhou Li , Jing Wang

This paper provides a source coding theorem for multi-dimensional information signals when, at a given instant, the distribution associated with one arbitrary component of the signal to be compressed is not known and a side information is…

Information Theory · Computer Science 2012-10-24 Maël Le Treust , Samson Lasaulce

This work addresses the problem of distributed computation of linearly separable functions, where a master node with access to $K$ datasets, employs $N$ servers to compute $L$ user-requested functions, each defined over the datasets.…

Information Theory · Computer Science 2025-09-30 K. K. Krishnan Namboodiri , Elizabath Peter , Derya Malak , Petros Elia

Computational hardness assumption from the syndrome decoding problem has been useful in designing the security of code based cryptosystem that are safe against quantum computing. Due to complexities in solution using high degree linearized…

Information Theory · Computer Science 2021-06-30 Kelechi Chuwkunonyerem Emerole , Said Boussakta

We consider correlated and distributed sources without cooperation at the encoder. For these sources, we derive the best achievable performance in the rate-distortion sense of any distributed compressed sensing scheme, under the constraint…

Information Theory · Computer Science 2014-04-10 Giulio Coluccia , Aline Roumy , Enrico Magli

Shaping codes are used to encode information for use on channels with cost constraints. Applications include data transmission with a power constraint and, more recently, data storage on flash memories with a constraint on memory cell wear.…

Information Theory · Computer Science 2020-01-10 Yi Liu , Pengfei Huang , Alexander W. Bergman , Paul H. Siegel

The fundamental limit of natural signal compression has traditionally been characterized by classical rate-distortion (RD) theory through the tradeoff between coding rate and reconstruction distortion, while the rate-distortion-perception…

Information Theory · Computer Science 2026-04-17 Zijian Liang , Kai Niu , Changshuo Wang , Jin Xu , Ping Zhang

While neural lossy compression techniques have markedly advanced the efficiency of Channel State Information (CSI) compression and reconstruction for feedback in MIMO communications, efficient algorithms for more challenging and practical…

Rate-distortion (R-D) function, a key quantity in information theory, characterizes the fundamental limit of how much a data source can be compressed subject to a fidelity criterion, by any compression algorithm. As researchers push for…

Information Theory · Computer Science 2022-03-14 Yibo Yang , Stephan Mandt

In this paper, we use linear codes to study zero-error Slepian-Wolf coding of a set of sources with deviation symmetry, where the sources are generalization of the Hamming sources over an arbitrary field. We extend our previous codes,…

Information Theory · Computer Science 2013-08-06 Rick Ma , Samuel Cheng

A lossy source coding problem is studied in which a source encoder communicates with two decoders, one with and one without correlated side information with an additional constraint on the privacy of the side information at the uninformed…

Information Theory · Computer Science 2011-06-13 Ravi Tandon , Lalitha Sankar , H. Vincent Poor

Numerical solutions to fractional differential equations can be extremely computationally intensive due to the effect of non-local derivatives in which all previous time points contribute to the current iteration. In finite difference…

Mathematical Physics · Physics 2010-04-30 Brian P. Sprouse , Christopher L. MacDonald , Gabriel A. Silva

This paper investigates applications of nonanticipative Rate Distortion Function (RDF) in a) zero-delay Joint Source-Channel Coding (JSCC) design based on average and excess distortion probability, b) in bounding the Optimal Performance…

Information Theory · Computer Science 2016-11-17 Photios A. Stavrou , Christos K. Kourtellaris , C. D. Charalambous

We consider the function computation problem in a three node network with one encoder and two decoders. The encoder has access to two correlated sources $X$ and $Y$. The encoder encodes $X^n$ and $Y^n$ into a message which is given to two…

Information Theory · Computer Science 2016-10-05 Jithin Ravi , Bikash Kumar Dey

In this paper, distributed (or multiterminal) source coding with one distortion criterion and correlated messages is considered. This problem can be also called ``Berger-Yeung problem with correlated messages''. It corresponds to the source…

Information Theory · Computer Science 2009-08-18 Suhan Choi