English
Related papers

Related papers: Distributed Multilevel Diversity Coding

200 papers

Let $X_1, ..., X_m$ be a set of $m$ statistically dependent sources over the common alphabet $\mathbb{F}_q$, that are linearly independent when considered as functions over the sample space. We consider a distributed function computation…

Information Theory · Computer Science 2016-11-17 V. Lalitha , N. Prakash , K. Vinodh , P. Vijay Kumar , S. Sandeep Pradhan

In this paper, we use linear codes to study zero-error Slepian-Wolf coding of a set of sources with deviation symmetry, where the sources are generalization of the Hamming sources over an arbitrary field. We extend our previous codes,…

Information Theory · Computer Science 2013-08-06 Rick Ma , Samuel Cheng

Distributed arithmetic coding (DAC) has been shown to be effective for Slepian-Wolf coding, especially for short data blocks. In this letter, we propose to use the DAC to compress momery-correlated sources. More specifically, the…

Information Theory · Computer Science 2021-01-08 Yong Fang , Jechang Jeong

Top-$k$ decoding is a widely used method for sampling from LLMs: at each token, only the largest $k$ next-token-probabilities are kept, and the next token is sampled after re-normalizing them to sum to unity. Top-$k$ and other sampling…

Artificial Intelligence · Computer Science 2026-02-24 Georgy Noarov , Soham Mallick , Tao Wang , Sunay Joshi , Yan Sun , Yangxinyu Xie , Mengxin Yu , Edgar Dobriban

We consider the problem of distributed compression for correlated quantum sources. The classical version of this problem was solved by Slepian and Wolf, who showed that distributed compression could take full advantage of redundancy in the…

Quantum Physics · Physics 2007-05-23 Charlene Ahn , Andrew Doherty , Patrick Hayden , Andreas Winter

Multilevel diversity coding is a classical coding model where multiple mutually independent information messages are encoded, such that different reliability requirements can be afforded to different messages. It is well known that {\em…

Information Theory · Computer Science 2020-06-11 Tao Guo , Chao Tian , Tie Liu , Raymond W. Yeung

This paper investigates a unification of distributed source coding, multiple description coding, and source coding with side information at decoders. The equivalence between the multiple-decoder extension of distributed source coding with…

Information Theory · Computer Science 2024-10-28 Jun Muramatsu

In this paper, distributed (or multiterminal) source coding with one distortion criterion and correlated messages is considered. This problem can be also called ``Berger-Yeung problem with correlated messages''. It corresponds to the source…

Information Theory · Computer Science 2009-08-18 Suhan Choi

Coding schemes for several problems in network information theory are constructed starting from point-to-point channel codes that are designed for symmetric channels. Given that the point-to-point codes satisfy certain properties pertaining…

Information Theory · Computer Science 2023-10-23 Nadim Ghaddar , Shouvik Ganguly , Lele Wang , Young-Han Kim

We study the transmission of correlated sources over discrete memoryless (DM) multiple-access-relay channels (MARCs), in which both the relay and the destination have access to side information arbitrarily correlated with the sources. As…

Information Theory · Computer Science 2014-07-29 Yonathan Murin , Ron Dabora , Deniz Gündüz

A method to construct nonasymmetric distributed source coding (DSC) scheme using polar codes which can achieve any point on the dominant face of the Slepian-Wolf (SW) rate region for sources with uniform marginals is considered. In addition…

Information Theory · Computer Science 2012-08-16 Saygun Onay

We consider a distributed source coding system in which several observations are communicated to the decoder using limited transmission rate. The observations must be separately coded. We introduce a robust distributed coding scheme which…

Information Theory · Computer Science 2007-07-13 Jun Chen , Toby Berger

We consider the problem of distributed joint source-channel coding of correlated Gaussian sources over a Gaussian Multiple Access Channel (GMAC). There may be side information at the decoder and/or at the encoders. First we specialize a…

Information Theory · Computer Science 2009-05-15 R Rajesh , Vinod Sharma

The polarization phenomenon for a single source is extended to a framework with multiple correlated sources. It is shown in addition to extracting the randomness of the source, the polar transforms takes the original arbitrary dependencies…

Information Theory · Computer Science 2014-11-13 Emmanuel Abbe

This paper extends the well-known source coding problem of multiple descriptions, in its general and basic setting, to analog source-channel coding scenarios. Encoding-decoding functions that optimally map between the (possibly continuous…

Information Theory · Computer Science 2015-10-05 Mustafa Said Mehmetoglu , Emrah Akyol , Kenneth Rose

Digital contents in large scale distributed storage systems may have different reliability and access delay requirements, and for this reason, erasure codes with different strengths need to be utilized to achieve the best storage…

Information Theory · Computer Science 2016-04-29 Chao Tian , Tie Liu

Our work addresses the well-known open problem of distributed computing of bilinear functions of two correlated sources ${\bf A}$ and ${\bf B}$. In a setting with two nodes, with the first node having access to ${\bf A}$ and the second to…

Information Theory · Computer Science 2026-05-12 Derya Malak

In this paper, a multi-source multi-relay cooperative wireless network with binary modulation and binary network coding is studied. The system model encompasses: i) a demodulate-and-forward protocol at the relays, where the received packets…

Information Theory · Computer Science 2012-04-24 Marco Di Renzo , Michela Iezzi , Fabio Graziosi

Distributed source coding (DSC) is the task of encoding an input in the absence of correlated side information that is only available to the decoder. Remarkably, Slepian and Wolf showed in 1973 that an encoder without access to the side…

Information Theory · Computer Science 2024-07-02 Jay Whang , Alliot Nagle , Anish Acharya , Hyeji Kim , Alexandros G. Dimakis

We consider Slepian-Wolf code design based on LDPC (low-density parity-check) coset codes for memoryless source-side information pairs. A density evolution formula, equipped with a concentration theorem, is derived for Slepian- Wolf coding…

Information Theory · Computer Science 2007-07-13 Jun Chen , Da-ke He , Ashish Jagmohan