English
Related papers

Related papers: A random coding theorem for "modulo-two adder" sou…

200 papers

In this work, the probability of an event under some joint distribution is bounded by measuring it with the product of the marginals instead (which is typically easier to analyze) together with a measure of the dependence between the two…

Information Theory · Computer Science 2020-10-22 Amedeo Roberto Esposito , Michael Gastpar , Ibrahim Issa

In the last few years, there has been a great interest in extending the information-theoretic scenario for the non-asymptotic or one-shot case, i.e., where the channel is used only once. We provide the one-shot rate region for the…

Information Theory · Computer Science 2013-02-26 Naresh Sharma , Naqueeb Ahmad Warsi

We consider a system in which two nodes take correlated measurements of a random source with time-varying and unknown statistics. The observations of the source at the first node are to be losslessly replicated with a given probability of…

Information Theory · Computer Science 2016-10-27 Fangzhou Chen , Bin Li , Can Emre Koksal

Consider the problem of distributed binary hypothesis testing with two terminals, where the decision is made at one of them (the "receiver"). We study the exponent of the error probability of the second type. Previously, an achievable…

Information Theory · Computer Science 2025-08-26 Yuval Kochman , Ligong Wang

This paper considers the multiple-access relay channel in a setting where two source nodes transmit packets to a destination node, both directly and via a relay node, over packet erasure channels. Intra-session network coding is used at the…

Information Theory · Computer Science 2022-03-08 Amjad Saeed Khan , Ioannis Chatzigeorgiou

We analyze the performance of a linear code used for a data compression of Slepian-Wolf type. In our framework, two correlated data are separately compressed into codewords employing Gallager-type codes and casted into a communication…

Disordered Systems and Neural Networks · Physics 2007-05-23 Tatsuto Murayama

Random linear network code has to sacrifice part of bandwidth to transfer the coding vectors, thus a head of size k log|T| is appended to each packet. We present a distributed random network coding approach based on the Chinese remainder…

Information Theory · Computer Science 2012-08-21 Zhifang Zhang

This paper has been withdrawn due to a critical error near equation (71). This error causes the entire argument of the paper to collapse. Emmanuel Candes of Stanford discovered the error, and has suggested a correct analysis, which will be…

Information Theory · Computer Science 2009-12-09 John Wright , Arvind Ganesh , Shankar Rao , Yi Ma

We consider zero error function computation in a three node wireless network. Nodes A and B observe $X$ and $Y$ respectively, and want to compute a function $f(X,Y)$ with zero error. To achieve this, nodes A and B send messages to a relay…

Information Theory · Computer Science 2014-11-26 Jithin Ravi , Bikash Kumar Dey

Recently, network error correction coding (NEC) has been studied extensively. Several bounds in classical coding theory have been extended to network error correction coding, especially the Singleton bound. In this paper, following the…

Information Theory · Computer Science 2010-11-08 Xuan Guang , Fang-Wei Fu , Zhen Zhang

A modification of Koetter-Kschischang codes for random networks is presented (these codes were also studied by Wang et al. in the context of authentication problems). The new codes have higher information rate, while maintaining the same…

Information Theory · Computer Science 2016-11-17 Vitaly Skachek

In this paper we study the redundancy of Huffman codes. In particular, we consider sources for which the probability of one of the source symbols is known. We prove a conjecture of Ye and Yeung regarding the upper bound on the redundancy of…

Information Theory · Computer Science 2016-11-17 Soheil Mohajer , Payam Pakzad , Ali Kakhbod

The coding problem over the Gray-Wyner network is studied from the second-order coding rates perspective. A tilted information density for this network is introduced in the spirit of Kostina-Verd\'u, and, under a certain regularity…

Information Theory · Computer Science 2017-04-11 Shun Watanabe

This work studies the problem of distributed compression of correlated sources with an action-dependent joint distribution. This class of problems is, in fact, an extension of the Slepian-Wolf model, but where cost-constrained actions taken…

Information Theory · Computer Science 2014-04-16 Oron Sabag , Haim H. Permuter , Asaf Cohen

We study two-layer belief networks of binary random variables in which the conditional probabilities Pr[childlparents] depend monotonically on weighted sums of the parents. In large networks where exact probabilistic inference is…

Machine Learning · Computer Science 2013-02-01 Michael Kearns , Lawrence Saul

In 1948, Shannon used a probabilistic argument to show the existence of codes achieving a maximal rate defined by the channel capacity. In 1954, Muller and Reed introduced a simple deterministic code construction based on polynomial…

Information Theory · Computer Science 2026-02-26 Emmanuel Abbe , Colin Sandon , Vladyslav Shashkov , Maryna Viazovska

In this paper, we study the upper and the lower bounds on the joint source-channel coding error exponent with decoder side-information. The results in the paper are non-trivial extensions of the Csiszar's classical paper [5]. Unlike the…

Information Theory · Computer Science 2009-01-26 Cheng Chang

This paper has been withdrawn by the author, due to a crucial error in the proof of Lemma 3.1.

Number Theory · Mathematics 2007-05-23 Tomohiro Yamada

We consider a noisy Slepian-Wolf problem where two correlated sources are separately encoded and transmitted over two independent binary memoryless symmetric channels. Each channel capacity is assumed to be characterized by a single…

Information Theory · Computer Science 2011-06-01 Arvind Yedla , Henry D. Pfister , Krishna Narayanan

A new universal coding/decoding scheme for random access with collision detection is given in the case of two senders. The result is used to give an achievable joint source-channel coding error exponent for multiple access channels in the…

Information Theory · Computer Science 2013-09-19 Lóránt Farkas , Tamás Kói