English
Related papers

Related papers: Improved Finite Blocklength Converses for Slepian-…

200 papers

Coding schemes for several problems in network information theory are constructed starting from point-to-point channel codes that are designed for symmetric channels. Given that the point-to-point codes satisfy certain properties pertaining…

Information Theory · Computer Science 2023-10-23 Nadim Ghaddar , Shouvik Ganguly , Lele Wang , Young-Han Kim

The Slepian-Wolf bound on the admissible coding rate forms the most fundamental aspect of distributed source coding. As such, it is necessary to provide a framework with which to model more practical scenarios with respect to the…

Information Theory · Computer Science 2021-04-21 Benjamin Rosen , Adnan M. Abu-Mahfouz , Ling Cheng

We consider a noisy Slepian-Wolf problem where two correlated sources are separately encoded and transmitted over two independent binary memoryless symmetric channels. Each channel capacity is assumed to be characterized by a single…

Information Theory · Computer Science 2011-06-01 Arvind Yedla , Henry D. Pfister , Krishna Narayanan

In this paper, we propose a polar coding based scheme for set reconciliation between two network nodes. The system is modeled as a well-known Slepian-Wolf setting induced by a fixed number of deletions. The set reconciliation process is…

Information Theory · Computer Science 2021-04-27 Ling Liu , Shengli Zhang , Cong Ling

Distributed Arithmetic Coding (DAC) has emerged as a feasible solution to the Slepian-Wolf problem, particularly in scenarios with non-stationary sources and for data sequences with lengths ranging from small to medium. Due to the inherent…

Information Theory · Computer Science 2025-04-17 Junwei Zhou , HaoYun Xiao , Jianwen Xi , Qiuzhen Lin

The LP-Newton method solves the linear programming problem (LP) by repeatedly projecting a current point onto a certain relevant polytope. In this paper, we extend the algorithmic framework of the LP-Newton method to the second-order cone…

Optimization and Control · Mathematics 2021-05-31 Takayuki Okuno , Mirai Tanaka

Motivated by recent work on entanglement-assisted codes for sending messages over classical channels, the larger, easily characterised class of non-signalling codes is defined. Analysing the optimal performance of these codes yields an…

Quantum Physics · Physics 2016-01-01 William Matthews

The polarization phenomenon for a single source is extended to a framework with multiple correlated sources. It is shown in addition to extracting the randomness of the source, the polar transforms takes the original arbitrary dependencies…

Information Theory · Computer Science 2014-11-13 Emmanuel Abbe

In source coding, either with or without side information at the decoder, the ultimate performance can be achieved by means of random binning. Structured binning into cosets of performing channel codes has been successfully employed in…

Information Theory · Computer Science 2010-08-03 Lorenzo Cappellari

We examine LDPC codes decoded using linear programming (LP). Four contributions to the LP framework are presented. First, a new method of tightening the LP relaxation, and thus improving the LP decoder, is proposed. Second, we present an…

Information Theory · Computer Science 2016-11-17 David Burshtein , Idan Goldenberg

In this paper, we use linear codes to study zero-error Slepian-Wolf coding of a set of sources with deviation symmetry, where the sources are generalization of the Hamming sources over an arbitrary field. We extend our previous codes,…

Information Theory · Computer Science 2013-08-06 Rick Ma , Samuel Cheng

We establish a coding theorem and a matching converse theorem for separate encodings and joint decoding of individual sequences using finite-state machines. The achievable rate region is characterized in terms of the Lempel-Ziv (LZ)…

Information Theory · Computer Science 2024-03-13 Neri Merhav

This paper presents a method for computing a finite-blocklength converse for the rate of fixed-length codes with feedback used on discrete memoryless channels (DMCs). The new converse is expressed in terms of a stochastic control problem…

Information Theory · Computer Science 2022-02-10 Felipe Areces , Dan Song , Richard Wesel , Aaron B. Wagner

In distributed multilevel diversity coding, $K$ correlated sources (each with $K$ components) are encoded in a distributed manner such that, given the outputs from any $\alpha$ encoders, the decoder can reconstruct the first $\alpha$…

Information Theory · Computer Science 2015-05-04 Zhiqing Xiao , Jun Chen , Yunzhou Li , Jing Wang

This paper studies variable-length (VL) source coding of general sources with side-information. Novel one-shot coding theorems for coding with common side-information available at the encoder and the decoder and Slepian- Wolf (SW) coding…

Information Theory · Computer Science 2014-04-09 Shigeaki Kuzuoka , Shun Watanabe

Diffusion language models (DLMs) have emerged as a promising alternative to autoregressive language generation due to their potential for parallel decoding and global refinement of the entire sequence. To unlock this potential, DLM…

Machine Learning · Computer Science 2026-04-20 Xiang Xia , Wuyang Zhang , Jiazheng Liu , Cheng Yan , Yanyong Zhang

Variable-length feedback coding has the potential to significantly enhance communication reliability in finite block length scenarios by adapting coding strategies based on real-time receiver feedback. Designing such codes, however, is…

Information Theory · Computer Science 2024-11-14 Wenwei Lai , Yulin Shao , Yu Ding , Deniz Gunduz

In this paper, we give a distributed joint source channel coding scheme for arbitrary correlated sources for arbitrary point in the Slepian-Wolf rate region, and arbitrary link capacities using LDPC codes. We consider the Slepian-Wolf…

Information Theory · Computer Science 2008-02-20 Vaneet Aggarwal

We consider a wireless sensors network scenario where two nodes detect correlated sources and deliver them to a central collector via a wireless link. Differently from the Slepian-Wolf approach to distributed source coding, in the proposed…

Information Theory · Computer Science 2007-07-13 A. Abrardo

This paper deals with the problem of multicasting a set of discrete memoryless correlated sources (DMCS) over a cooperative relay network. Necessary conditions with cut-set interpretation are presented. A \emph{Joint source-Wyner-Ziv…

Information Theory · Computer Science 2016-11-17 Mohammad Hossein Yassaee , Mohammad Reza Aref