English
Related papers

Related papers: Reed-Muller Codes Achieve Capacity on Erasure Chan…

200 papers

Reed-Muller (RM) codes have undergone significant analytical advancements over the past decade, particularly for binary memoryless symmetric (BMS) channels. We extend the scope of RM codes development and analysis to multiple-access…

Information Theory · Computer Science 2025-06-11 Dina Abdelhadi , Colin Sandon , Emmanuel Abbe , Ruediger Urbanke

In this paper we prove threshold saturation for spatially coupled turbo codes (SC-TCs) and braided convolutional codes (BCCs) over the binary erasure channel. We introduce a compact graph representation for the ensembles of SC-TC and BCC…

Information Theory · Computer Science 2015-08-11 Saeedeh Moloudi , Michael Lentmaier , Alexandre Graell i Amat

This work investigates the fundamental limits of communication over a noisy discrete memoryless channel that wears out, in the sense of signal-dependent catastrophic failure. In particular, we consider a channel that starts as a memoryless…

Information Theory · Computer Science 2018-08-07 Ting-Yi Wu , Lav R. Varshney , Vincent Y. F. Tan

This work studies the problem of constructing capacity-achieving codes from an algorithmic perspective. Specifically, we prove that there exists a Turing machine which, given a discrete memoryless channel $p_{Y|X}$, a target rate $R$ less…

Information Theory · Computer Science 2025-11-06 Angelos Gkekas , Nikos A. Mitsiou , Ioannis Souldatos , George K. Karagiannidis

Locally repairable codes (LRCs) were originally introduced to enable efficient recovery from erasures in distributed storage systems by accessing only a small number of other symbols. While their structural properties-such as bounds and…

Information Theory · Computer Science 2026-02-23 Hoang Ly , Emina Soljanin , Philip Whiting

This paper considers multiplexing two sequences of messages with two different decoding delays over a packet erasure channel. In each time slot, the source constructs a packet based on the current and previous messages and transmits the…

Information Theory · Computer Science 2019-11-12 Silas L. Fong , Ashish Khisti , Baochun Li , Wai-Tian Tan , Xiaoqing Zhu , John Apostolopoulos

In this paper, we study binary constrained codes that are resilient to bit-flip errors and erasures. In our first approach, we compute the sizes of constrained subcodes of linear codes. Since there exist well-known linear codes that achieve…

Information Theory · Computer Science 2023-04-20 V. Arvind Rameshwar , Navin Kashyap

The paper considers the input-constrained binary erasure channel (BEC) with causal, noiseless feedback. The channel input sequence respects the $(d,\infty)$-runlength limited (RLL) constraint, i.e., any pair of successive $1$s must be…

Information Theory · Computer Science 2021-02-19 V. Arvind Rameshwar , Navin Kashyap

This paper considers the transmission of an infinite sequence of messages (a streaming source) over a packet erasure channel, where every source message must be recovered perfectly at the destination subject to a fixed decoding delay. While…

Information Theory · Computer Science 2020-05-14 Elad Domanovitz , Silas L. Fong , Ashish Khisti

In this work, we address the question of the largest rate of linear subcodes of Reed-Muller (RM) codes, all of whose codewords respect a runlength-limited (RLL) constraint. Our interest is in the $(d,\infty)$-RLL constraint, which mandates…

Information Theory · Computer Science 2022-08-05 V. Arvind Rameshwar , Navin Kashyap

The paper introduces new bounds on the asymptotic density of parity-check matrices and the achievable rates under ML decoding of binary linear block codes transmitted over memoryless binary-input output-symmetric channels. The lower bounds…

Information Theory · Computer Science 2007-07-13 Gil Wiechman , Igal Sason

We introduce the notion of the stopping redundancy hierarchy of a linear block code as a measure of the trade-off between performance and complexity of iterative decoding for the binary erasure channel. We derive lower and upper bounds for…

Information Theory · Computer Science 2016-11-15 Thorsten Hehn , Olgica Milenkovic , Stefan Laendner , Johannes B. Huber

We develop a systematic approach, based on convex programming and real analysis, for obtaining upper bounds on the capacity of the binary deletion channel and, more generally, channels with i.i.d. insertions and deletions. Other than the…

Information Theory · Computer Science 2018-06-12 Mahdi Cheraghchi

We identify a family of binary codes whose structure is similar to Reed-Muller (RM) codes and which include RM codes as a strict subclass. The codes in this family are denoted as $C_n(r,m)$, and their duals are denoted as $B_n(r,m)$. The…

Information Theory · Computer Science 2023-07-26 Lakshmi Prasad Natarajan , Prasad Krishnan

Block codes are considered for improving the reliability of messages stored in a computer memory with both stuck-at defects and random errors. It is assumed that the side information about the state of the defects is available to the…

Information Theory · Computer Science 2026-05-22 Ivana Djurdjevic , Robert Mateescu , Cyril Guyot

The input-constrained erasure channel with feedback is considered, where the binary input sequence contains no consecutive ones, i.e., it satisfies the $(1,\infty)$-RLL constraint. We derive the capacity for this setting, which can be…

Information Theory · Computer Science 2015-03-12 Oron Sabag , Haim H. Permuter , Navin Kashyap

We derive an upper bound on the capacity of non-binary deletion channels. Although binary deletion channels have received significant attention over the years, and many upper and lower bounds on their capacity have been derived, such…

Information Theory · Computer Science 2013-10-10 Mojtaba Rahmati , Tolga M. Duman

We explain how to optimize finite-length LDPC codes for transmission over the binary erasure channel. Our approach relies on an analytic approximation of the erasure probability. This is in turn based on a finite-length scaling result to…

Information Theory · Computer Science 2007-07-13 Abdelaziz Amraoui , Andrea Montanari , Ruediger Urbanke

This paper provides simple lower bounds on the number of iterations which is required for successful message-passing decoding of some important families of graph-based code ensembles (including low-density parity-check codes and variations…

Information Theory · Computer Science 2007-11-08 Igal Sason , Gil Wiechman

We prove that, for the binary erasure channel (BEC), the polar-coding paradigm gives rise to codes that not only approach the Shannon limit but do so under the best possible scaling of their block length as a~function of the gap to…

Information Theory · Computer Science 2020-10-15 Arman Fazeli , S. Hamed Hassani , Marco Mondelli , Alexander Vardy