English
Related papers

Related papers: Decoding of Expander Codes at Rates Close to Capac…

200 papers

Determining the exact decoding error probability of linear block codes is an interesting problem. For binary BCH codes, McEliece derived methods to estimate the error probability of a simple bounded distance decoding (BDD) for BCH codes.…

Information Theory · Computer Science 2026-01-29 Sisi Miao , Jonathan Mandelbaum , Holger Jäkel , Laurent Schmalen

Over any discrete memoryless channel, we build codes such that: for one, their block error probabilities and code rates scale like random codes'; and for two, their encoding and decoding complexities scale like polar codes'. Quantitatively,…

Information Theory · Computer Science 2020-12-14 Hsin-Po Wang , Iwan Duursma

We consider communication over the binary erasure channel (BEC) using low-density parity-check (LDPC) codes and belief propagation (BP) decoding. For fixed numbers of BP iterations, the bit error probability approaches a limit as…

Information Theory · Computer Science 2016-11-17 Ryuhei Mori , Toshiyuki Tanaka , Kenta Kasai , Kohichi Sakaniwa

A pruned variant of polar coding is reinvented for all binary erasure channels. For small $\varepsilon>0$, we construct codes with block length $\varepsilon^{-5}$, code rate $\text{Capacity}-\varepsilon$, error probability $\varepsilon$,…

Information Theory · Computer Science 2018-12-20 Hsin-Po Wang , Iwan Duursma

We show that the entire class of polar codes (up to a natural necessary condition) converge to capacity at block lengths polynomial in the gap to capacity, while simultaneously achieving failure probabilities that are exponentially small in…

Information Theory · Computer Science 2022-05-09 Jarosław Błasiok , Venkatesan Guruswami , Madhu Sudan

When a neural network (NN) is used to decode a polar code, its training complexity scales exponentially as the code block size (or to be precise, as a number of message bits) increases. Therefore, existing solutions that use a neural…

Information Theory · Computer Science 2022-11-10 Evgeny Stupachenko

We consider transmission over a general memoryless channel, with bounded decoding complexity per bit under message passing decoding. We show that the achievable rate is bounded below capacity if there is a finite success in the decoding in…

Information Theory · Computer Science 2007-07-13 Pulkit Grover

This paper analyzes the distribution of cycle lengths in turbo decoding and low-density parity check (LDPC) graphs. The properties of such cycles are of significant interest in the context of iterative decoding algorithms which are based on…

Discrete Mathematics · Computer Science 2010-01-21 Xian-ping Ge , David Eppstein , Padhraic Smyth

The performance of maximum-likelihood (ML) decoded binary linear block codes is addressed via the derivation of tightened upper bounds on their decoding error probability. The upper bounds on the block and bit error probabilities are valid…

Information Theory · Computer Science 2007-07-13 M. Twitto , I. Sason , S. Shamai

In this work, we present the first local-decoding algorithm for expander codes. This yields a new family of constant-rate codes that can recover from a constant fraction of errors in the codeword symbols, and where any symbol of the…

Information Theory · Computer Science 2015-01-08 Brett Hemenway , Rafail Ostrovsky , Mary Wootters

We explore the relationship between polar and RM codes and we describe a coding scheme which improves upon the performance of the standard polar code at practical block lengths. Our starting point is the experimental observation that RM…

Information Theory · Computer Science 2014-09-04 Marco Mondelli , S. Hamed Hassani , Rüdiger Urbanke

We consider explicit polar constructions of blocklength $n\rightarrow\infty$ for the two extreme cases of code rates $R\rightarrow1$ and $R\rightarrow0.$ For code rates $R\rightarrow1,$ we design codes with complexity order of $n\log n$ in…

Information Theory · Computer Science 2017-02-17 Ilya Dumer

We prove that, for the binary erasure channel (BEC), the polar-coding paradigm gives rise to codes that not only approach the Shannon limit but do so under the best possible scaling of their block length as a~function of the gap to…

Information Theory · Computer Science 2020-10-15 Arman Fazeli , S. Hamed Hassani , Marco Mondelli , Alexander Vardy

The DNA storage channel is considered, in which a codeword is comprised of $M$ unordered DNA molecules. At reading time, $N$ molecules are sampled with replacement, and then each molecule is sequenced. A coded-index concatenated-coding…

Information Theory · Computer Science 2022-05-23 Nir Weinberger

We derive the optimum second-order coding rates, known as second-order capacities, for erasure and list decoding. For erasure decoding for discrete memoryless channels, we show that second-order capacity is $\sqrt{V}\Phi^{-1}(\epsilon_t)$…

Information Theory · Computer Science 2014-04-22 Vincent Y. F. Tan , Pierre Moulin

It is well known that a random q-ary code of rate \Omega(\epsilon^2) is list decodable up to radius (1 - 1/q - \epsilon) with list sizes on the order of 1/\epsilon^2, with probability 1 - o(1). However, until recently, a similar statement…

Information Theory · Computer Science 2013-07-11 Mary Wootters

It is shown that for any binary-input discrete memoryless channel $W$ with symmetric capacity $I(W)$ and any rate $R <I(W)$, the probability of block decoding error for polar coding under successive cancellation decoding satisfies $P_e \le…

Information Theory · Computer Science 2009-04-06 Erdal Arikan , Emre Telatar

We consider the discrete memoryless degraded broadcast channels. We prove that the error probability of decoding tends to one exponentially for rates outside the capacity region and derive an explicit lower bound of this exponent function.…

Information Theory · Computer Science 2015-04-23 Yasutada Oohama

A family of error-correcting codes is list-decodable from error fraction $p$ if, for every code in the family, the number of codewords in any Hamming ball of fractional radius $p$ is less than some integer $L$ that is independent of the…

Information Theory · Computer Science 2024-07-11 Venkatesan Guruswami , Ray Li , Jonathan Mosheiff , Nicolas Resch , Shashwat Silas , Mary Wootters

Using tools developed in a recent work by Shen and the second author, in this paper we carry out an in-depth study on the average decoding error probability of the random matrix ensemble over the erasure channel under three decoding…

Information Theory · Computer Science 2024-04-23 Chin Hei Chan , Fang-Wei Fu , Maosheng Xiong