English
Related papers

Related papers: Stopping Redundancy Hierarchy Beyond the Minimum D…

200 papers

We present simple constructions of optimal erasure-correcting LRC codes by exhibiting their parity-check matrices. When the number of local parities in a parity group plus the number of global parities is smaller than the size of the parity…

Information Theory · Computer Science 2015-12-22 Mario Blaum

In this paper, we investigate the redundancy of universal coding schemes on smooth parametric sources in the finite-length regime. We derive an upper bound on the probability of the event that a sequence of length $n$, chosen using…

Information Theory · Computer Science 2011-10-27 Ahmad Beirami , Faramarz Fekri

The minimum average number of bits need to describe a random variable is its entropy, assuming knowledge of the underlying statistics On the other hand, universal compression supposes that the distribution of the random variable, while…

Information Theory · Computer Science 2014-04-02 Maryam Hosseini , Narayana Santhanam

Motivated by the significant performance gains which polar codes experience under successive cancellation list decoding, their scaling exponent is studied as a function of the list size. In particular, the error probability is fixed and the…

Information Theory · Computer Science 2014-09-23 Marco Mondelli , S. Hamed Hassani , Rüdiger Urbanke

The paper introduces ensembles of accumulate-repeat-accumulate (ARA) codes which asymptotically achieve capacity on the binary erasure channel (BEC) with {\em bounded complexity} per information bit. It also introduces symmetry properties…

Information Theory · Computer Science 2007-07-13 Henry D. Pfister , Igal Sason

In this paper we investigate the behavior of iteratively decoded low-density parity-check codes over the binary erasure channel in the so-called ``waterfall region." We show that the performance curves in this region follow a very basic…

Information Theory · Computer Science 2007-07-13 Abdelaziz Amraoui , Andrea Montanari , Tom Richardson , Ruediger Urbanke

Whereas many results are known about thresholds for ensembles of low-density parity-check codes under message-passing iterative decoding, this is not the case for linear programming decoding. Towards closing this knowledge gap, this paper…

Information Theory · Computer Science 2007-07-16 Pascal O. Vontobel , Ralf Koetter

Because of their capacity-approaching performance, graph-based codes have a wide range of applications, including communications and storage. In these codes, unequal error protection (UEP) can offer performance gains with limited rate loss.…

Information Theory · Computer Science 2021-01-25 Beyza Dabak , Ahmed Hareedy , Alexei Ashikhmin , Robert Calderbank

Error exponents characterize the exponential decay, when increasing message length, of the probability of error of many error-correcting codes. To tackle the long standing problem of computing them exactly, we introduce a general,…

Disordered Systems and Neural Networks · Physics 2007-07-16 Thierry Mora , Olivier Rivoire

Erasures are the primary type of errors in physical systems dominated by leakage errors. While quantum error correction (QEC) using stabilizer codes can combat erasure errors, it remains unknown which constructions achieve capacity…

Quantum Physics · Physics 2026-05-05 Kao-Yueh Kuo , Yingkai Ouyang

Subcode-ensemble decoders improve iterative decoding by running multiple decoders in parallel over carefully chosen subcodes, increasing the likelihood that at least one decoder avoids the dominant trapping structures. Achieving strong…

Information Theory · Computer Science 2026-02-10 Yubeen Jo , Geon Choi , Chanho Park , Namyoon Lee

We show that iterative coding systems can not surpass capacity using only quantities which naturally appear in density evolution. Although the result in itself is trivial, the method which we apply shows that in order to achieve capacity…

Information Theory · Computer Science 2007-07-13 Cyril Measson , Andrea Montanari , Rudiger Urbanke

The paper presents bounds on the achievable rates and the decoding complexity of low-density parity-check (LDPC) codes. It is assumed that the communication of these codes takes place over statistically independent parallel channels where…

Information Theory · Computer Science 2007-07-13 Igal Sason , Gil Wiechman

In this work, we give good concatenated code ensembles for the binary erasure channel (BEC). In particular, we consider repeat multiple-accumulate (RMA) code ensembles formed by the serial concatenation of a repetition code with multiple…

Information Theory · Computer Science 2011-05-31 Alexandre Graell i Amat , Eirik Rosnes

Erasure coding is widely used for massive storage in data centers to achieve high fault tolerance and low storage redundancy. Since the cross-rack communication cost is often high, it is critical to design erasure codes that minimize the…

Information Theory · Computer Science 2019-02-26 Hanxu Hou , Patrick P. C. Lee , Kenneth W. Shum , Yuchong Hu

In this paper we present a new algorithm, denoted as TEP, to decode low-density parity-check (LDPC) codes over the Binary Erasure Channel (BEC). The TEP decoder is derived applying the expectation propagation (EP) algorithm with a tree-…

Information Theory · Computer Science 2012-01-05 Pablo M. Olmos , Juan José Murillo-Fuentes , Fernando Pérez-Cruz

In this work, we derive upper bounds on the cardinality of tandem duplication and palindromic deletion correcting codes by deriving the generalized sphere packing bound for these error types. We first prove that an upper bound for tandem…

Information Theory · Computer Science 2018-01-17 Andreas Lenz , Antonia Wachter-Zeh , Eitan Yaakobi

In the field of constraint satisfaction problems (CSP), a clause is called redundant if its satisfaction is implied by satisfying all other clauses. An instance of CSP$(P)$ is called non-redundant if it does not contain any redundant…

Discrete Mathematics · Computer Science 2025-12-03 Joshua Brakensiek , Venkatesan Guruswami , Bart M. P. Jansen , Victor Lagerkvist , Magnus Wahlström

We investigate random spatially coupled low-density parity-check (SC-LDPC) code ensembles over finite fields. Under different variable-node edge-spreading rules, the random Tanner graphs of several coupled ensembles are defined by multiple…

Information Theory · Computer Science 2026-01-01 Jiaxin Lyu , Guanghui He

We explain how to optimize finite-length LDPC codes for transmission over the binary erasure channel. Our approach relies on an analytic approximation of the erasure probability. This is in turn based on a finite-length scaling result to…

Information Theory · Computer Science 2007-07-13 Abdelaziz Amraoui , Andrea Montanari , Ruediger Urbanke