English
Related papers

Related papers: Coding for Parallel Channels: Gallager Bounds for …

200 papers

In this paper, we consider quantized decoding of LDPC codes on the binary symmetric channel. The binary message passing algorithms, while allowing extremely fast hardware implementation, are not very attractive from the perspective of…

Information Theory · Computer Science 2016-11-17 Lucile Sassatelli , Shashi Kiran Chilappagari , Bane Vasic , David Declercq

We address the problem of bounding below the probability of error under maximum likelihood decoding of a binary code with a known distance distribution used on a binary symmetric channel. An improved upper bound is given for the maximum…

Information Theory · Computer Science 2007-07-16 Alexander Barg , Andrew McGregor

We study error bounds for linear programming decoding of regular LDPC codes. For memoryless binary-input output-symmetric channels, we prove bounds on the word error probability that are inverse doubly-exponential in the girth of the factor…

Information Theory · Computer Science 2011-04-12 Nissim Halabi , Guy Even

Statistical physics is employed to evaluate the performance of error-correcting codes in the case of finite message length for an ensemble of Gallager's error correcting codes. We follow Gallager's approach of upper-bounding the average…

Disordered Systems and Neural Networks · Physics 2009-10-31 Yoshiyuki Kabashima , Naoya Sazuka , Kazutaka Nakamura , David Saad

Since the classical work of Berlekamp, McEliece and van Tilborg, it is well known that the problem of exact maximum-likelihood (ML) decoding of general linear codes is NP-hard. In this paper, we show that exact ML decoding of a classs of…

Information Theory · Computer Science 2016-11-17 Weiyu Xu , Babak Hassibi

The Gallager bound is well known in the area of channel coding. However, most discussions about it mainly focus on its applications to memoryless channels. We show in this paper that the bounds obtained by Gallager's method are very tight…

Information Theory · Computer Science 2007-07-13 Shengtian Yang , Peiliang Qiu

The Poltyrev bound provides a very tight upper bound on the decoding error probability when using binary linear codes for transmission over the binary symmetric channel and the additive white Gaussian noise channel, making use of the code's…

Information Theory · Computer Science 2025-01-23 Tal Philosof , Ariel Doubchak , Amit Berman , Uri Erez

This paper presents a refined analysis of the block error rate (BLER) of polar codes over symmetric binary-input discrete memoryless channels under successive cancellation (SC) and successive cancellation list (SCL) decoding. A novel…

Information Theory · Computer Science 2026-03-23 Hassan Noghrei , Murad Abdullah

The performance of maximum-likelihood (ML) decoded binary linear block codes over the AWGN channel is addressed via the tangential-sphere bound (TSB) and two of its recent improved versions. The paper is focused on the derivation of the…

Information Theory · Computer Science 2007-07-13 M. Twitto , I. Sason

We explore the relation between the techniques of statistical mechanics and information theory for assessing the performance of channel coding. We base our study on a framework developed by Gallager in {\em IEEE Trans. Inform. Theory} {\bf…

Information Theory · Computer Science 2009-11-13 Yoshiyuki Kabashima

Improved bounds on the blocklength required to communicate over binary-input channels using polar codes, below some given error probability, are derived. For that purpose, an improved bound on the number of non-polarizing channels is…

Information Theory · Computer Science 2013-07-23 Dina Goldin , David Burshtein

We introduce a new approach to proving that a sequence of deterministic linear codes achieves capacity on an erasure channel under maximum a posteriori decoding. Rather than relying on the precise structure of the codes our method exploits…

Information Theory · Computer Science 2016-01-19 Shrinivas Kudekar , Santhosh Kumar , Marco Mondelli , Henry D. Pfister , Eren Şaşoğlu , Rüdiger Urbanke

We derive critical noise levels for Gallager codes on asymmetric channels as a function of the input bias and the temperature. Using a statistical mechanics approach we study the space of codewords and the entropy in the various decoding…

Disordered Systems and Neural Networks · Physics 2009-11-13 I. Neri , N. S. Skantzos , D. Bollé

The paper considers coding schemes derived from Reed-Muller (RM) codes, for transmission over input-constrained memoryless channels. Our focus is on the $(d,\infty)$-runlength limited (RLL) constraint, which mandates that any pair of…

Information Theory · Computer Science 2023-05-23 V. Arvind Rameshwar , Navin Kashyap

Polar codes are a family of capacity-achieving codes that have explicit and low-complexity construction, encoding, and decoding algorithms. Decoding of polar codes is based on the successive-cancellation decoder, which decodes in a bit-…

Information Theory · Computer Science 2018-03-06 Boaz Shuval , Ido Tal

This work considers optimizing LDPC codes in the physical-layer network coded two-way relay channel using noncoherent FSK modulation. The error-rate performance of channel decoding at the relay node during the multiple-access phase was…

Information Theory · Computer Science 2015-02-23 Terry Ferrett , Matthew C. Valenti

In this paper, nested Gallager regions with a single parameter is introduced to exploit Gallager's first bounding technique (GFBT). We present a necessary and sufficient condition on the optimal parameter. We also present a sufficient…

Information Theory · Computer Science 2012-03-12 Xiao Ma , Jia Liu , Baoming Bai

This paper introduces a new approach to proving that a sequence of deterministic linear codes achieves capacity on an erasure channel under maximum a posteriori decoding. Rather than relying on the precise structure of the codes, this…

Information Theory · Computer Science 2015-06-16 Santhosh Kumar , Henry D. Pfister

Locally repairable codes (LRCs) were originally introduced to enable efficient recovery from erasures in distributed storage systems by accessing only a small number of other symbols. While their structural properties-such as bounds and…

Information Theory · Computer Science 2026-02-23 Hoang Ly , Emina Soljanin , Philip Whiting

A binary code of blocklength $n$ and codebook size $M$ is called an $(n,M)$ code, which is studied for memoryless binary symmetric channels (BSCs) with the maximum likelihood (ML) decoding. For any $n \geq 2$, some optimal codes among the…

Information Theory · Computer Science 2023-07-06 Yanyan Dong , Shenghao Yang