English

Codes approaching the Shannon limit with polynomial complexity per information bit

Information Theory 2021-01-26 v1 math.IT

Abstract

We consider codes for channels with extreme noise that emerge in various low-power applications. Simple LDPC-type codes with parity checks of weight 3 are first studied for any dimension m.m\rightarrow\infty. These codes form modulation schemes: they improve the original channel output for any SNR>SNR> 6-6 dB (per information bit) and gain 33 dB over uncoded modulation as SNRSNR grows. However, they also have a floor on the output bit error rate (BER) irrespective of their length. Tight lower and upper bounds, which are virtually identical to simulation results, are then obtained for BER at any SNR. We also study a combined scheme that splits mm information bits into bb blocks and protects each with some polar code. Decoding moves back and forth between polar and LDPC codes, every time using a polar code of a higher rate. For a sufficiently large constant bb and mm\rightarrow\infty, this design yields a vanishing BER at any SNR that is arbitrarily close to the Shannon limit of -1.59 dB. Unlike other existing designs, this scheme has polynomial complexity of order mlnmm\ln m per information bit.

Keywords

Cite

@article{arxiv.2101.10145,
  title  = {Codes approaching the Shannon limit with polynomial complexity per information bit},
  author = {Ilya Dumer and Navid Gharavi},
  journal= {arXiv preprint arXiv:2101.10145},
  year   = {2021}
}

Comments

18 pages, 3 figures

R2 v1 2026-06-23T22:29:49.732Z