English
Related papers

Related papers: Rejection-Sampled Linear Codes for Lossy Compressi…

200 papers

In this paper, we leverage polar codes and the well-established channel polarization to design capacity-achieving codes with a certain constraint on the weights of all the columns in the generator matrix (GM) while having a low-complexity…

Information Theory · Computer Science 2023-03-17 James Chin-Jen Pang , Hessam Mahdavifar , S. Sandeep Pradhan

Channel polarization is a method of constructing capacity achieving codes for symmetric binary-input discrete memoryless channels (B-DMCs) [1]. In the original paper, the construction complexity is exponential in the blocklength. In this…

Information Theory · Computer Science 2009-05-23 Ryuhei Mori , Toshiyuki Tanaka

Constructing efficient low-rate error-correcting codes with low-complexity encoding and decoding have become increasingly important for applications involving ultra-low-power devices such as Internet-of-Things (IoT) networks. To this end,…

Information Theory · Computer Science 2020-11-02 Fariba Abbasi , Hessam Mahdavifar , Emanuele Viterbo

A pruned variant of polar coding is reinvented for all binary erasure channels. For small $\varepsilon>0$, we construct codes with block length $\varepsilon^{-5}$, code rate $\text{Capacity}-\varepsilon$, error probability $\varepsilon$,…

Information Theory · Computer Science 2018-12-20 Hsin-Po Wang , Iwan Duursma

Resistive memories are considered a promising memory technology enabling high storage densities with in-memory computing capabilities. However, the readout reliability of resistive memories is impaired due to the inevitable existence of…

Information Theory · Computer Science 2019-04-22 Marwen Zorgui , Mohammed E. Fouda , Zhiying Wang , Ahmed M. Eltawil , Fadi Kurdahi

A pruned variant of polar coding is proposed for binary erasure channels. For sufficiently small $\varepsilon>0$, we construct a series of capacity achieving codes with block length $N=\varepsilon^{-5}$, code rate…

Information Theory · Computer Science 2020-12-14 Hsin-Po Wang , Iwan Duursma

In this paper we study codes with sparse generator matrices. More specifically, codes with a certain constraint on the weight of all the columns in the generator matrix are considered. The end result is the following. For any binary-input…

Signal Processing · Electrical Eng. & Systems 2020-02-03 James Chin-Jen Pang , Hessam Mahdavifar , S. Sandeep Pradhan

Achieving security against adversaries with unlimited computational power is of great interest in a communication scenario. Since polar codes are capacity achieving codes with low encoding-decoding complexity and they can approach perfect…

Information Theory · Computer Science 2018-01-23 Amirsina Torfi , Sobhan Soleymani , Siamak Aram , Vahid Tabataba Vakili

Stochastic encoders for channel coding and lossy source coding are introduced with a rate close to the fundamental limits, where the only restriction is that the channel input alphabet and the reproduction alphabet of the lossy source code…

Information Theory · Computer Science 2016-11-15 Jun Muramatsu

We introduce a new approach to proving that a sequence of deterministic linear codes achieves capacity on an erasure channel under maximum a posteriori decoding. Rather than relying on the precise structure of the codes our method exploits…

Information Theory · Computer Science 2016-01-19 Shrinivas Kudekar , Santhosh Kumar , Marco Mondelli , Henry D. Pfister , Eren Şaşoğlu , Rüdiger Urbanke

A lossy compression algorithm for binary redundant memoryless sources is presented. The proposed scheme is based on sparse graph codes. By introducing a nonlinear function, redundant memoryless sequences can be compressed. We propose a…

Information Theory · Computer Science 2011-08-19 Kazushi Mimura

In this paper, we prove the existence of capacity achieving linear codes with random binary sparse generating matrices. The results on the existence of capacity achieving linear codes in the literature are limited to the random binary codes…

Information Theory · Computer Science 2011-08-31 A. Makhdoumi Kakhaki , H. Karkeh Abadi , P. Pad , H. Saeedi , F. Marvasti , K. Alishahi

Long polar codes can achieve the capacity of arbitrary binary-input discrete memoryless channels under a low complexity successive cancelation (SC) decoding algorithm. But for polar codes with short and moderate code length, the decoding…

Information Theory · Computer Science 2016-11-18 Jun Lin , Chenrong Xiong , Zhiyuan Yan

We propose computationally efficient encoders and decoders for lossy compression using a Sparse Regression Code. The codebook is defined by a design matrix and codewords are structured linear combinations of columns of this matrix. The…

Information Theory · Computer Science 2014-05-20 Ramji Venkataramanan , Tuhin Sarkar , Sekhar Tatikonda

Polar codes are a class of capacity-achieving error correcting codes that have been selected for use in enhanced mobile broadband in the 3GPP 5th generation (5G) wireless standard. Most polar code research examines the original Arikan polar…

Information Theory · Computer Science 2019-07-17 Adam Cavatassi , Thibaud Tonnellier , Warren J. Gross

This paper introduces a new approach to proving that a sequence of deterministic linear codes achieves capacity on an erasure channel under maximum a posteriori decoding. Rather than relying on the precise structure of the codes, this…

Information Theory · Computer Science 2015-06-16 Santhosh Kumar , Henry D. Pfister

We present an approach to showing that a linear code is resilient to random errors. We use this approach to obtain decoding results for both transitive codes and Reed-Muller codes. We give three kinds of results about linear codes in…

Information Theory · Computer Science 2025-02-27 Anup Rao , Oscar Sprumont

Recent work has suggested that low-density generator matrix (LDGM) codes are likely to be effective for lossy source coding problems. We derive rigorous upper bounds on the effective rate-distortion function of LDGM codes for the binary…

Information Theory · Computer Science 2007-07-13 Emin Martinian , Martin J. Wainwright

We construct a channel coding scheme to achieve the capacity of any discrete memoryless channel based solely on the techniques of polar coding. In particular, we show how source polarization and randomness extraction via polarization can be…

Information Theory · Computer Science 2016-01-22 David Sutter , Joseph M. Renes , Frédéric Dupuis , Renato Renner

Transmission of information reliably and efficiently across channels is one of the fundamental goals of coding and information theory. In this respect, efficiently decodable deterministic coding schemes which achieve capacity provably have…

Information Theory · Computer Science 2015-10-20 Vishvajeet Nagargoje