English
Related papers

Related papers: Codes That Achieve Capacity on Symmetric Channels

200 papers

We prove two results on the universality of polar codes for source coding and channel communication. First, we show that for any polar code built for a source $P_{X,Z}$ there exists a slightly modified polar code - having the same rate, the…

Information Theory · Computer Science 2016-01-22 David Sutter , Joseph M. Renes

We consider transmission over a general memoryless channel, with bounded decoding complexity per bit under message passing decoding. We show that the achievable rate is bounded below capacity if there is a finite success in the decoding in…

Information Theory · Computer Science 2007-07-13 Pulkit Grover

Deep polar codes are pre-transformed polar codes that employ a multi-layered polar kernel transformation strategy to enhance code performance in short blocklength regimes. However, like conventional polar codes, their block length is…

Information Theory · Computer Science 2025-05-13 Geon Choi , Namyoon Lee

Low-Density Parity-Check (LDPC) codes received much attention recently due to their capacity-approaching performance. The iterative message-passing algorithm is a widely adopted decoding algorithm for LDPC codes \cite{Kschischang01}. An…

Information Theory · Computer Science 2009-08-27 Xudong Ma , En-hui Yang

We consider the problem of coded distributed computing using polar codes. The average execution time of a coded computing system is related to the error probability for transmission over the binary erasure channel in recent work by…

Information Theory · Computer Science 2022-02-02 Dorsa Fathollahi , Marco Mondelli

We consider the problem of coded distributed computing where a large linear computational job, such as a matrix multiplication, is divided into $k$ smaller tasks, encoded using an $(n,k)$ linear code, and performed over $n$ distributed…

Information Theory · Computer Science 2021-10-06 Mahdi Soleymani , Mohammad Vahid Jamali , Hessam Mahdavifar

This paper considers the achievable rates and decoding complexity of low-density parity-check (LDPC) codes over statistically independent parallel channels. The paper starts with the derivation of bounds on the conditional entropy of the…

Information Theory · Computer Science 2007-07-13 Igal Sason , Gil Wiechman

Consider the transmission of a polar code of block length $N$ and rate $R$ over a binary memoryless symmetric channel $W$ and let $P_e$ be the block error probability under successive cancellation decoding. In this paper, we develop new…

Information Theory · Computer Science 2016-08-05 Marco Mondelli , S. Hamed Hassani , Rüdiger Urbanke

Polar codes have been gaining a lot of interest due to it being the first coding scheme to provably achieve the symmetric capacity of a binary memoryless channel with an explicit construction. However, the main drawback of polar codes is…

Information Theory · Computer Science 2019-11-11 Heshani Gamage , Vismika Ranasinghe , Nandana Rajatheva , Matti Latva-aho

Polar codes have gained significant attention in channel coding for their ability to approach the capacity of binary input discrete memoryless channels (B-DMCs), thanks to their reliability and efficiency in transmission. However, existing…

Information Theory · Computer Science 2025-01-30 Jiaxing Li , Shuwen Zhang , Zhisong Bie

In this paper, we consider quantized decoding of LDPC codes on the binary symmetric channel. The binary message passing algorithms, while allowing extremely fast hardware implementation, are not very attractive from the perspective of…

Information Theory · Computer Science 2016-11-17 Lucile Sassatelli , Shashi Kiran Chilappagari , Bane Vasic , David Declercq

Polar codes have emerged as the most favorable channel codes for their unique capacity-achieving property. To date, numerous works have been reported for efficient design of polar codes decoder. However, these prior efforts focused on…

Information Theory · Computer Science 2015-01-15 Bo Yuan , Keshab K. Parhi

Information-theoretic work for wiretap channels is mostly based on random coding schemes. Designing practical coding schemes to achieve information-theoretic security is an important problem. By applying the two recently developed…

Information Theory · Computer Science 2014-10-15 Yi-Peng Wei , Sennur Ulukus

Polar codes are one of the most recent advancements in coding theory and they have attracted significant interest. While they are provably capacity achieving over various channels, they have seen limited practical applications.…

Information Theory · Computer Science 2016-11-17 Alexios Balatsoukas-Stimming , Georgios Karakonstantis , Andreas Burg

In this paper, we study codes with sparse generator matrices. More specifically, low-density generator matrix (LDGM) codes with a certain constraint on the weight of the columns in the generator matrix are considered. In this paper, it is…

Information Theory · Computer Science 2022-06-28 James Chin-Jen Pang , Hessam Mahdavifar , S. Sandeep Pradhan

In this paper, we propose a low-complexity, secrecy capacity achieving polar coding scheme for the cognitive interference channel with confidential messages (CICC) under the strong secrecy criterion. Existing polar coding schemes for…

Information Theory · Computer Science 2017-10-30 Mengfan Zheng , Wen Chen , Cong Ling

We study the problem of strong coordination of the actions of two nodes $X$ and $Y$ that communicate over a discrete memoryless channel (DMC) such that the actions follow a prescribed joint probability distribution. We propose two novel…

Information Theory · Computer Science 2021-06-29 Sarah A. Obead , Badri N. Vellambi , Jörg Kliewer

This paper studies the parameters for which Reed-Muller (RM) codes over $GF(2)$ can correct random erasures and random errors with high probability, and in particular when can they achieve capacity for these two classical channels.…

Information Theory · Computer Science 2014-11-18 Emmanuel Abbe , Amir Shpilka , Avi Wigderson

In this paper, we derive analytic expressions for the success probability of decoding (Partial) Unit Memory codes in memoryless channels. An applications of this result is that these codes outperform individual block codes in certain…

Information Theory · Computer Science 2017-05-25 Sven Puchinger , Sven Müelich , Martin Bossert

Polar codes are of great interest since they are the first provably capacity-achieving forward error correction codes. To improve throughput and to reduce decoding latency of polar decoders, maximum likelihood (ML) decoding units are used…

Information Theory · Computer Science 2015-10-27 Chenrong Xiong , Jun Lin , Zhiyuan Yan