English
Related papers

Related papers: Finite-Length Analysis of BATS Codes

200 papers

The recent development of deep learning methods provides a new approach to optimize the belief propagation (BP) decoding of linear codes. However, the limitation of existing works is that the scale of neural networks increases rapidly with…

Information Theory · Computer Science 2021-02-11 Jincheng Dai , Kailin Tan , Zhongwei Si , Kai Niu , Mingzhe Chen , H. Vincent Poor , Shuguang Cui

One key requirement for fountain (rateless) coding schemes is to achieve a high intermediate symbol recovery rate. Recent coding schemes have incorporated the use of a feedback channel to improve intermediate performance of traditional…

Information Theory · Computer Science 2016-11-17 Morteza Hashemi , Yuval Cassuto , Ari Trachtenberg

Auto-regressive decoding in Large Language Models (LLMs) is inherently memory-bound: every generation step requires loading the model weights and intermediate results from memory (e.g., High-Bandwidth Memory (HBM) for GPU servers), making…

Machine Learning · Computer Science 2026-05-13 Yuning Han , Yangchenchen Jin , Dylan Zhao , Jingwei Sun

In this paper, a modified extrinsic information transfer (EXIT) chart analysis that takes into account the relation between mutual information (MI) and bit-error-rate (BER) is presented to study the convergence behavior of block Markov…

Information Theory · Computer Science 2015-02-03 Kechao Huang , Xiao Ma , Daniel J. Costello

Communication over the binary erasure channel (BEC) using low-density parity-check (LDPC) codes and belief propagation (BP) decoding is considered. The average bit error probability of an irregular LDPC code ensemble after a fixed number of…

Information Theory · Computer Science 2009-05-23 Ryuhei Mori , Toshiyuki Tanaka , Kenta Kasai , Kohichi Sakaniwa

Finite-length codes are learned for the Gaussian wiretap channel in an end-to-end manner assuming that the communication parties are equipped with deep neural networks (DNNs), and communicate through binary phase-shift keying (BPSK)…

Machine Learning · Computer Science 2020-03-25 Alireza Nooraiepour , Sina Rezaei Aghdam

Unrolling a decoding algorithm allows to achieve extremely high throughput at the cost of increased area. Look-up tables (LUTs) can be used to replace functions otherwise implemented as circuits. In this work, we show the impact of…

Information Theory · Computer Science 2024-09-04 Pascal Giard , Syed Aizaz Ali Shah , Alexios Balatsoukas-Stimming , Maximilian Stark , Gerhard Bauch

This paper examines the maximum code rate achievable by a data-driven communication system over some unknown discrete memoryless channel in the finite blocklength regime. A class of channel codes, called learning-based channel codes, is…

Information Theory · Computer Science 2023-07-18 Neil Irwin Bernardo , Jingge Zhu , Jamie Evans

In this paper, we propose a new ensemble of rateless forward error correction (FEC) codes. The proposed codes are serially concatenated codes with Reed-Solomon (RS) codes as outer codes and Kite codes as inner codes. The inner Kite codes…

Information Theory · Computer Science 2011-04-27 Xiao Ma , Kai Zhang , Baoming Bai , Xiaoyi Zhang

In this paper, we derive analytic expressions for the success probability of decoding (Partial) Unit Memory codes in memoryless channels. An applications of this result is that these codes outperform individual block codes in certain…

Information Theory · Computer Science 2017-05-25 Sven Puchinger , Sven Müelich , Martin Bossert

Slotted ALOHA can benefit from physical-layer network coding (PNC) by decoding one or multiple linear combinations of the packets simultaneously transmitted in a timeslot, forming a system of linear equations. Different systems of linear…

Information Theory · Computer Science 2015-02-16 Shenghao Yang , Yi Chen , Soung Chang Liew , Lizhao You

Extrinsic Information Transfer (EXIT) functions can be measured by statistical methods if the message alphabet size is moderate or if messages are true a-posteriori distributions. We propose an approximation we call mixed information that…

Information Theory · Computer Science 2016-11-17 Jossy Sayir

Link and node failures are common two fundamental problems that affect operational networks. Hence, protection of communication networks is essential to increase their reliability, performance, and operations. Much research work has been…

Information Theory · Computer Science 2009-06-30 Salah A. Aly , Ahmed E. Kamal

In this paper, throughput achieved in cognitive radio channels with finite blocklength codes under buffer limitations is studied. Cognitive users first determine the activity of the primary users' through channel sensing and then initiate…

Information Theory · Computer Science 2013-08-26 Gozde Ozcan , M. Cenk Gursoy

The performance of iterative decoding techniques for linear block codes correcting erasures depends very much on the sizes of the stopping sets associated with the underlying Tanner graph, or, equivalently, the parity-check matrix…

Information Theory · Computer Science 2007-07-13 Jos H. Weber , Khaled A. S. Abdel-Ghaffar

Departing from traditional communication theory where decoding algorithms are assumed to perform without error, a system where noise perturbs both computational devices and communication channels is considered here. This paper studies…

Information Theory · Computer Science 2010-05-31 Lav R. Varshney

A scheme for concatenating the recently invented polar codes with non-binary MDS codes, as Reed-Solomon codes, is considered. By concatenating binary polar codes with interleaved Reed-Solomon codes, we prove that the proposed concatenation…

Information Theory · Computer Science 2016-11-17 Hessam Mahdavifar , Mostafa El-Khamy , Jungwon Lee , Inyup Kang

A primitive $k$-batch code encodes a string $x$ of length $n$ into string $y$ of length $N$, such that each multiset of $k$ symbols from $x$ has $k$ mutually disjoint recovering sets from $y$. We develop new explicit and random coding…

Information Theory · Computer Science 2019-01-23 Nikita Polyanskii , Ilya Vorobyev

Raptor code ensembles with linear random outer codes in a fixed-rate setting are considered. An expression for the average distance spectrum is derived and this expression is used to obtain the asymptotic exponent of the weight…

Information Theory · Computer Science 2015-11-03 Francisco Lázaro , Enrico Paolini , Gianluigi Liva , Gerhard Bauch

In this paper, we propose an alternative for routing based packet forwarding, which uses network coding to increase transmission efficiency, in terms of both compression and error resilience. This non-adaptive encoding is called quantized…

Information Theory · Computer Science 2012-10-04 Mahdy Nabaee , Fabrice Labeau