English
Related papers

Related papers: Analysis of Sequential Decoding Complexity Using t…

200 papers

In the context of supervised learning, meta learning uses features, metadata and other information to learn about the difficulty, behavior, or composition of the problem. Using this knowledge can be useful to contextualize classifier…

Information Theory · Computer Science 2020-04-28 Salimeh Yasaei Sekeh , Brandon Oselio , Alfred O. Hero

Aiming at bridging the gap between the maximum likelihood decoding (MLD) and the suboptimal iterative decodings for short or medium length LDPC codes, we present a generalized ordered statistic decoding (OSD) in the form of syndrome…

Information Theory · Computer Science 2008-05-16 Guangwen Li , Guangzeng Feng

Assuming iterative decoding for binary erasure channels (BECs), a novel tree-based technique for upper bounding the bit error rates (BERs) of arbitrary, finite low-density parity-check (LDPC) codes is provided and the resulting bound can be…

Information Theory · Computer Science 2007-07-13 Chih-Chun Wang , Sanjeev R. Kulkarni , H. Vincent Poor

Let $(g_{n})_{n\geq 1}$ be a sequence of independent and identically distributed (i.i.d.) $d\times d$ real random matrices. For $n\geq 1$ set $G_n = g_n \ldots g_1$. Given any starting point $x=\mathbb R v\in\mathbb{P}^{d-1}$, consider the…

Probability · Mathematics 2025-02-20 Hui Xiao , Ion Grama , Quansheng Liu

The extended Euclidean algorithm (EEA) for polynomial greatest common divisors is commonly used in solving the key equation in the decoding of Reed-Solomon (RS) codes, and more generally in BCH decoding. For this particular application, the…

Information Theory · Computer Science 2009-06-23 Dilip V. Sarwate , Zhiyuan Yan

Neyman (1923/1990) introduced the randomization model, which contains the notation of potential outcomes to define causal effects and a framework for large-sample inference based on the design of the experiment. However, the existing theory…

Methodology · Statistics 2025-06-16 Lei Shi , Peng Ding

The asymptotic iterative decoding performances of low-density parity-check (LDPC) codes using min-sum (MS) and sum-product (SP) decoding algorithms on memoryless binary-input output-symmetric (MBIOS) channels are analyzed in this paper. For…

Information Theory · Computer Science 2007-07-13 Chun-Hao Hsu , Achilleas Anastasopoulos

Algebraic decoding algorithms are commonly applied for the decoding of Reed-Solomon codes. Their main advantages are low computational complexity and predictable decoding capabilities. Many algorithms can be extended for correction of both…

Information Theory · Computer Science 2015-03-19 Christian Senger , Vladimir R. Sidorenko , Steffen Schober , Martin Bossert , Victor V. Zyablov

Linear wavelet density estimators are wavelet projections of the empirical measure based on independent, identically distributed observations. We study here the law of the iterated logarithm (LIL) and a Berry-Esseen type theorem. These…

Statistics Theory · Mathematics 2012-10-31 Lu Lu

The ordered-reliability bits (ORB) variant of guessing random additive noise decoding (GRAND), known as ORBGRAND, achieves remarkably low time complexity at high code rates compared to other GRAND variants. However, its computational…

Information Theory · Computer Science 2025-02-05 Mohammad Rowshan , Jinhong Yuan

A likelihood encoder is studied in the context of lossy source compression. The analysis of the likelihood encoder is based on the soft-covering lemma. It is demonstrated that the use of a likelihood encoder together with the soft-covering…

Information Theory · Computer Science 2016-04-07 Eva C. Song , Paul Cuff , H. Vincent Poor

We derive a Gaussian Central Limit Theorem for the sample quantiles based on locally dependent random variables with explicit convergence rate. Our approach is based on converting the problem to a sum of indicator random variables, applying…

Probability · Mathematics 2025-03-05 Partha S. Dey , Grigory Terlov

The efficiency of a code is estimated by its redundancy $R$, while the complexity of a code is estimated by its average delay $\bar N$. In this work we construct word-based codes, for which $R \lesssim \bar N^{-5/3}$. Therefore, word-based…

Information Theory · Computer Science 2007-12-04 G. L. Khodak

In this paper, the uniformly asymptotic normality for sample quantiles of associated random variables is investigated under some conditions on the decay of the covariances. We obtain the rate of normal approximation of order…

Statistics Theory · Mathematics 2020-06-18 L. Douge

Guessing Random Additive Noise Decoding (GRAND) is a family of hard- and soft-detection error correction decoding algorithms that provide accurate decoding of any moderate redundancy code of any length. Here we establish a method through…

Information Theory · Computer Science 2023-08-11 Kevin Galligan , Peihong Yuan , Muriel Médard , Ken R. Duffy

An exchangeable pair approach is commonly taken in the normal and non-normal approximation using Stein's method. It has been successfully used to identify the limiting distribution and provide an error of approximation. However, when the…

Probability · Mathematics 2021-04-28 Qi-Man Shao , Zhuo-Song Zhang

In this paper, we establish Berry-Esseen-type bounds for federated linear stochastic approximation (LSA). Our results provide the first federated Gaussian approximations for LSA that explicitly capture communication-computation trade-offs…

Machine Learning · Statistics 2026-05-20 Ilya Levin , Maksim Shuklin , Eric Moulines , Paul Mangold , Sergey Samsonov

Guessing Random Additive Noise Decoding (GRAND) is a universal decoding algorithm that can be used to perform maximum likelihood decoding. It attempts to find the errors introduced by the channel by generating a sequence of possible error…

Information Theory · Computer Science 2022-07-26 Carlo Condo

Low-density parity-check (LDPC) codes together with belief propagation (BP) decoding yield exceptional error correction capabilities in the large block length regime. Yet, there remains a gap between BP decoding and maximum likelihood…

Information Theory · Computer Science 2025-01-22 Jonathan Mandelbaum , Holger Jäkel , Laurent Schmalen

Decoding via sequentially guessing the error pattern in a received noisy sequence has received attention recently, and ORBGRAND has been proposed as one such decoding algorithm that is capable of utilizing the soft information embedded in…

Information Theory · Computer Science 2022-12-20 Mengxiao Liu , Yuejun Wei , Zhenyuan Chen , Wenyi Zhang