English
Related papers

Related papers: Reed-Muller Subcodes: Machine Learning-Aided Desig…

200 papers

Interleaved Reed-Solomon codes admit efficient decoding algorithms which correct burst errors far beyond half the minimum distance in the random errors regime, e.g., by computing a common solution to the Key Equation for each Reed-Solomon…

The distance profiles of linear block codes can be employed to design variational coding scheme for encoding message with variational length and getting lower decoding error probability by large minimum Hamming distance. %, e.g. the design…

Information Theory · Computer Science 2013-06-05 Xiaogang Liu , Yuan Luo , Kenneth W. Shum

Over the past years, Polar codes have arisen as a highly effective class of linear codes, equipped with a decoding algorithm of low computational complexity. This family of codes share a common algebraic formalism with the well-known…

Combinatorics · Mathematics 2024-06-17 Jicheng Ma , Guiying Yan

Since the classical work of Berlekamp, McEliece and van Tilborg, it is well known that the problem of exact maximum-likelihood (ML) decoding of general linear codes is NP-hard. In this paper, we show that exact ML decoding of a classs of…

Information Theory · Computer Science 2016-11-17 Weiyu Xu , Babak Hassibi

We decode Reed-Solomon codes using soft information provided at the receiver. The Extended Euclidean Algorithm (EEA) is considered as an initial step to obtain an intermediate result. The final decoding result is obtained by interpolating…

Information Theory · Computer Science 2014-06-04 Mostafa Hosni Mohamed , Johan S. R. Nielsen , Martin Bossert

Products codes (PCs) are conventionally decoded with efficient iterative bounded-distance decoding (iBDD) based on hard-decision channel outputs which entails a performance loss compared to a soft-decision decoder. Recently, several hybrid…

Information Theory · Computer Science 2022-11-22 Sisi Miao , Lukas Rapp , Laurent Schmalen

Reed-Muller codes are some of the oldest and most widely studied error-correcting codes, of interest for both their algebraic structure as well as their many algorithmic properties. A recent beautiful result of Saptharishi, Shpilka and Volk…

Information Theory · Computer Science 2017-12-19 Swastik Kopparty , Aditya Potukuchi

To generate data from trained diffusion models, most inference algorithms, such as DDPM, DDIM, and other variants, rely on discretizing the reverse SDEs or their equivalent ODEs. In this paper, we view such approaches as decomposing the…

Machine Learning · Statistics 2024-05-28 Xunpeng Huang , Difan Zou , Hanze Dong , Yi Zhang , Yi-An Ma , Tong Zhang

Projective Reed-Muller codes correspond to subcodes of the Reed-Muller code in which the polynomials being evaluated to yield codewords, are restricted to be homogeneous. The Generalized Hamming Weights (GHW) of a code ${\cal C}$, identify…

Information Theory · Computer Science 2018-06-07 Vinayak Ramkumar , Myna Vajha , P. Vijay Kumar

This paper presents a hybrid decoding architecture that serially couples a normalized min-sum (NMS) decoder with reinforced ordered statistics decoding (OSD) to achieve near-maximum likelihood (ML) performance for short linear block codes,…

Information Theory · Computer Science 2026-04-28 Guangwen Li , Xiao Yu

Attentional sequence-to-sequence models have become the new standard for machine translation, but one challenge of such models is a significant increase in training and decoding cost compared to phrase-based systems. Here, we focus on…

Computation and Language · Computer Science 2017-05-08 Jacob Devlin

Using techniques and results from Kudekar et al. we strengthen the bounds on the weight distribution of linear codes achieving capacity on the BEC, which were shown by the first author. In particular, we show that for any doubly transitive…

Information Theory · Computer Science 2020-08-26 Alex Samorodnitsky , Ori Sberlo

The past decade has seen notable advances in our understanding of structured error-correcting codes, particularly binary Reed--Muller (RM) codes. While initial breakthroughs were for erasure channels based on symmetry, extending these…

Information Theory · Computer Science 2025-04-23 Henry D. Pfister , Galen Reeves

Speculative decoding is an inference-acceleration method for large language models (LLMs) where a small language model generates a draft-token sequence which is further verified by the target LLM in parallel. Recent works have advanced this…

Machine Learning · Computer Science 2024-03-06 Wonseok Jeon , Mukul Gagrani , Raghavv Goel , Junyoung Park , Mingu Lee , Christopher Lott

The sum-rank metric is the mixture of the Hamming and rank metrics. The sum-rank metric found its application in network coding, locally repairable codes, space-time coding, and quantum-resistant cryptography. Linearized Reed-Solomon (LRS)…

Information Theory · Computer Science 2026-02-10 Kuo Shang , Chen Yuan , Ruiqi Zhu

We present novel decoding schemes for hard and soft decision decoding of block codes using the minimal weight codewords of the dual code. The decoding schemes will be described for cyclic codes where polynomials can be used, however, the…

Information Theory · Computer Science 2020-01-10 Martin Bossert

This letter proposes successive cancellation list (SCL) decoding of product codes with Reed--Muller (RM) component codes. SCL decoding relies on a product code description based on the $2\times 2$ Hadamard kernel, which enables interpreting…

Information Theory · Computer Science 2019-08-29 Mustafa Cemil Coşkun , Thomas Jerkovits , Gianluigi Liva

We present error-correcting codes that achieve the information-theoretically best possible trade-off between the rate and error-correction radius. Specifically, for every $0 < R < 1$ and $\eps> 0$, we present an explicit construction of…

Information Theory · Computer Science 2007-10-08 Venkatesan Guruswami , Atri Rudra

The variable-length Reverse Multi-Delimiter (RMD) codes are known to represent sequences of unbounded and unordered integers. When applied to data compression, they combine a good compression ratio with fast decoding. In this paper, we…

Information Theory · Computer Science 2023-02-14 Igor O. Zavadskyi

Multi-user spatial modulation (SM) assisted by sparse code multiple access (SCMA) has been recently proposed to provide uplink high spectral efficiency transmission. The message passing algorithm (MPA) is employed to detect the transmitted…

Signal Processing · Electrical Eng. & Systems 2020-08-19 Ibrahim Al-Nahhal , Octavia A. Dobre , Salama Ikki