English
Related papers

Related papers: Guessing Decoding of Short Blocklength Codes

200 papers

Gradient descent (GD) methods are commonly employed in machine learning problems to optimize the parameters of the model in an iterative fashion. For problems with massive datasets, computations are distributed to many parallel computing…

Information Theory · Computer Science 2019-03-06 Emre Ozfatura , Deniz Gunduz , Sennur Ulukus

The ordered-reliability bits (ORB) variant of guessing random additive noise decoding (GRAND), known as ORBGRAND, achieves remarkably low time complexity at high code rates compared to other GRAND variants. However, its computational…

Information Theory · Computer Science 2025-02-05 Mohammad Rowshan , Jinhong Yuan

The high computational cost of approaching the performance of Maximum-likelihood (ML) decoding has limited its practical use for decades. Because the complexity grows exponentially with the message length, researchers have spent years…

Signal Processing · Electrical Eng. & Systems 2026-04-21 Marwan Jalaleddine , Jiajie Li , Syed Mohsin Abbas , Warren J. Gross

We introduce and analyze a new type of decoding algorithm called General Color Clustering (GCC), based on renormalization group methods, to be used in qudit color codes. The performance of this decoder is analyzed under code capacity…

Quantum Physics · Physics 2017-11-20 Jacob Marks , Tomas Jochym-O'Connor , Vlad Gheorghiu

Parallelism has become a central concern in modern decoding frameworks aiming to meet stringent throughput and latency requirements. Guessing Random Additive Noise Decoding (GRAND) is a recently proposed decoding paradigm that tests…

Information Theory · Computer Science 2026-05-04 Li Wan , Huarui Yin , Wenyi Zhang

The sum-rank metric generalizes the Hamming and rank metric by partitioning vectors into blocks and defining the total weight as the sum of the rank weights of these blocks, based on their matrix representation. In this work, we explore…

Information Theory · Computer Science 2024-10-22 Thomas Jerkovits , Hannes Bartz , Antonia Wachter-Zeh

We establish that during the execution of any Guessing Random Additive Noise Decoding (GRAND) algorithm, an interpretable, useful measure of decoding confidence can be evaluated. This measure takes the form of a log-likelihood ratio (LLR)…

Information Theory · Computer Science 2023-08-11 Ken R. Duffy , Muriel Medard

This paper reviews the potential channel decoding techniques for ultra-reliable low-latency communications (URLLC). URLLC is renowned for its stringent requirements including ultra-reliability, low end-to-end transmission latency, and…

Information Theory · Computer Science 2022-12-26 Chentao Yue , Vera Miloslavskaya , Mahyar Shirvanimoghaddam , Branka Vucetic , Yonghui Li

Optimal modulation (OM) schemes for Gaussian channels with peak and average power constraints are known to require nonuniform probability distributions over signal points, which presents practical challenges. An established way to map…

Information Theory · Computer Science 2022-11-01 Basak Ozaydin , Muriel Médard , Ken Duffy

Fault-tolerant quantum computing demands decoders that are fast, accurate, and adaptable to circuit structure and realistic noise. While machine learning (ML) decoders have demonstrated impressive performance for quantum memory, their use…

Quantum Physics · Physics 2025-09-16 J. Pablo Bonilla Ataides , Andi Gu , Susanne F. Yelin , Mikhail D. Lukin

Large language models~(LLMs) exhibit exceptional performance in language tasks, yet their auto-regressive inference is limited due to high computational requirements and is sub-optimal due to the exposure bias. Inspired by speculative…

Computation and Language · Computer Science 2024-03-14 Hongyi Yuan , Keming Lu , Fei Huang , Zheng Yuan , Chang Zhou

We consider the Additive White Gaussian Noise channel with Binary Phase Shift Keying modulation. Our aim is to enable an algebraic hard decision Bounded Minimum Distance decoder for a binary block code to exploit soft information obtained…

Information Theory · Computer Science 2009-05-18 Christian Senger , Vladimir Sidorenko , Victor Zyablov

Ultra-reliable low-latency communications (URLLC) demand decoding algorithms that simultaneously offer high reliability and low complexity under stringent latency constraints. While iterative decoding schemes for LDPC and Polar codes offer…

Signal Processing · Electrical Eng. & Systems 2025-07-30 Enrico Testi , Enrico Paolini

CA-Polar codes have been selected for all control channel communications in 5G NR, but accurate, computationally feasible decoders are still subject to development. Here we report the performance of a recently proposed class of optimally…

Information Theory · Computer Science 2021-02-22 Ken Duffy , Amit Solomon , Kishori M. Konwar , Muriel Medard

This paper investigates guesswork over ordered statistics and formulates the achievable guesswork complexity of ordered statistics decoding (OSD) in binary additive white Gaussian noise (AWGN) channels. The achievable guesswork complexity…

Information Theory · Computer Science 2024-12-18 Chentao Yue , Changyang She , Branka Vucetic , Yonghui Li

Weak-to-strong generalization provides a promising paradigm for scaling large language models (LLMs) by training stronger models on samples from aligned weaker ones, without requiring human feedback or explicit reward modeling. However, its…

Computation and Language · Computer Science 2025-10-10 Houcheng Jiang , Junfeng Fang , Jiaxin Wu , Tianyu Zhang , Chen Gao , Yong Li , Xiang Wang , Xiangnan He , Yang Deng

It is well known that for Gaussian channels, a nearest neighbor decoding rule, which seeks the minimum Euclidean distance between a codeword and the received channel output vector, is the maximum likelihood solution and hence…

Information Theory · Computer Science 2022-05-09 Yizhu Wang , Wenyi Zhang

In the search for highly efficient decoders for short LDPC codes approaching maximum likelihood performance, a relayed decoding strategy, specifically activating the ordered statistics decoding process upon failure of a neural min-sum…

Information Theory · Computer Science 2024-03-26 Guangwen Li , Xiao Yu

Departing from traditional communication theory where decoding algorithms are assumed to perform without error, a system where noise perturbs both computational devices and communication channels is considered here. This paper studies…

Information Theory · Computer Science 2010-05-31 Lav R. Varshney

We propose "Generative Fusion Decoding" (GFD), a novel shallow fusion framework designed to integrate large language models (LLMs) into cross-modal text recognition systems for automatic speech recognition (ASR) and optical character…

Computation and Language · Computer Science 2025-06-12 Chan-Jan Hsu , Yi-Chang Chen , Feng-Ting Liao , Pei-Chen Ho , Yu-Hsiang Wang , Po-Chun Hsu , Da-shan Shiu