English
Related papers

Related papers: Capacity-achieving Guessing Random Additive Noise …

200 papers

Within the family of guessing-based decoding algorithms, ordered reliability bits GRAND (ORBGRAND) has attracted considerable attention due to its efficient use of soft information and suitability for hardware implementation. It has also…

Information Theory · Computer Science 2026-05-05 Zhuang Li , Wenyi Zhang

This paper considers a transmitter, which uses random linear coding (RLC) to encode data packets. The generated coded packets are broadcast to one or more receivers. A receiver can recover the data packets if it gathers a sufficient number…

Information Theory · Computer Science 2022-05-05 Ioannis Chatzigeorgiou

Proposals have been made to reduce the guesswork of Guessing Random Additive Noise Decoding (GRAND) for binary linear codes by leveraging codebook structure at the expense of degraded block error rate (BLER). We establish one can preserve…

Information Theory · Computer Science 2025-12-18 Lukas Rapp , Muriel Médard , Ken R. Duffy

Within the Guessing Random Additive Noise Decoding (GRAND) family, ordered reliability bits GRAND (ORBGRAND) has received considerable attention for its hardware-friendly exploitation of soft information. Existing information-theoretic…

Information Theory · Computer Science 2026-03-12 Zhuang Li , Wenyi Zhang

We propose a massive parallel decoding GRAND framework. The framework introduces two novelties: 1. A likelihood function for $M$-QAM demodulated signals that effectively reduces the symbol error pattern space from $\mathcal{O}(5^{N/\log_2…

Information Theory · Computer Science 2024-05-06 Danilo Gligoroski , Sahana Sridhar , Katina Kralevska

In this work we develop the maximum likelihood detection (MLD) algorithm for noncoherent amplitude shift keying (NCASK) systems in additive white Gaussian noise (AWGN) channels. The developed algorithm was used to investigate the…

Information Theory · Computer Science 2019-11-11 Arafat Al-Dweik , Fuqin Xiong

We study universal decoding over unknown discrete additive channels determined by a finite-state (unifilar) random process. Aiming at low-complexity decoders, we study variants of noise-guessing decoders that use estimators for the…

Information Theory · Computer Science 2025-07-24 Henrique K. Miyamoto , Sheng Yang

Large Language Models (LLMs) have become an indispensable part of natural language processing tasks. However, autoregressive sampling has become an efficiency bottleneck. Multi-Draft Speculative Decoding (MDSD) is a recent approach where,…

Computation and Language · Computer Science 2025-02-27 Zhengmian Hu , Tong Zheng , Vignesh Viswanathan , Ziyi Chen , Ryan A. Rossi , Yihan Wu , Dinesh Manocha , Heng Huang

In this paper, we propose a quantum-native formulation of maximum likelihood detection (MLD) for overloaded multiple-input multiple-output (MIMO) systems in a random access channel, where numerous user terminals share the same channel…

Signal Processing · Electrical Eng. & Systems 2026-05-20 Hyoga Iizumi , Naoki Ishikawa , Shunsuke Uehashi , Kota Nakamura , Shusaku Umeda , Toshiaki Koike-Akino

An additive noise channel is considered, in which the distribution of the noise is nonparametric and unknown. The problem of learning encoders and decoders based on noise samples is considered. For uncoded communication systems, the problem…

Information Theory · Computer Science 2021-11-17 Nir Weinberger

CRC codes have long since been adopted in a vast range of applications. The established notion that they are suitable primarily for error detection can be set aside through use of the recently proposed Guessing Random Additive Noise…

Information Theory · Computer Science 2024-10-28 Wei An , Muriel Médard , Ken R. Duffy

In addition to a proposed codeword, error correction decoders that provide blockwise soft output (SO) return an estimate of the likelihood that the decoding is correct. Following Forney, such estimates are traditionally only possible for…

Information Theory · Computer Science 2025-03-24 Jiewei Feng , Ken R. Duffy , Muriel Médard

We describe two implementations of the optimal error correction algorithm known as the maximum likelihood decoder (MLD) for the 2D surface code with a noiseless syndrome extraction. First, we show how to implement MLD exactly in time…

Quantum Physics · Physics 2014-10-01 Sergey Bravyi , Martin Suchara , Alexander Vargo

We establish that a large, flexible class of long, high redundancy error correcting codes can be efficiently and accurately decoded with guessing random additive noise decoding (GRAND). Performance evaluation demonstrates that it is…

Information Theory · Computer Science 2025-12-18 Peihong Yuan , Muriel Medard , Kevin Galligan , Ken R. Duffy

We present a novel method for error correction in the presence of fading channel estimation errors (CEE). When such errors are significant, considerable performance losses can be observed if the wireless transceiver is not adapted. Instead…

Information Theory · Computer Science 2025-06-18 Charles Wiame , Ken R. Duffy , Muriel Médard

Large Language Models (LLMs) struggle with reliably generating highly structured outputs, such as program code, mathematical formulas, or well-formed markup. Constrained decoding approaches mitigate this problem by greedily restricting what…

Artificial Intelligence · Computer Science 2025-12-15 Kanghee Park , Jiayu Wang , Taylor Berg-Kirkpatrick , Nadia Polikarpova , Loris D'Antoni

The problem of learning a channel decoder is considered for two channel models. The first model is an additive noise channel whose noise distribution is unknown and nonparametric. The learner is provided with a fixed codebook and a dataset…

Information Theory · Computer Science 2023-02-17 Amit Tsvieli , Nir Weinberger

The emergence of long-context large language models (LLMs) offers a promising alternative to traditional retrieval-augmented generation (RAG) for processing extensive documents. However, the computational overhead of long-context inference…

Computation and Language · Computer Science 2025-06-24 Guanzheng Chen , Qilong Feng , Jinjie Ni , Xin Li , Michael Qizhe Shieh

We introduce a new family of concatenated codes with an outer low-density parity-check (LDPC) code and an inner low-density generator matrix (LDGM) code, and prove that these codes can achieve capacity under any memoryless binary-input…

Information Theory · Computer Science 2016-08-31 Chun-Hao Hsu , Achilleas Anastasopoulos

We establish that during the execution of any Guessing Random Additive Noise Decoding (GRAND) algorithm, an interpretable, useful measure of decoding confidence can be evaluated. This measure takes the form of a log-likelihood ratio (LLR)…

Information Theory · Computer Science 2023-08-11 Ken R. Duffy , Muriel Medard