English
Related papers

Related papers: Error exponents of typical random codes

200 papers

We consider irregular product codes.In this class of codes, each codeword is represented by a matrix. The entries in each row (column) of the matrix should come from a component row (column) code. As opposed to (standard) product codes, we…

Information Theory · Computer Science 2012-06-12 Masoud Alipour , Omid Etesami , Ghid Maatouk , Amin Shokrollahi

In this paper, we first introduce the concept of elementary linear subspace, which has similar properties to those of a set of coordinates. Using this new concept, we derive properties of maximum rank distance (MRD) codes that parallel…

Information Theory · Computer Science 2007-07-13 Maximilien Gadouleau , Zhiyuan Yan

A missing piece in quantum information theory, with very few exceptions, has been to provide the random coding exponents for quantum information-processing protocols. We remedy the situation by providing these exponents for a variety of…

Quantum Physics · Physics 2015-09-30 Naresh Sharma

We consider the problem of modulation and estimation of a random parameter $U$ to be conveyed across a discrete memoryless channel. Upper and lower bounds are derived for the best achievable exponential decay rate of a general moment of the…

Information Theory · Computer Science 2016-11-17 Neri Merhav

Error probabilities of random codes for memoryless channels are considered in this paper. In the area of communication systems, admissible error probability is very small and it is sometimes more important to discuss the relative gap…

Information Theory · Computer Science 2015-06-11 Junya Honda

This paper introduces a novel error estimator for the Proper Generalized Decomposition (PGD) approximation of parametrized equations. The estimator is intrinsically random: It builds on concentration inequalities of Gaussian maps and an…

Numerical Analysis · Mathematics 2019-10-28 Kathrin Smetana , Olivier Zahm

We analyze the trade-off between the undetected error probability (i.e., the probability that the channel decoder outputs an erroneous message without detecting the error) and the total error probability in the short blocklength regime. We…

Information Theory · Computer Science 2025-03-05 Alexander Sauter , A. Oguz Kislal , Giuseppe Durisi , Gianluigi Liva , Balazs Matuz , Erik G. Ström

Most low-density parity-check (LDPC) code constructions are considered over finite fields. In this work, we focus on regular LDPC codes over integer residue rings and analyze their performance with respect to the Lee metric. Their…

Information Theory · Computer Science 2024-08-01 Jessica Bariffi , Hannes Bartz , Gianluigi Liva , Joachim Rosenthal

We are concerned with the issue of how to calculate the normalized maximum likelihood (NML) code-length. There is a problem that the normalization term of the NML code-length may diverge when it is continuous and unbounded and a…

Machine Learning · Computer Science 2012-05-18 So Hirai , Kenji Yamanishi

We introduce a thermodynamic (large deviation) formalism for computing error exponents in error-correcting codes. Within this framework, we apply the heuristic cavity method from statistical mechanics to derive the average and typical error…

Information Theory · Computer Science 2007-07-16 Thierry Mora , Olivier Rivoire

Guessing Random Additive Noise Decoding (GRAND) is a family of hard- and soft-detection error correction decoding algorithms that provide accurate decoding of any moderate redundancy code of any length. Here we establish a method through…

Information Theory · Computer Science 2023-08-11 Kevin Galligan , Peihong Yuan , Muriel Médard , Ken R. Duffy

Recently, network error correction coding (NEC) has been studied extensively. Several bounds in classical coding theory have been extended to network error correction coding, especially the Singleton bound. In this paper, following the…

Information Theory · Computer Science 2010-11-08 Xuan Guang , Fang-Wei Fu , Zhen Zhang

Inner and outer bounds are derived on the optimal performance of fixed length block codes on discrete memoryless channels with feedback and errors-and-erasures decoding. First an inner bound is derived using a two phase encoding scheme with…

Information Theory · Computer Science 2020-01-03 Baris Nakiboglu , Lizhong Zheng

Locally decodable codes (LDCs) are error correcting codes that allow for decoding of a single message bit using a small number of queries to a corrupted encoding. Despite decades of study, the optimal trade-off between query complexity and…

Computational Complexity · Computer Science 2017-06-28 Jop Briët , Zeev Dvir , Sivakanth Gopi

This paper considers the problem of channel coding with a given (possibly suboptimal) maximum-metric decoding rule. A cost-constrained random-coding ensemble with multiple auxiliary costs is introduced, and is shown to achieve error…

Information Theory · Computer Science 2014-03-05 Jonathan Scarlett , Alfonso Martinez , Albert Guillén i Fàbregas

The DNA storage channel is considered, in which a codeword is comprised of $M$ unordered DNA molecules. At reading time, $N$ molecules are sampled with replacement, and then each molecule is sequenced. A coded-index concatenated-coding…

Information Theory · Computer Science 2022-05-23 Nir Weinberger

We consider the topic of universal decoding with a decoder that does not have direct access to the codebook, but only to noisy versions of the various randomly generated codewords, a problem motivated by biometrical identification systems.…

Information Theory · Computer Science 2016-09-05 Neri Merhav

The prevailing assumption of an exponential decay in large language model (LLM) reliability with sequence length, predicated on independent per-token error probabilities, posits an inherent limitation for long autoregressive outputs. Our…

Computation and Language · Computer Science 2026-05-07 Mikhail L. Arbuzov , Sisong Bei , Ziwei Dong , Dmitri Kalaev , Alexey A. Shvets

Variable-length compression without prefix-free constraints and with side-information available at both encoder and decoder is considered. Instead of requiring the code to be error-free, we allow for it to have a non-vanishing error…

Information Theory · Computer Science 2020-08-24 Yuta Sakai , Vincent Y. F. Tan

We derive the optimum second-order coding rates, known as second-order capacities, for erasure and list decoding. For erasure decoding for discrete memoryless channels, we show that second-order capacity is $\sqrt{V}\Phi^{-1}(\epsilon_t)$…

Information Theory · Computer Science 2014-04-22 Vincent Y. F. Tan , Pierre Moulin
‹ Prev 1 3 4 5 6 7 10 Next ›