English
Related papers

Related papers: New Techniques for Upper-Bounding the ML Decoding …

200 papers

This work proves new results on the ability of binary Reed-Muller codes to decode from random errors and erasures. We obtain these results by proving improved bounds on the weight distribution of Reed-Muller codes of high degrees.…

Information Theory · Computer Science 2018-12-03 Ori Sberlo , Amir Shpilka

This paper tackles two problems that fall under the study of coding for insertions and deletions. These problems are motivated by several applications, among them is reconstructing strands in DNA-based storage systems. Under this paradigm,…

Information Theory · Computer Science 2025-06-23 Omer Sabary , Daniella Bar-Lev , Yotam Gershon , Alexander Yucovich , Eitan Yaakobi

Motivated by a greedy approach for generating {\it{information stable}} processes, we prove a universal maximum likelihood (ML) upper bound on the capacities of discrete information stable channels, including the binary erasure channel…

Information Theory · Computer Science 2018-05-21 Tongxin Li

Linear programming approaches have been applied to derive upper bounds on the size of classical codes and quantum codes. In this paper, we derive similar results for general quantum codes with entanglement assistance, including nonadditive…

Information Theory · Computer Science 2018-01-16 Ching-Yi Lai , Alexei Ashikhmin

Recently, Gilmer proved the first constant lower bound for the union-closed sets conjecture via an information-theoretic argument. The heart of the argument is an entropic inequality involving the OR function of two i.i.d.\ binary vectors,…

Information Theory · Computer Science 2023-06-16 Jingbo Liu

In this paper, we re-visit the combinatorial error model of Mazumdar et al. that models errors in high-density magnetic recording caused by lack of knowledge of grain boundaries in the recording medium. We present new upper bounds on the…

Discrete Mathematics · Computer Science 2013-06-20 Navin Kashyap , Gilles Zémor

Ahlswede and Katona (1977) posed the following isodiametric problem in Hamming spaces: For every $n$ and $1\le M\le2^{n}$, determine the minimum average Hamming distance of binary codes with length $n$ and size $M$. Fu, Wei, and Yeung…

Combinatorics · Mathematics 2019-10-22 Lei Yu , Vincent Y. F. Tan

We describe two implementations of the optimal error correction algorithm known as the maximum likelihood decoder (MLD) for the 2D surface code with a noiseless syndrome extraction. First, we show how to implement MLD exactly in time…

Quantum Physics · Physics 2014-10-01 Sergey Bravyi , Martin Suchara , Alexander Vargo

This paper studies the interpretability of neural network features from a Bayesian Gaussian view, where optimizing a cost is reaching a probabilistic bound; learning a model approximates a density that makes the bound tight and the cost…

Machine Learning · Computer Science 2025-11-18 Bo Hu , Jose C. Principe

In this paper, we use reinforcement learning to find effective decoding strategies for binary linear codes. We start by reviewing several iterative decoding algorithms that involve a decision-making process at each step, including…

Information Theory · Computer Science 2019-12-10 Fabrizio Carpi , Christian Häger , Marco Martalò , Riccardo Raheli , Henry D. Pfister

An additive noise channel is considered, in which the distribution of the noise is nonparametric and unknown. The problem of learning encoders and decoders based on noise samples is considered. For uncoded communication systems, the problem…

Information Theory · Computer Science 2021-11-17 Nir Weinberger

We consider a broadcast channel with a degraded message set, in which a single transmitter sends a common message to two receivers and a private message to one of the receivers only. The main goal of this work is to find new lower bounds to…

Information Theory · Computer Science 2009-06-09 Yonatan Kaspi , Neri Merhav

This work contains two main contributions concerning the expurgation of hierarchical ensembles for the asymmetric broadcast channel. The first is an analysis of the optimal maximum likelihood (ML) decoders for the weak and strong user. Two…

Information Theory · Computer Science 2017-11-29 Ran Averbuch , Nir Weinberger , Neri Merhav

A Lagrange-dual (Gallager-style) lower bound is derived for the error exponent function of the typical random code (TRC) pertaining to the i.i.d. random coding ensemble and mismatched stochastic likelihood decoding. While the original…

Information Theory · Computer Science 2019-08-13 Neri Merhav

The binary asymmetric channel is a model for practical communication systems where the error probabilities for symbol transitions $0\rightarrow 1$ and $1\rightarrow0$ differ substantially. In this paper, we introduce the notion of…

Information Theory · Computer Science 2026-04-10 Shukai Wang , Cuiling Fan , Chunming Tang , Zhengchun Zhou

In this paper upper and lower bounds on the probability of decoding failure under maximum likelihood decoding are derived for different (nonbinary) Raptor code constructions. In particular four different constructions are considered; (i)…

Information Theory · Computer Science 2021-01-08 Francisco Lázaro , Gianluigi Liva , Gerhard Bauch , Enrico Paolini

An approach is established for maximizing the Lower bound on the Mismatch capacity (hereafter abbreviated as LM rate), a key performance bound in mismatched decoding, by optimizing the channel input probability distribution. Under a fixed…

Information Theory · Computer Science 2024-05-02 Lingyi Chen , Shitong Wu , Xinwei Li , Huihui Wu , Hao Wu , Wenyi Zhang

The error coefficient of a linear code is defined as the number of minimum-weight codewords. In an additive white Gaussian noise channel, optimal linear codes with the smallest error coefficients achieve the best possible asymptotic frame…

Information Theory · Computer Science 2025-07-09 Chaofeng Guan , Shitao Li , Gaojun Luo , Zhi Ma , Hong Wang

Understanding how the optimal value of an optimisation problem changes when its input data is modified is an old question in mathematical optimisation. This paper investigates the computation of the optimal values of a family of (possibly…

Optimization and Control · Mathematics 2026-03-02 Guillaume Derval , Damien Ernst , Quentin Louveaux , Bardhyl Miftari

This paper considers the achievability and converse bounds on the maximal channel coding rate at a given blocklength and error probability over AWGN channels. The problem stems from covert communication with Gaussian codewords. By…

Information Theory · Computer Science 2021-01-01 Xinchun Yu , Shuangqin Wei , Yuan Luo