English
Related papers

Related papers: Non-Random Coding Error Exponent for Lattices

200 papers

Motivated by the approach of random linear codes, a new distance in the vector space over a finite field is defined as the logarithm of the "surface area" of a Hamming ball with radius being the corresponding Hamming distance. It is named…

Information Theory · Computer Science 2013-04-30 Shengtian Yang

In this paper, we study the problem of relaying a single bit over a tandem of binary-input channels, with the goal of attaining the highest possible error exponent in the exponentially decaying error probability. Our previous work gave an…

Information Theory · Computer Science 2024-06-07 Yan Hao Ling , Jonathan Scarlett

We prove upper bounds on outside probabilities for generic non-autonomous Schr\"odinger operators on lattices of arbitrary dimension. Our approach is based on a combination of commutator method originated in scattering theory and novel…

Mathematical Physics · Physics 2024-10-01 Jingxuan Zhang

Spinal codes, a family of rateless codes introduced in 2011, have been proved to achieve Shannon capacity over both the additive white Gaussian noise (AWGN) channel and the binary symmetric channel (BSC). In this paper, we derive explicit…

Information Theory · Computer Science 2023-04-28 Xiaomeng Chen , Aimin Li , Shaohua Wu

The distributed hypothesis testing problem with full side-information is studied. The trade-off (reliability function) between the two types of error exponents under limited rate is studied in the following way. First, the problem is…

Information Theory · Computer Science 2019-04-24 Nir Weinberger , Yuval Kochman

We develop a new class of distance-aware error bounds that tightly characterize the approximation error of spline neural networks. Our bottom-up approach analyzes the error bound of each neuron (a spline) and then extends it to the full…

Signal Processing · Electrical Eng. & Systems 2026-05-04 Masoud Ataei , Mohammad Javad Khojasteh , Vikas Dhiman

We analyze the optimal trade-off between the error exponent and the excess-rate exponent for variable-rate Slepian-Wolf codes. In particular, we first derive upper (converse) bounds on the optimal error and excess-rate exponents, and then…

Information Theory · Computer Science 2014-11-07 Nir Weinberger , Neri Merhav

In this paper, we propose a new class of lattices constructed from polar codes, namely polar lattices, to achieve the capacity $\frac{1}{2}\log(1+\SNR)$ of the additive white Gaussian-noise (AWGN) channel. Our construction follows the…

Information Theory · Computer Science 2018-10-16 Ling Liu , Yanfei Yan , Cong Ling , Xiaofu Wu

Sparse superposition codes, or sparse regression codes (SPARCs), are a recent class of codes for reliable communication over the AWGN channel at rates approaching the channel capacity. Approximate message passing (AMP) decoding, a…

Information Theory · Computer Science 2019-04-24 Cynthia Rush , Ramji Venkataramanan

In this paper we provide explicit upper bounds on some distances between the (law of the) output of a random Gaussian NN and (the law of) a random Gaussian vector. Our results concern both shallow random Gaussian neural networks with…

Statistical learning theory and the Probably Approximately Correct (PAC) criterion are the common approach to mathematical learning theory. PAC is widely used to analyze learning problems and algorithms, and have been studied thoroughly.…

Machine Learning · Computer Science 2024-05-03 Adi Hendel , Meir Feder

We derive a new upper bound on the reliability function for channel coding over discrete memoryless channels. Our bounding technique relies on two main elements: (i) adding an auxiliary genie-receiver that reveals to the original receiver a…

Information Theory · Computer Science 2022-09-05 Anelia Somekh-Baruch

New lower and upper bounds on the reliability function of typewriter channels are given. Our lower bounds improve upon the (multiletter) expurgated bound of Gallager, furnishing a new and simple counterexample to a conjecture made in 1967…

Information Theory · Computer Science 2017-11-02 M. Dalai , Y. Polyanskiy

We extend a low-rate improvement of the random coding bound on the reliability of a classical discrete memoryless channel to its quantum counterpart. The key observation that we make is that the problem of bounding below the error exponent…

Quantum Physics · Physics 2007-05-23 Alexander Barg

In this paper we show error bounds for randomly subsampled rank-1 lattices. We pay particular attention to the ratio of the size of the subset to the size of the initial lattice, which is decisive for the computational complexity. In the…

Numerical Analysis · Mathematics 2026-02-12 Felix Bartel , Alexander D. Gilbert , Frances Y. Kuo , Ian H. Sloan

The problem of error correction in both coherent and noncoherent network coding is considered under an adversarial model. For coherent network coding, where knowledge of the network topology and network code is assumed at the source and…

Information Theory · Computer Science 2019-05-07 Danilo Silva , Frank R. Kschischang

In this paper, we derive an asymptotic closed--form expression for the error bound on extrapolation of doubly selective mobile MIMO wireless channels. The bound shows the relationship between the prediction error and system design…

Information Theory · Computer Science 2014-07-25 Ramoni Adeogun , Paul Teal , Pawel Dmochowski

Recent work in unsupervised representation learning has focused on learning deep directed latent-variable models. Fitting these models by maximizing the marginal likelihood or evidence is typically intractable, thus a common approximation…

Machine Learning · Computer Science 2018-02-15 Alexander A. Alemi , Ben Poole , Ian Fischer , Joshua V. Dillon , Rif A. Saurous , Kevin Murphy

Statistical physics is employed to evaluate the performance of error-correcting codes in the case of finite message length for an ensemble of Gallager's error correcting codes. We follow Gallager's approach of upper-bounding the average…

Disordered Systems and Neural Networks · Physics 2009-10-31 Yoshiyuki Kabashima , Naoya Sazuka , Kazutaka Nakamura , David Saad

A linear-programming decoder for \emph{nonbinary} expander codes is presented. It is shown that the proposed decoder has the maximum-likelihood certificate properties. It is also shown that this decoder corrects any pattern of errors of a…

Information Theory · Computer Science 2016-11-17 Vitaly Skachek