English
Related papers

Related papers: Analysis of Sequential Decoding Complexity Using t…

200 papers

We propose a Semantic Ordered Statistics Decoder (sem-OSD), a soft decoder for short linear block codes carrying byte-streamed sources such as natural-language text. Sem-OSD injects a byte-level language-model (LM) prior into ordered…

Information Theory · Computer Science 2026-05-05 Chentao Yue , Branka Vucetic , Yonghui Li

We consider the problem of sampling from a strongly log-concave density in $\mathbb{R}^d$, and prove an information theoretic lower bound on the number of stochastic gradient queries of the log density needed. Several popular sampling…

Machine Learning · Statistics 2021-07-06 Niladri S. Chatterji , Peter L. Bartlett , Philip M. Long

Guessing Random Additive Noise Decoding (GRAND) is a recently proposed universal Maximum Likelihood (ML) decoder for short-length and high-rate linear block-codes. Soft-GRAND (SGRAND) is a prominent soft-input GRAND variant, outperforming…

Information Theory · Computer Science 2022-12-05 Syed Mohsin Abbas , Marwan Jalaleddine , Warren J. Gross

A concatenated coding scheme over binary memoryless symmetric (BMS) channels using a polarization transformation followed by outer sub-codes is analyzed. Achievable error exponents and upper bounds on the error rate are derived. The first…

Information Theory · Computer Science 2017-10-24 Dina Goldin , David Burshtein

We introduce a novel approach to error correction decoding in the presence of additive alpha-stable noise, which serves as a model of interference-limited wireless systems. In the absence of modifications to decoding algorithms, treating…

Information Theory · Computer Science 2024-10-31 Charles Wiame , Ken R. Duffy , Muriel Médard

In this paper, we study chance constrained mixed integer program with consideration of recourse decisions and their incurred cost, developed on a finite discrete scenario set. Through studying a non-traditional bilinear mixed integer…

Optimization and Control · Mathematics 2016-10-05 Bo Zeng , Yu An , Ludwig Kuznia

The performance of maximum-likelihood (ML) decoded binary linear block codes is addressed via the derivation of tightened upper bounds on their decoding error probability. The upper bounds on the block and bit error probabilities are valid…

Information Theory · Computer Science 2007-07-13 M. Twitto , I. Sason , S. Shamai

We establish fundamental limits on estimation accuracy for the noisy 20 questions problem with measurement-dependent noise and introduce optimal non-adaptive procedures that achieve these limits. The minimal achievable resolution is defined…

Information Theory · Computer Science 2021-01-12 Lin Zhou , Alfred Hero

We present a convergence rate analysis for biased stochastic gradient descent (SGD), where individual gradient updates are corrupted by computation errors. We develop stochastic quadratic constraints to formulate a small linear matrix…

Optimization and Control · Mathematics 2020-03-31 Bin Hu , Peter Seiler , Laurent Lessard

In this work, we provide a $(n/m)^{-1/2}$-rate finite sample Berry-Esseen bound for $m$-dependent high-dimensional random vectors over the class of hyper-rectangles. This bound imposes minimal assumptions on the random vectors such as…

Probability · Mathematics 2022-12-13 Heejong Bong , Arun Kumar Kuchibhotla , Alessandro Rinaldo

We propose four finite-length scaling laws to predict the frame error rate (FER) performance of spatially-coupled low-density parity-check codes under full belief propagation (BP) decoding with a limit on the number of decoding iterations…

Information Theory · Computer Science 2022-03-18 Roman Sokolovskii , Alexandre Graell i Amat , Fredrik Brännström

Fault-tolerant quantum computers will depend crucially on the performance of the classical decoding algorithm which takes in the results of measurements and outputs corrections to the errors inferred to have occurred. Machine learning…

Quantum Physics · Physics 2025-04-18 John Blue , Harshil Avlani , Zhiyang He , Liu Ziyin , Isaac L. Chuang

Using a modification of Stein's method, we generalize the results of Bentkus, G{\"o}tze, and Tikhomirov \cite{bentkus1997berry} to obtain Berry-Esseen bounds for a broad class of statistics of sequences of $\phi$-mixing, non-stationary…

Probability · Mathematics 2026-04-07 Brendan Williams , Yeor Hafouta

Consider a stationary, weakly dependent sequence of random variables. Given only mild conditions, allowing for polynomial decay of the autocovariance function, we show a Berry-Esseen bound of optimal order $n^{-1/2}$ for studentized…

Probability · Mathematics 2025-04-22 Moritz Jirak

To alleviate the suboptimal performance of belief propagation (BP) decoding of short low-density parity-check (LDPC) codes, a plethora of improved decoding algorithms has been proposed over the last two decades. Many of these methods can be…

Information Theory · Computer Science 2024-11-01 Felix Krieg , Jannis Clausius , Marvin Geiselhart , Stephan ten Brink

The analysis of random coding error exponents pertaining to erasure/list decoding, due to Forney, is revisited. Instead of using Jensen's inequality as well as some other inequalities in the derivation, we demonstrate that an exponentially…

Information Theory · Computer Science 2016-11-17 Neri Merhav

In this paper, we obtain the Berry-Esseen bound for multivariate normal approximation for the Polyak-Ruppert averaged iterates of the linear stochastic approximation (LSA) algorithm with decreasing step size. Moreover, we prove the…

Machine Learning · Statistics 2025-02-04 Sergey Samsonov , Eric Moulines , Qi-Man Shao , Zhuo-Song Zhang , Alexey Naumov

In this paper we consider the cluster estimation problem under the Stochastic Block Model. We show that the semidefinite programming (SDP) formulation for this problem achieves an error rate that decays exponentially in the signal-to-noise…

Machine Learning · Statistics 2017-05-24 Yingjie Fei , Yudong Chen

Traditionally, multi-trial error/erasure decoding of Reed-Solomon (RS) codes is based on Bounded Minimum Distance (BMD) decoders with an erasure option. Such decoders have error/erasure tradeoff factor L=2, which means that an error is…

Information Theory · Computer Science 2015-03-19 Christian Senger , Vladimir R. Sidorenko , Martin Bossert , Victor V. Zyablov

Consider the problem of identifying a massive number of bees, uniquely labeled with barcodes, using noisy measurements. We formally introduce this `bee-identification problem', define its error exponent, and derive efficiently computable…

Information Theory · Computer Science 2019-06-05 Anshoo Tandon , Vincent Y. F. Tan , Lav R. Varshney
‹ Prev 1 3 4 5 6 7 10 Next ›