English
Related papers

Related papers: Error Exponents for Variable-length Block Codes wi…

200 papers

The performance of an error correcting code is evaluated by its error probability, rate, and en/decoding complexity. The performance of a series of codes is evaluated by, as the block lengths approach infinity, whether their error…

Information Theory · Computer Science 2021-07-15 Hsin-Po Wang

We investigate deterministic identification over arbitrary memoryless channels under the constraint that the error probabilities of first and second kind are exponentially small in the block length $\mathbf{n}$, controlled by reliability…

Information Theory · Computer Science 2025-07-29 Pau Colomer , Christian Deppe , Holger Boche , Andreas Winter

We consider data transmission across discrete memoryless channels (DMCs) using variable-length codes with feedback. We consider the family of such codes whose rates are $\rho_N$ below the channel capacity $C$, where $\rho_N$ is a positive…

Information Theory · Computer Science 2018-05-17 Lan V. Truong , Vincent Y. F. Tan

We examine regular and irregular repeat-accumulate (RA) codes with repetition degrees which are all even. For these codes and with a particular choice of an interleaver, we give an upper bound on the decoding error probability of a…

Information Theory · Computer Science 2010-02-22 Idan Goldenberg , David Burshtein

Guruswami and Indyk showed in [1] that Forney's error exponent can be achieved with linear coding complexity over binary symmetric channels. This paper extends this conclusion to general discrete-time memoryless channels and shows that…

Information Theory · Computer Science 2016-11-17 Zheng Wang , Jie Luo

We consider the stationaly memoryless channels with input cost. We prove that for transmission rates above the capacity the correct probability of decoding tends to zero exponentially as the block length $n$ of codes tends to infinity. In…

Information Theory · Computer Science 2025-09-26 Yasutada Oohama

The decoding error probability of codes is studied as a function of their block length. It is shown that the existence of codes with a polynomially small decoding error probability implies the existence of codes with an exponentially small…

Information Theory · Computer Science 2007-07-13 Alexei Ashikhmin , Vitaly Skachek

We derive a general formula of the minimum achievable rate for fixed-to-variable length coding with a regular cost function by allowing the error probability up to a constant $\varepsilon$. For a fixed-to-variable length code, we call the…

Information Theory · Computer Science 2017-10-11 Hideki Yagi , Ryo Nomura

The highest fidelity of quantum error-correcting codes of length n and rate R is proven to be lower bounded by 1 - exp [-n E(R)+ o(n)] for some function E(R) on noisy quantum channels that are subject to not necessarily independent errors.…

Quantum Physics · Physics 2015-06-26 Mitsuru Hamada

The problem of distributed testing against independence with variable-length coding is considered when the \emph{average} and not the \emph{maximum} communication load is constrained as in previous works. The paper characterizes the optimum…

Information Theory · Computer Science 2020-05-19 Sadaf Salehkalaibar , Michele Wigger

This paper considers the problem of variable-length coding over a discrete memoryless channel (DMC) with noiseless feedback. The paper provides a stochastic control view of the problem whose solution is analyzed via a newly proposed…

Information Theory · Computer Science 2016-11-18 Mohammad Naghshvar , Tara Javidi , Michèle Wigger

The problem of variable-rate lossless data compression is considered, for codes with and without prefix constraints. Sharp bounds are derived for the best achievable compression rate of memoryless sources, when the excess-rate probability…

Information Theory · Computer Science 2025-11-13 Andreas Theocharous , Lampros Gavalakis , Ioannis Kontoyiannis

Over any discrete memoryless channel, we build codes such that: for one, their block error probabilities and code rates scale like random codes'; and for two, their encoding and decoding complexities scale like polar codes'. Quantitatively,…

Information Theory · Computer Science 2020-12-14 Hsin-Po Wang , Iwan Duursma

This paper studies the fundamental limits of the minimum average length of lossless and lossy variable-length compression, allowing a nonzero error probability $\epsilon$, for lossless compression. We give non-asymptotic bounds on the…

Information Theory · Computer Science 2015-10-09 Victoria Kostina , Yury Polyanskiy , Sergio Verdú

We derive upper and lower bounds for the error exponents of lossless streaming compression of two correlated sources under the blockwise and symbolwise settings. We consider the linear scaling regime in which the delay is a scalar multiple…

Information Theory · Computer Science 2016-02-24 Lin Zhou , Vincent Yan Fu Tan , Mehul Motani

In this work, we consider efficient maximum-likelihood decoding of linear block codes for small-to-moderate block lengths. The presented approach is a branch-and-bound algorithm using the cutting-plane approach of Zhang and Siegel (IEEE…

Information Theory · Computer Science 2014-04-29 Michael Helmling , Eirik Rosnes , Stefan Ruzika , Stefan Scholl

In \cite{butman1976} the linear coding scheme is applied, $X_t =g_t\Big(\Theta - {\bf E}\Big\{\Theta\Big|Y^{t-1}, V_0=v_0\Big\}\Big)$, $t=2,\ldots,n$, $X_1=g_1\Theta$, with $\Theta: \Omega \to {\mathbb R}$, a Gaussian random variable, to…

Information Theory · Computer Science 2021-06-17 Charalambos D. Charalambous , Christos Kourtellaris , Themistoklis Charalambous

We study channel simulation under common randomness assistance in the finite-blocklength regime and identify the smooth channel max-information as a linear program one-shot converse on the minimal simulation cost for fixed error tolerance.…

Information Theory · Computer Science 2024-10-10 Michael X. Cao , Navneeth Ramakrishnan , Mario Berta , Marco Tomamichel

It is shown that for any binary-input discrete memoryless channel $W$ with symmetric capacity $I(W)$ and any rate $R <I(W)$, the probability of block decoding error for polar coding under successive cancellation decoding satisfies $P_e \le…

Information Theory · Computer Science 2009-04-06 Erdal Arikan , Emre Telatar

In this paper, we are interested in the performance of a variable-length stop-feedback (VLSF) code with $m$ optimal decoding times for the binary-input additive white Gaussian noise channel. We first develop tight approximations on the tail…

Information Theory · Computer Science 2022-02-08 Hengjie Yang , Recep Can Yavas , Victoria Kostina , Richard D. Wesel