English

List decoding - random coding exponents and expurgated exponents

Information Theory 2016-11-17 v1 math.IT

Abstract

Some new results are derived concerning random coding error exponents and expurgated exponents for list decoding with a deterministic list size LL. Two asymptotic regimes are considered, the fixed list-size regime, where LL is fixed independently of the block length nn, and the exponential list-size, where LL grows exponentially with nn. We first derive a general upper bound on the list-decoding average error probability, which is suitable for both regimes. This bound leads to more specific bounds in the two regimes. In the fixed list-size regime, the bound is related to known bounds and we establish its exponential tightness. In the exponential list-size regime, we establish the achievability of the well known sphere packing lower bound. Relations to guessing exponents are also provided. An immediate byproduct of our analysis in both regimes is the universality of the maximum mutual information (MMI) list decoder in the error exponent sense. Finally, we consider expurgated bounds at low rates, both using Gallager's approach and the Csisz\'ar-K\"orner-Marton approach, which is, in general better (at least for L=1L=1). The latter expurgated bound, which involves the notion of {\it multi-information}, is also modified to apply to continuous alphabet channels, and in particular, to the Gaussian memoryless channel, where the expression of the expurgated bound becomes quite explicit.

Keywords

Cite

@article{arxiv.1311.7298,
  title  = {List decoding - random coding exponents and expurgated exponents},
  author = {Neri Merhav},
  journal= {arXiv preprint arXiv:1311.7298},
  year   = {2016}
}

Comments

28 pages; submitted to the IEEE Trans. on Information Theory

R2 v1 2026-06-22T02:16:51.041Z