English
Related papers

Related papers: Another look at expurgated bounds and their statis…

200 papers

This paper studies expurgated random-coding bounds and exponents for channel coding with a given (possibly suboptimal) decoding rule. Variations of Gallager's analysis are presented, yielding several asymptotic and non-asymptotic bounds on…

Information Theory · Computer Science 2016-11-17 Jonathan Scarlett , Li Peng , Neri Merhav , Alfonso Martinez , Albert Guillén i Fàbregas

This work contains two main contributions concerning the expurgation of hierarchical ensembles for the asymmetric broadcast channel. The first is an analysis of the optimal maximum likelihood (ML) decoders for the weak and strong user. Two…

Information Theory · Computer Science 2017-11-29 Ran Averbuch , Nir Weinberger , Neri Merhav

Some new results are derived concerning random coding error exponents and expurgated exponents for list decoding with a deterministic list size $L$. Two asymptotic regimes are considered, the fixed list-size regime, where $L$ is fixed…

Information Theory · Computer Science 2016-11-17 Neri Merhav

Caire, Taricco and Biglieri presented a detailed analysis of bit interleaved coded modulation, a simple and popular technique used to improve system performance, especially in the context of fading channels. They derived an upper bound to…

Information Theory · Computer Science 2007-07-13 Vignesh Sethuraman , Bruce Hajek

We show that for a wide range of channels and code ensembles with pairwise-independent codewords, with probability tending to 1 with the code length, expurgating an arbitrarily small fraction of codewords from a randomly selected code…

Information Theory · Computer Science 2024-04-22 Giuseppe Cocco , Albert Guillén i Fàbregas , Josep Font-Segura

The analysis of random coding error exponents pertaining to erasure/list decoding, due to Forney, is revisited. Instead of using Jensen's inequality as well as some other inequalities in the derivation, we demonstrate that an exponentially…

Information Theory · Computer Science 2016-11-17 Neri Merhav

A conceptually simple method for derivation of lower bounds on the error exponent of specific families of block codes used on classical-quantum channels with arbitrary signal states over a finite Hilbert space is presented. It is shown that…

Quantum Physics · Physics 2007-05-23 Pawel Wocjan , Dejan E. Lazic , Thomas Beth

In 1973, Gallager proved that the random-coding bound is exponentially tight for the random code ensemble at all rates, even below expurgation. This result explained that the random-coding exponent does not achieve the expurgation exponent…

Information Theory · Computer Science 2013-08-29 Yuval Domb , Ram Zamir , Meir Feder

We introduce an expurgation method for source coding with side information that enables direct dual-domain derivations of expurgated error exponents. Dual-domain methods yield optimization problems over few parameters, with any sub-optimal…

Information Theory · Computer Science 2026-02-25 Mehdi Dabirnia , Hamdi Joudeh , Albert Guillén i Fàbregas

This paper studies expurgated error exponents for joint source-channel coding for discrete memoryless sources and channels. We consider a partition of the source messages into classes, where the codeword distributions depend on the class.…

Information Theory · Computer Science 2025-09-16 AmirPouya Moeini , Albert Guillén i Fàbregas

A unified framework to obtain all known lower bounds (random coding, typical random coding and expurgated bound) on the reliability function of a point-to-point discrete memoryless channel (DMC) is presented. By using a similar idea for a…

Information Theory · Computer Science 2010-10-08 Ali Nazari , Achilleas Anastasopoulos , S. Sandeep Pradhan

New bounds on classification error rates for the error-correcting output code (ECOC) approach in machine learning are presented. These bounds have exponential decay complexity with respect to codeword length and theoretically validate the…

Machine Learning · Computer Science 2021-09-21 Hieu D. Nguyen , Mohammed Sarosh Khan , Nicholas Kaegi , Shen-Shyang Ho , Jonathan Moore , Logan Borys , Lucas Lavalva

We introduce a random coding technique for transmission over discrete memoryless channels, reminiscent of the basic construction attaining the Gilbert-Varshamov bound for codes in Hamming spaces. The code construction is based on drawing…

Information Theory · Computer Science 2019-03-15 Anelia Somekh-Baruch , Jonathan Scarlett , Albert Guillén i Fàbregas

We derive various error exponents in the bee identification problem under two different decoding rules. Under na\"ive decoding, which decodes each bee independently of the others, we analyze a general discrete memoryless channel and a…

Information Theory · Computer Science 2020-11-20 Ran Tamir , Neri Merhav

We define the error exponent of the typical random code as the long-block limit of the negative normalized expectation of the logarithm of the error probability of the random code, as opposed to the traditional random coding error exponent,…

Information Theory · Computer Science 2017-08-25 Neri Merhav

A Lagrange-dual (Gallager-style) lower bound is derived for the error exponent function of the typical random code (TRC) pertaining to the i.i.d. random coding ensemble and mismatched stochastic likelihood decoding. While the original…

Information Theory · Computer Science 2019-08-13 Neri Merhav

In this paper q-ary Raptor codes under ML decoding are considered. An upper bound on the probability of decoding failure is derived using the weight enumerator of the outer code, or its expected weight enumerator if the outer code is drawn…

Information Theory · Computer Science 2016-11-21 Francisco Lázaro , Gianluigi Liva , Enrico Paolini , Gerhard Bauch

The likelihood decoder is a stochastic decoder that selects the decoded message at random, using the posterior distribution of the true underlying message given the channel output. In this work, we study a generalized version of this…

Information Theory · Computer Science 2016-11-17 Neri Merhav

We introduce a new quantum decoder based on a variant of the pretty good measurement, but defined via an alternative matrix quotient. We use this decoder to show new lower bounds on the error exponent both in the one-shot and asymptotic…

Quantum Physics · Physics 2025-07-29 Salman Beigi , Marco Tomamichel

In continuation to an earlier work, where error exponents of typical random codes were studied in the context of general block coding, with no underlying structure, here we carry out a parallel study on typical random, time-varying trellis…

Information Theory · Computer Science 2019-03-05 Neri Merhav
‹ Prev 1 2 3 10 Next ›