English
Related papers

Related papers: The generalized likelihood decoder: random coding …

200 papers

Raptor codes have been widely used in many multimedia broadcast/multicast applications. However, our understanding of Raptor codes is still incomplete due to the insufficient amount of theoretical work on the performance analysis of Raptor…

Information Theory · Computer Science 2015-01-30 Peng Wang , Guoqiang Mao , Zihuai Lin , Ming Ding , Weifa Liang , Xiaohu Ge , Zhiyun Lin

We propose a source/channel duality in the exponential regime, where success/failure in source coding parallels error/correctness in channel coding, and a distortion constraint becomes a log-likelihood ratio (LLR) threshold. We establish…

Information Theory · Computer Science 2017-01-27 Sergey Tridenski , Ram Zamir

We consider a communication problem in which the receiver must first detect the presence of an information packet and, if detected, decode the message carried within it. We present general nonasymptotic upper and lower bounds on the maximum…

Information Theory · Computer Science 2021-09-29 Alejandro Lancho , Johan Östman , Giuseppe Durisi

In source coding, either with or without side information at the decoder, the ultimate performance can be achieved by means of random binning. Structured binning into cosets of performing channel codes has been successfully employed in…

Information Theory · Computer Science 2010-08-03 Lorenzo Cappellari

We give the proof of a tight lower bound on the probability that a binomial random variable exceeds its expected value. The inequality plays an important role in a variety of contexts, including the analysis of relative deviation bounds in…

Machine Learning · Computer Science 2013-11-12 Spencer Greenberg , Mehryar Mohri

This paper considers properties of an optimization based sampler for targeting the posterior distribution when the likelihood is intractable and auxiliary statistics are used to summarize information in the data. Our reverse sampler…

Methodology · Statistics 2015-12-02 Jean-Jacques Forneron , Serena Ng

The problem of computing a linear combination of sources over a multiple access channel is studied. Inner and outer bounds on the optimal tradeoff between the communication rates are established when encoding is restricted to random…

Information Theory · Computer Science 2018-10-30 Pinar Sen , Sung Hoon Lim , Young-Han Kim

In addition to a proposed codeword, error correction decoders that provide blockwise soft output (SO) return an estimate of the likelihood that the decoding is correct. Following Forney, such estimates are traditionally only possible for…

Information Theory · Computer Science 2025-03-24 Jiewei Feng , Ken R. Duffy , Muriel Médard

We consider communication over binary-input memoryless output-symmetric channels using low-density parity-check codes and message-passing decoding. The asymptotic (in the length) performance of such a combination for a fixed number of…

Information Theory · Computer Science 2008-02-12 Satish Babu Korada , Ruediger Urbanke

This paper considers the average complexity of maximum likelihood (ML) decoding of convolutional codes. ML decoding can be modeled as finding the most probable path taken through a Markov graph. Integrated with the Viterbi algorithm (VA),…

Information Theory · Computer Science 2016-11-17 Jie Luo

A general information transmission model, under independent and identically distributed Gaussian codebook and nearest neighbor decoding rule with processed channel output, is investigated using the performance metric of generalized mutual…

Information Theory · Computer Science 2019-08-23 Wenyi Zhang , Yizhu Wang , Cong Shen , Ning Liang

The index coding problem studies the fundamental limit on broadcasting multiple messages to their respective receivers with different sets of side information that are represented by a directed graph. The generalized lexicographic product…

Information Theory · Computer Science 2018-10-02 Fatemeh Arbabjolfaei , Young-Han Kim

The golden code is a full-rate full-diversity space-time code for two transmit antennas that has a maximal coding gain. Because each codeword conveys four information symbols from an M-ary quadrature-amplitude modulation alphabet, the…

Information Theory · Computer Science 2008-11-14 Mohanned O. Sinnokrot , John R. Barry

We present a new model for LT codes which simplifies the analysis of the error probability of decoding by belief propagation. For any given degree distribution, we provide the first rigorous expression for the limiting error probability as…

Information Theory · Computer Science 2007-07-13 Elitza N. Maneva , Amin Shokrollahi

Two familiar notions of correlation are rediscovered as the extreme operating points for distributed synthesis of a discrete memoryless channel, in which a stochastic channel output is generated based on a compressed description of the…

Information Theory · Computer Science 2016-11-18 Paul Cuff

We derive a single-letter upper bound to the mismatched-decoding capacity for discrete memoryless channels. The bound is expressed as the mutual information of a transformation of the channel, such that a maximum-likelihood decoding error…

Information Theory · Computer Science 2021-02-16 Ehsan Asadi Kangarshahi , Albert Guillén i Fàbregas

We investigate threshold-based multi-trial decoding of concatenated codes with an inner Maximum-Likelihood decoder and an outer error/erasure (L+1)/L-extended Bounded Distance decoder, i.e. a decoder which corrects e errors and t erasures…

Information Theory · Computer Science 2012-02-07 Christian Senger , Vladimir R. Sidorenko , Martin Bossert , Victor V. Zyablov

We consider a variant of the channel simulation problem with a single input and multiple outputs, where Alice observes a probability distribution $P$ from a set of prescribed probability distributions $\mathbb{\mathcal{P}}$, and sends a…

Information Theory · Computer Science 2021-09-07 Chak Fung Choi , Cheuk Ting Li

This paper studies the random-coding exponent of joint source-channel coding for the multiple-access channel with correlated sources. For each user, by defining a threshold, the messages of each source are partitioned into two classes. The…

Information Theory · Computer Science 2019-04-19 Arezou Rezazadeh , Josep Font-Segura , Alfonso Martinez , Albert Guillén i Fàbregas

Since the classical work of Berlekamp, McEliece and van Tilborg, it is well known that the problem of exact maximum-likelihood (ML) decoding of general linear codes is NP-hard. In this paper, we show that exact ML decoding of a classs of…

Information Theory · Computer Science 2016-11-17 Weiyu Xu , Babak Hassibi