English
Related papers

Related papers: The Likelihood Encoder for Source Coding

200 papers

We consider the problem of erasure/list decoding using certain classes of simplified decoders. Specifically, we assume a class of erasure/list decoders, such that a codeword is in the list if its likelihood is larger than a threshold. This…

Information Theory · Computer Science 2016-11-17 Nir Weinberger , Neri Merhav

We propose a new construction for low-density source codes with multiple parameters that can be tuned to optimize the performance of the code. In addition, we introduce a set of analysis techniques for deriving upper bounds for the expected…

Information Theory · Computer Science 2007-07-13 Emin Martinian , Martin J. Wainwright

In this paper, we consider the mismatched rate-distortion problem, in which the encoding is done using a codebook, and the encoder chooses the minimum-distortion codeword according to a mismatched distortion function that differs from the…

Information Theory · Computer Science 2022-12-20 Millen Kanabar , Jonathan Scarlett

We introduce a universal quantization scheme based on random coding, and we analyze its performance. This scheme consists of a source-independent random codebook (typically_mismatched_ to the source distribution), followed by optimal…

Information Theory · Computer Science 2007-07-13 Ioannis Kontoyiannis , Rami Zamir

The construction of a channel code by using a source code with decoder side information is introduced. For the construction, any pair of encoder and decoder is available for a source code with decoder side information. A…

Information Theory · Computer Science 2017-04-18 Jun Muramatsu , Shigeki Miyake

The information spectrum approach gives general formulae for optimal rates of various information theoretic protocols, under minimal assumptions on the nature of the sources, channels and entanglement resources involved. This paper…

Quantum Physics · Physics 2007-05-23 Garry Bowen , Nilanjana Datta

Error-correcting codes and related combinatorial constructs play an important role in several recent (and old) results in computational complexity theory. In this paper we survey results on locally-testable and locally-decodable…

Computational Complexity · Computer Science 2007-07-13 Luca Trevisan

We consider the problem of joint source and channel coding of structured data such as natural language over a noisy channel. The typical approach to this problem in both theory and practice involves performing source coding to first…

Information Theory · Computer Science 2018-02-21 Nariman Farsad , Milind Rao , Andrea Goldsmith

The statistical distribution, when determined from an incomplete set of constraints, is shown to be suitable as host for encrypted information. We design an encoding/decoding scheme to embed such a distribution with hidden information. The…

Statistical Mechanics · Physics 2015-06-25 L. Rebollo-Neira , A Plastino

We introduce and analyze a discrete soft-decision channel called the linear reliability channel (LRC) in which the soft information is the rank ordering of the received symbol reliabilities. We prove that the LRC is an appropriate…

Information Theory · Computer Science 2025-09-11 Alexander Mariona , Ken R. Duffy , Muriel Médard

This paper studies a Shannon-theoretic version of the generalized distribution preserving quantization problem where a stationary and memoryless source is encoded subject to a distortion constraint and the additional requirement that the…

Information Theory · Computer Science 2015-07-10 Naci Saldi , Tamás Linder , Serdar Yüksel

We consider a distributed source coding system in which several observations are communicated to the decoder using limited transmission rate. The observations must be separately coded. We introduce a robust distributed coding scheme which…

Information Theory · Computer Science 2007-07-13 Jun Chen , Toby Berger

This paper investigates a unification of distributed source coding, multiple description coding, and source coding with side information at decoders. The equivalence between the multiple-decoder extension of distributed source coding with…

Information Theory · Computer Science 2024-10-28 Jun Muramatsu

The source-coding problem with side information at the decoder is studied subject to a constraint that the encoder---to whom the side information is unavailable---be able to compute the decoder's reconstruction sequence to within some…

Information Theory · Computer Science 2016-11-15 Amos Lapidoth , Andreas Malär , Michèle Wigger

Locally decodable channel codes form a special class of error-correcting codes with the property that the decoder is able to reconstruct any bit of the input message from querying only a few bits of a noisy codeword. It is well known that…

Information Theory · Computer Science 2013-08-28 Ali Makhdoumi , Shao-Lun Huang , Muriel Medard , Yury Polyanskiy

A randomized covering-packing duality between source and channel coding will be discussed by considering the source coding problem of coding a source with a certain distortion level and by considering a channel which communicates the source…

Information Theory · Computer Science 2015-05-25 Mukul Agarwal , Sanjoy MItter

We investigate two source coding problems with secrecy constraints. In the first problem we consider real--time fully secure transmission of a memoryless source. We show that although classical variable--rate coding is not an option since…

Information Theory · Computer Science 2012-05-16 Yonatan Kaspi , Neri Merhav

In addition to a proposed codeword, error correction decoders that provide blockwise soft output (SO) return an estimate of the likelihood that the decoding is correct. Following Forney, such estimates are traditionally only possible for…

Information Theory · Computer Science 2025-03-24 Jiewei Feng , Ken R. Duffy , Muriel Médard

We establish that it is possible to extract accurate blockwise and bitwise soft output from Guessing Codeword Decoding with minimal additional computational complexity by considering it as a variant of Guessing Random Additive Noise…

Information Theory · Computer Science 2025-12-18 Ken R. Duffy , Peihong Yuan , Joseph Griffin , Muriel Medard

The secrecy performance of a source-channel model is studied in the context of lossy source compression over a noisy broadcast channel. The source is causally revealed to the eavesdropper during decoding. The fidelity of the transmission to…

Information Theory · Computer Science 2015-06-24 Eva C. Song , Paul Cuff , H. Vincent Poor