English
Related papers

Related papers: Universal decoding using a noisy codebook

200 papers

A single input multiple output (SIMO) multiple access channel, with a large number of transmitters sending symbols from a constellation to the receiver of a multi-antenna base station, is considered. The fundamental limits of joint decoding…

Information Theory · Computer Science 2014-04-10 Mainak Chowdhury , Andrea Goldsmith

We consider the decoding of bit interleaved coded modulation (BICM) applied to multiband OFDM for practical scenarios where only a noisy (possibly very bad) estimate of the channel is available at the receiver. First, a decoding metric…

Networking and Internet Architecture · Computer Science 2007-08-13 Sajad Sadough , Pablo Piantanida , Pierre Duhamel

We consider universal variable-to-fixed length compression of memoryless sources with a fidelity criterion. We design a dictionary codebook over the reproduction alphabet which is used to parse the source stream. Once a source subsequence…

Information Theory · Computer Science 2022-11-24 Nematollah Iri

This paper studies optimization of zero-delay source-channel codes, and specifically the problem of obtaining globally optimal transformations that map between the source space and the channel space, under a given transmission power…

Information Theory · Computer Science 2013-04-26 Mustafa S. Mehmetoglu , Emrah Akyol , Kenneth Rose

We consider the quantum decoding problem. It consists in recovering a codeword given a superposition of noisy versions of this codeword. By measuring the superposition, we get back to the classical decoding problem. It appears for the first…

Quantum Physics · Physics 2026-02-05 Agathe Blanvillain , André Chailloux , Jean-Pierre Tillich

This paper studies multiuser random coding techniques for channel coding with a given (possibly suboptimal) decoding rule. For the mismatched discrete memoryless multiple-access channel, an error exponent is obtained that is tight with…

Information Theory · Computer Science 2016-11-18 Jonathan Scarlett , Alfonso Martinez , Albert Guillén i Fàbregas

In this paper, we consider the outer channel for DNA-based data storage. When transmitting over the outer channel, each DNA string is treated as a unit/symbol that would be either correctly received, or erased, or corrupted by uniformly…

Information Theory · Computer Science 2025-09-23 Xuan He , Yi Ding , Kui Cai , Guanghui Song , Bin Dai , Xiaohu Tang

A multiterminal lossy coding problem, which includes various problems such as the Wyner-Ziv problem and the complementary delivery problem as special cases, is considered. It is shown that any point in the achievable rate-distortion region…

Information Theory · Computer Science 2010-04-20 Shigeaki Kuzuoka , Akisato Kimura , Tomohiko Uyematsu

We consider a point-to-point communication system, where in addition to the encoder and the decoder, there is a helper that observes non-causally the realization of the noise vector and provides a (lossy) rate-$R_{\mbox{\tiny h}}$…

Information Theory · Computer Science 2020-11-23 Neri Merhav

We consider the Additive White Gaussian Noise channel with Binary Phase Shift Keying modulation. Our aim is to enable an algebraic hard decision Bounded Minimum Distance decoder for a binary block code to exploit soft information obtained…

Information Theory · Computer Science 2009-05-18 Christian Senger , Vladimir Sidorenko , Victor Zyablov

We examine the coordinated and universal rate-efficient sampling of a subset of correlated discrete memoryless sources followed by lossy compression of the sampled sources. The goal is to reconstruct a predesignated subset of sources within…

Information Theory · Computer Science 2017-06-23 Vinay Praneeth Boda , Prakash Narayan

Coding and testing schemes for binary hypothesis testing over noisy networks are proposed and their corresponding type-II error exponents are derived. When communication is over a discrete memoryless channel (DMC), our scheme combines…

Information Theory · Computer Science 2018-06-15 Sadaf Salehkalaibar , Michele Wigger

We study error correction type protocols in which a quantum channel encodes logical information into an enlarged Hilbert space. Specifically, we consider channels realized by one dimensional random noisy quantum circuits with spatially…

Quantum Physics · Physics 2026-03-24 Arman Sauliere , Guglielmo Lami , Pedro Ribeiro , Andrea De Luca , Jacopo De Nardis

Using a mild variant of polar codes we design linear compression schemes compressing Hidden Markov sources (where the source is a Markov chain, but whose state is not necessarily observable from its output), and to decode from Hidden Markov…

Information Theory · Computer Science 2018-10-05 Venkatesan Guruswami , Preetum Nakkiran , Madhu Sudan

A lossy source code $\mathcal{C}$ with rate $R$ for a discrete memoryless source $S$ is called subset-universal if for every $0<R'< R$, almost every subset of $2^{nR'}$ of its codewords achieves average distortion close to the source's…

Information Theory · Computer Science 2015-03-13 Or Ordentlich , Ofer Shayevitz

The most common decision criteria for decoding are maximum likelihood decoding and nearest neighbor decoding. It is well-known that maximum likelihood decoding coincides with nearest neighbor decoding with respect to the Hamming metric on…

Information Theory · Computer Science 2015-06-12 Marcelo Firer , Judy L. Walker

To ensure large language models (LLMs) are used safely, one must reduce their propensity to hallucinate or to generate unacceptable answers. A simple and often used strategy is to first let the LLM generate multiple hypotheses and then…

Computation and Language · Computer Science 2025-02-12 António Farinhas , Haau-Sing Li , André F. T. Martins

We consider the problem of erasure/list decoding using certain classes of simplified decoders. Specifically, we assume a class of erasure/list decoders, such that a codeword is in the list if its likelihood is larger than a threshold. This…

Information Theory · Computer Science 2016-11-17 Nir Weinberger , Neri Merhav

Consider a binary additive noise channel with noiseless feedback. When the noise is a stationary and ergodic process $\mathbf{Z}$, the capacity is $1-\mathbb{H}(\mathbf{Z})$ ($\mathbb{H}(\cdot)$ denoting the entropy rate). It is shown…

Information Theory · Computer Science 2012-06-01 Vinith Misra , Tsachy Weissman

Given a default distribution $P$ and a set of test data $x^M=\{x_1,x_2,\ldots,x_M\}$ this paper seeks to answer the question if it was likely that $x^M$ was generated by $P$. For discrete distributions, the definitive answer is in principle…

Information Theory · Computer Science 2024-04-29 Mojtaba Abolfazli , Mohammad Zaeri Amirani , Anders Høst-Madsen , June Zhang , Andras Bratincsak