English
Related papers

Related papers: Tight Exponential Strong Converse for Source Codin…

200 papers

We evaluate the asymptotics of equivocations, their exponents as well as their second-order coding rates under various R\'{e}nyi information measures. Specifically, we consider the effect of applying a hash function on a source and we…

Information Theory · Computer Science 2016-07-06 Masahito Hayashi , Vincent Y. F. Tan

The output of a discrete Markov source is to be encoded instantaneously by a variable-rate encoder and decoded by a finite-state decoder. Our performance measure is a linear combination of the distortion and the instantaneous rate.…

Information Theory · Computer Science 2011-08-16 Yonatan Kaspi , Neri Merhav

Stochastic Approximation (SA) is a popular approach for solving fixed-point equations where the information is corrupted by noise. In this paper, we consider an SA involving a contraction mapping with respect to an arbitrary norm, and show…

Machine Learning · Computer Science 2021-07-01 Zaiwei Chen , Siva Theja Maguluri , Sanjay Shakkottai , Karthikeyan Shanmugam

We present a new inner bound for the rate region of the $t$-stage successive-refinement problem with side-information. We also present a new upper bound for the rate-distortion function for lossy-source coding with multiple decoders and…

Information Theory · Computer Science 2016-11-17 Roy Timo , Terence Chan , Alexander Grant

We study a semantic communication problem with a privacy constraint where an encoder consists of two separate parts, e.g., encoder 1 and encoder 2. The first encoder has access to information source $X=(X_1,\ldots,X_N)$ which is arbitrarily…

Information Theory · Computer Science 2024-12-24 Amirreza Zamani , Mikael Skoglund

A coding theorem and converse are proved for a large class of abstract stationary channels with time structure including the result by Kadota and Wyner (1972) on continuous-time real-valued channels as special cases. As main contribution…

Information Theory · Computer Science 2018-04-18 Martin Mittelbach , Eduard A. Jorswieck

A new framework is introduced for examining and evaluating the fundamental limits of lossless data compression, that emphasizes genuinely non-asymptotic results. The {\em sample complexity} of compressing a given source is defined as the…

Information Theory · Computer Science 2026-04-16 Terence Viaud , Ioannis Kontoyiannis

We pose and investigate the distributed secure source coding based on the common key cryptosystem. This cryptosystem includes the secrecy amplification problem for distributed encrypted sources with correlated keys using…

Information Theory · Computer Science 2022-08-31 Yasutada Oohama , Bagus Santoso

We study relaxations of entanglement-assisted quantum channel coding and establish that non-signaling assistance and a natural semi-definite programming relaxation\, -- \,termed meta-converse\, -- \,are equivalent in terms of success…

Quantum Physics · Physics 2025-10-08 Aadil Oufkir , Mario Berta

This paper considers guessing-based decoders with abandonment for discrete memoryless channels in which all codewords have the same composition. This class of decoders rank-orders all input sequences in the codebook's composition class from…

Information Theory · Computer Science 2025-08-11 Vincent Y. F. Tan , Hamdi Joudeh

The Shannon cipher system is studied in the context of general sources using a notion of computational secrecy introduced by Merhav & Arikan. Bounds are derived on limiting exponents of guessing moments for general sources. The bounds are…

Information Theory · Computer Science 2010-08-12 Manjesh Kumar Hanawal , Rajesh Sundaresan

It is known for many algorithmic problems that if a tree decomposition of width $t$ is given in the input, then the problem can be solved with exponential dependence on $t$. A line of research by Lokshtanov, Marx, and Saurabh [SODA 2011]…

Computational Complexity · Computer Science 2024-02-20 Barış Can Esmer , Jacob Focke , Dániel Marx , Paweł Rzążewski

One-shot achievable rate region for source coding when coded side information is available at the decoder (source coding with a helper) is proposed. The achievable region proposed is in terms of conditional smooth max Renyi entropy and…

Information Theory · Computer Science 2013-03-12 Naqueeb Ahmad Warsi

A strong converse bound for constant composition codes of the form $P_{e}^{(n)} \geq 1- A n^{-0.5(1-E_{sc}'(R,W,p))} e^{-n E_{sc}(R,W,p)}$ is established using the Berry-Esseen theorem through the concepts of Augustin information and…

Information Theory · Computer Science 2020-08-31 Hao-Chung Cheng , Baris Nakiboglu

We introduce an expurgation method for source coding with side information that enables direct dual-domain derivations of expurgated error exponents. Dual-domain methods yield optimization problems over few parameters, with any sub-optimal…

Information Theory · Computer Science 2026-02-25 Mehdi Dabirnia , Hamdi Joudeh , Albert Guillén i Fàbregas

Turbo coding is a powerful class of forward error correcting codes, which can achieve performances close to the Shannon limit. The turbo principle can be applied to the problem of side-information source coding, and we investigate here its…

Information Theory · Computer Science 2007-07-16 Kim-Chi Nguyen , Gilles Van Assche , Nicolas J. Cerf

We propose a method to study the secrecy constraints in key generation problems where side information might be present at untrusted users. Our method is inspired by a recent work of Hayashi and Tan who used the R\'enyi divergence as the…

Information Theory · Computer Science 2020-09-08 Lin Zhou

Integer-forcing source coding has been proposed as a low-complexity method for compression of distributed correlated Gaussian sources. In this scheme, each encoder quantizes its observation using the same fine lattice and reduces the result…

Information Theory · Computer Science 2019-06-05 Elad Domanovitz , Uri Erez

Consensus problems for strings and sequences appear in numerous application contexts, ranging from bioinformatics over data mining to machine learning. Closing some gaps in the literature, we show that several fundamental problems in this…

Discrete Mathematics · Computer Science 2019-04-12 Laurent Bulteau , Vincent Froese , Rolf Niedermeier

A lossy source coding problem is studied in which a source encoder communicates with two decoders, one with and one without correlated side information with an additional constraint on the privacy of the side information at the uninformed…

Information Theory · Computer Science 2011-06-13 Ravi Tandon , Lalitha Sankar , H. Vincent Poor