English
Related papers

Related papers: Information Nonanticipative Rate Distortion Functi…

200 papers

Perception-aware lossy source coding has attracted significant recent interest. It augments the classical distortion criterion with an explicit perception constraint, thereby enabling more refined control over fidelity and perceptual…

Information Theory · Computer Science 2026-04-22 Ali Hussein , Jun Chen , Chao Tian , S. Sandeep Pradhan

In this paper, we introduce new lower bounds on the distortion of scalar fixed-rate codes for lossy compression with side information available at the receiver. These bounds are derived by presenting the relevant random variables as a…

Information Theory · Computer Science 2014-11-18 Avraham Reani , Neri Merhav

The main purpose of this note is to show that in a realization $(x_{1}^{n}, y_{1}^{n})$ of the causal \textit{information rate-distortion function} (IRDF) for a $\kappa$-th order Markovian source $x_{1}^{n}$, under a single letter sum…

Information Theory · Computer Science 2018-09-18 Milan S. Derpich

A computable expression for the rate-distortion (RD) function proposed by Heegard and Berger has eluded information theory for nearly three decades. Heegard and Berger's single-letter achievability bound is well known to be optimal for…

Information Theory · Computer Science 2012-12-12 Roy Timo , Tobias J. Oechtering , Michèle Wigger

In this monograph, we review recent advances in second-order asymptotics for lossy source coding, which provides approximations to the finite blocklength performance of optimal codes. The monograph is divided into three parts. In part I, we…

Information Theory · Computer Science 2024-10-25 Lin Zhou , Mehul Motani

New bounds on the rate distortion function of certain non-Gaussian sources, with a proportional-weighted mean-square error (MSE) distortion measure, are given. The growth, g, of the rate distortion function, as a result of changing from a…

Information Theory · Computer Science 2007-07-13 Jacob Binia

This paper proposes robust nonlinear transform coding (Robust-NTC), a generalizable digital joint source-channel coding (JSCC) framework that couples variational latent modeling with channel-adaptive transmission. Unlike learning-based JSCC…

Signal Processing · Electrical Eng. & Systems 2026-04-24 Jihun Park , Junyong Shin , Jinsung Park , Yo-Seb Jeon

In the rate-distortion function and the Maximum Entropy (ME) method, Minimum Mutual In-formation (MMI) distributions and ME distributions are expressed by Bayes-like formulas, in-cluding Negative Exponential Functions (NEFs) and partition…

Information Theory · Computer Science 2021-10-18 Chenguang Lu

Common state-of-the-art video codecs are optimized to deliver a low bitrate by providing a certain quality for the final human observer, which is achieved by rate-distortion optimization (RDO). But, with the steady improvement of neural…

Image and Video Processing · Electrical Eng. & Systems 2022-03-14 Kristian Fischer , Fabian Brand , Christian Herglotz , André Kaup

This paper considers lossy source coding of $n$-dimensional memoryless sources and shows an explicit approximation to the minimum source coding rate required to sustain the probability of exceeding distortion $d$ no greater than $\epsilon$,…

Information Theory · Computer Science 2017-02-28 Victoria Kostina

This paper characterizes the second-order coding rates for lossy source coding with side information available at both the encoder and the decoder. We first provide non-asymptotic bounds for this problem and then specialize the…

Information Theory · Computer Science 2014-10-13 Sy-Quoc Le , Vincent Y. F. Tan , Mehul Motani

We formulate quantum rate-distortion theory in the most general setting where classical side information is included in the tradeoff. Using a natural distortion measure based on entanglement fidelity and specializing to the case of an…

Quantum Physics · Physics 2009-09-25 Igor Devetak , Toby Berger

Following a previous paper [Y. Shi, Phys. Rev. C 98, 014329(2018)], we present an extension of the density-functional theory to allow for dynamic calculations based on the obtained static Hartree-Fock results. We perform extensive benchmark…

Nuclear Theory · Physics 2020-11-04 Yue Shi , Nobuo Hinohara , Bastian Schuetrumpf

This paper derives an achievable rate-distortion (R-D) region for the state-dependent discrete memoryless multiple access channel (SD-DMMAC), where the generalized feedback and causal side information are present at encoders, and the…

Information Theory · Computer Science 2024-09-27 Xinyang Li , Vlad C. Andrei , Ullrich J. Mönich , Holger Boche

Direct evaluation of the rate-distortion function has rarely been achieved when it is strictly greater than its Shannon lower bound. In this paper, we consider the rate-distortion function for the distortion measure defined by an…

Information Theory · Computer Science 2013-02-27 Kazuho Watanabe

This paper considers the problem of source coding with side information at the decoder, also called Slepian-Wolf source coding scheme. In practical applications of this coding scheme, the statistical relation between the source and the side…

Information Theory · Computer Science 2018-08-21 Fangping Ye , Elsa Dupraz , Zeina Mheich , Karine Amis

We derive quantum counterparts of two key theorems of classical information theory, namely, the rate distortion theorem and the source-channel separation theorem. The rate-distortion theorem gives the ultimate limits on lossy data…

Quantum Physics · Physics 2012-12-21 Nilanjana Datta , Min-Hsiu Hsieh , Mark M. Wilde

In this paper, random coding error exponents and cutoff rate are studied for noncoherent Rician fading channels, where neither the receiver nor the transmitter has channel side information. First, it is assumed that the input is subject…

Information Theory · Computer Science 2016-11-18 Mustafa Cenk Gursoy

We present a new deep-neural-network (DNN) based error correction code for fading channels with output feedback, called deep SNR-robust feedback (DRF) code. At the encoder, parity symbols are generated by a long short term memory (LSTM)…

Information Theory · Computer Science 2021-12-23 Mahdi Boloursaz Mashhadi , Deniz Gunduz , Alberto Perotti , Branislav Popovic

One popular approach to soft-decision decoding of Reed-Solomon (RS) codes is based on using multiple trials of a simple RS decoding algorithm in combination with erasing or flipping a set of symbols or bits in each trial. This paper…

Information Theory · Computer Science 2015-03-17 Phong S. Nguyen , Henry D. Pfister , Krishna R. Narayanan