English
Related papers

Related papers: Zero-Delay Rate Distortion via Filtering for Vecto…

200 papers

The relation between rate distortion function (RDF) and Bayesian filtering theory is discussed. The relation is established by imposing a causal or realizability constraint on the reconstruction conditional distribution of the RDF, leading…

Information Theory · Computer Science 2012-04-16 Photios A. Stavrou , Charalambos D. Charalambous , Christos K. Kourtellaris

Common state-of-the-art video codecs are optimized to deliver a low bitrate by providing a certain quality for the final human observer, which is achieved by rate-distortion optimization (RDO). But, with the steady improvement of neural…

Image and Video Processing · Electrical Eng. & Systems 2022-03-14 Kristian Fischer , Fabian Brand , Christian Herglotz , André Kaup

Efficient low-delay video encoders are of fundamental importance to provide timely feedback in remotely controlled platforms such as drones. In order to fully understand the theoretical limits of low-delay video encoders, we consider an…

Information Theory · Computer Science 2018-11-16 Giuseppe Cocco , Laura Toni

Many images and videos are primarily processed by computer vision algorithms, involving only occasional human inspection. When this content requires compression before processing, e.g., in distributed applications, coding methods must…

Image and Video Processing · Electrical Eng. & Systems 2025-08-27 Samuel Fernández-Menduiña , Eduardo Pavez , Antonio Ortega

The Gauss-Markov source produces $U_i = aU_{i-1} + Z_i$ for $i\geq 1$, where $U_0 = 0$, $|a|<1$ and $Z_i\sim\mathcal{N}(0, \sigma^2)$ are i.i.d. Gaussian random variables. We consider lossy compression of a block of $n$ samples of the…

Information Theory · Computer Science 2019-09-26 Peida Tian , Victoria Kostina

In this paper, communication of a Multivariate Gaussian over a Gaussian Multiple Access Channel is studied. Distributed zero-delay joint source-channel coding (JSCC) solutions to the problem are given. Both nonlinear and linear approaches…

Information Theory · Computer Science 2014-01-14 Pål Anders Floor , Anna N. Kim , Tor A. Ramstad , Ilangko Balasingham , Niklas Wernersson , Mikael Skoglund

This paper focuses on the structural properties of test channels, of Wyner's operational information rate distortion function (RDF), $\overline{R}(\Delta_X)$, of a tuple of multivariate correlated, jointly independent and identically…

Information Theory · Computer Science 2020-11-24 Michail Gkagkos , Charalambos D. Charalambous

In this paper we introduce a definition for nonanticipative Rate Distortion Function (RDF) on abstract alphabets, and we invoke weak convergence of probability measures to show various of its properties, such as, existence of the optimal…

Information Theory · Computer Science 2013-01-29 Photios A. Stavrou , Charalambos D. Charalambous , Christos K. Kourtellaris

The relation between nonanticipative Rate Distortion Function (RDF) and filtering theory is discussed on abstract spaces. The relation is established by imposing a realizability constraint on the reconstruction conditional distribution of…

Information Theory · Computer Science 2016-11-15 Charalambos D. Charalambous , Photios A. Stavrou , Nasir U. Ahmed

We consider the variable-to-fixed length lossy source coding (VFSC) problem. The optimal compression rate of the average length of variable-to-fixed source coding, allowing a non-vanishing probability of excess-distortion $\varepsilon$, is…

Information Theory · Computer Science 2018-03-20 Lan V. Truong , Vincent Y. F. Tan

We present a new method to estimate the rate-distortion-perception function in the perfect realism regime (PR-RDPF), for multivariate continuous sources subject to a single-letter average distortion constraint. The proposed approach is not…

Information Theory · Computer Science 2024-01-31 Giuseppe Serra , Photios A. Stavrou , Marios Kountouris

We propose an approach to lossy source coding, utilizing ideas from Gibbs sampling, simulated annealing, and Markov Chain Monte Carlo (MCMC). The idea is to sample a reconstruction sequence from a Boltzmann distribution associated with an…

Information Theory · Computer Science 2016-11-17 Shirin Jalali , Tsachy Weissman

An effective 'on-the-fly' mechanism for stochastic lossy coding of Markov sources using string matching techniques is proposed in this paper. Earlier work has shown that the rate-distortion bound can be asymptotically achieved by a 'natural…

Information Theory · Computer Science 2023-01-18 Ahmed Elshafiy , Kenneth Rose

We study the problem of zero-delay coding for the transmission of a Markov source over a noisy channel with feedback and present a reinforcement learning solution which is guaranteed to achieve near-optimality. To this end, we formulate the…

Optimization and Control · Mathematics 2025-10-07 Liam Cregg , Fady Alajaji , Serdar Yuksel

Rate-distortion formulation is the information-theoretic approach to the study of signal encoding systems. Since a more general approach to model the nonstationarity exhibited by real-world signals is to use appropriately fitted time…

Information Theory · Computer Science 2019-11-01 Jia-Chyi Wu

In this work we study the rate-distortion function (RDF) for lossy compression of asynchronously-sampled continuous-time (CT) wide-sense cyclostationary (WSCS) Gaussian processes with memory. As the case of synchronous sampling, i.e., when…

Information Theory · Computer Science 2024-05-27 Zikun Tan , Ron Dabora , H. Vincent Poor

In this paper the relation between nonanticipative rate distortion function (RDF) and Bayesian filtering theory is investigated using the topology of weak convergence of probability measures on Polish spaces. The relation is established via…

Information Theory · Computer Science 2013-04-29 Charalambos D. Charalambous , Photios A. Stavrou

We present a novel systematic theoretical framework to analyze the rate-distortion (R-D) limits of learned image compression. While recent neural codecs have achieved remarkable empirical results, their distance from the…

Information Theory · Computer Science 2026-01-15 Changshuo Wang , Zijian Liang , Kai Niu , Ping Zhang

Zero-delay transmission of a Gaussian source over an additive white Gaussian noise (AWGN) channel is considered in the presence of an additive Gaussian interference signal. The mean squared error (MSE) distortion is minimized under an…

Information Theory · Computer Science 2016-04-15 Morteza Varasteh , Deniz Gündüz , Ertem Tuncel

We investigate the optimal performance of dense sensor networks by studying the joint source-channel coding problem. The overall goal of the sensor network is to take measurements from an underlying random process, code and transmit those…

Information Theory · Computer Science 2007-07-13 Nan Liu , Sennur Ulukus