English
Related papers

Related papers: On the Computation of the Gaussian Rate-Distortion…

200 papers

This paper studies the performance of sparse regression codes for lossy compression with the squared-error distortion criterion. In a sparse regression code, codewords are linear combinations of subsets of columns of a design matrix. It is…

Information Theory · Computer Science 2017-07-17 Ramji Venkataramanan , Sekhar Tatikonda

We revisit the sequential rate-distortion (SRD) trade-off problem for vector-valued Gauss-Markov sources with mean-squared error distortion constraints. We show via a counterexample that the dynamic reverse water-filling algorithm suggested…

Optimization and Control · Mathematics 2017-11-28 Photios A. Stavrou , Takashi Tanaka , Sekhar Tatikonda

Rate-distortion optimization (RDO) of codecs, where distortion is quantified by the mean-square error, has been a standard practice in image/video compression over the years. RDO serves well for optimization of codec performance for…

Image and Video Processing · Electrical Eng. & Systems 2021-05-03 Ogun Kirmemis , A. Murat Tekalp

In this paper, the rate-distortion theory of the Gray-Wyner lossy source coding system is investigated. For the case of jointly Gaussian distributed sources, we establish an expression for the rate-distortion function under the constraint…

Information Theory · Computer Science 2023-03-29 Guojun Chen , Yinfei Xu , Ling Liu , Tiecheng Song , Jing Hu

In this paper we consider the rate distortion problem of discrete-time, ergodic, and stationary sources with feed forward at the receiver. We derive a sequence of achievable and computable rates that converge to the feed-forward rate…

Information Theory · Computer Science 2011-06-07 Iddo Naiss , Haim Permuter

We derive a simple general parametric representation of the rate-distortion function of a memoryless source, where both the rate and the distortion are given by integrals whose integrands include the minimum mean square error (MMSE) of the…

Information Theory · Computer Science 2010-04-30 Neri Merhav

Sequential rate-distortion (SRD) theory provides a framework for studying the fundamental trade-off between data-rate and data-quality in real-time communication systems. In this paper, we consider the SRD problem for multi-dimensional…

Optimization and Control · Mathematics 2018-01-16 Takashi Tanaka , Kwang-Ki K. Kim , Pablo A. Parrilo , Sanjoy K. Mitter

In this paper, we develop {finite-time horizon} causal filters using the nonanticipative rate distortion theory. We apply the {developed} theory to {design optimal filters for} time-varying multidimensional Gauss-Markov processes, subject…

Information Theory · Computer Science 2017-02-13 Photios A. Stavrou , Themistoklis Charalambous , Charalambos D. Charalambous , Sergey Loyka

We revisit the Gray-Wyner lossy source coding problem and derive the first-order asymptotic optimal rate-distortion-perception region when additional perception constraints are imposed on reproduced source sequences. The optimal trade-off…

Information Theory · Computer Science 2026-01-19 Yu Yang , Yingxin Zhang , Weijie Yuan , Lin Zhou

The rate-distortion-perception (RDP) tradeoff characterizes the fundamental limits of lossy compression by jointly considering bitrate, reconstruction fidelity, and perceptual quality. While recent neural compression methods have improved…

Information Theory · Computer Science 2026-05-25 Yuhan Wang , Suzhi Bi , Ying-Jun Angela Zhang

Quantifying the difference between probability distributions is crucial in machine learning. However, estimating statistical divergences from empirical samples is challenging due to unknown underlying distributions. This work proposes the…

Machine Learning · Computer Science 2024-10-25 Jhoan K. Hoyos-Osorio , Luis G. Sanchez-Giraldo

We study the rate-distortion function (RDF) for the lossy compression of discrete-time (DT) wide-sense almost cyclostationary (WSACS) Gaussian processes with memory, arising from sampling continuous-time (CT) wide-sense cyclostationary…

Information Theory · Computer Science 2025-07-02 Zikun Tan , Ron Dabora , H. Vincent Poor

Despite their output being ultimately consumed by human viewers, 3D Gaussian Splatting (3DGS) methods often rely on ad-hoc combinations of pixel-level losses, resulting in blurry renderings. To address this, we systematically explore…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Ezgi Ozyilkan , Zhiqi Chen , Oren Rippel , Jona Ballé , Kedar Tatwawadi

For a Gaussian source under mean-squared error (MSE), classical transform coding is rate--distortion (RD) optimal: the Karhunen--Loeve transform (KLT) diagonalizes the covariance, reverse waterfilling allocates the bits, and scalar…

Information Theory · Computer Science 2026-05-18 Bumsu Park , Chanho Park , Youngmok Park , Namyoon Lee

Diffusion probabilistic models (DPMs) are widely adopted for their outstanding generative fidelity, yet their sampling is computationally demanding. Polynomial-based multistep samplers mitigate this cost by accelerating inference; however,…

Machine Learning · Computer Science 2026-03-17 Soochul Park , Yeon Ju Lee , SeongJin Yoon , Jiyub Shin , Juhee Lee , Seongwoon Jo

The objective of this paper is to further investigate various applications of information Nonanticipative Rate Distortion Function (NRDF) by discussing two working examples, the Binary Symmetric Markov Source with parameter $p$ (BSMS($p$))…

Information Theory · Computer Science 2014-04-30 Photios A. Stavrou , Christos K. Kourtellaris , Charalambos D. Charalambous

Recent advances in Rate-Distortion-Perception (RDP) theory highlight the importance of balancing compression level, reconstruction quality, and perceptual fidelity. While previous work has explored numerical approaches to approximate the…

Information Theory · Computer Science 2025-08-20 Chunhui Chen , Linyi Chen , Xueyan Niu , Hao Wu

In this paper, we propose a novel function named Rate Distortion-in-Distortion (RDD) function as an extension of the classical rate-distortion (RD) function, where the expected distortion constraint is replaced by a Gromov-type distortion.…

Information Theory · Computer Science 2025-07-25 Lingyi Chen , Haoran Tang , Shitong Wu , Jiakun Liu , Huihui Wu , Wenyi Zhang , Hao Wu

This paper investigates the rate-distortion function, under a squared error distortion $D$, for an $n$-dimensional random vector uniformly distributed on an $(n-1)$-sphere of radius $R$. First, an expression for the rate-distortion function…

Information Theory · Computer Science 2024-01-10 Alex Dytso , Martina Cardone

In this paper we invoke a nonanticipative information Rate Distortion Function (RDF) for sources with memory, and we analyze its importance in probabilistic matching of the source to the channel so that transmission of a symbol-by-symbol…

Information Theory · Computer Science 2013-04-26 Christos Kourtellaris , Charalambos D. Charalambous , Photios A. Stavrou