English
Related papers

Related papers: Information Nonanticipative Rate Distortion Functi…

200 papers

In recent years, numerous data-intensive broadcasting applications have emerged at the wireless edge, calling for a flexible tradeoff between distortion, transmission rate, and processing complexity. While deep learning-based joint…

Information Theory · Computer Science 2026-03-24 Zijun Qin , Jingxuan Huang , Zesong Fei , Haichuan Ding , Yulin Shao , Xianhao Chen

An effective 'on-the-fly' mechanism for stochastic lossy coding of Markov sources using string matching techniques is proposed in this paper. Earlier work has shown that the rate-distortion bound can be asymptotically achieved by a 'natural…

Information Theory · Computer Science 2023-01-18 Ahmed Elshafiy , Kenneth Rose

This paper focuses on the structural properties of test channels, of Wyner's operational information rate distortion function (RDF), $\overline{R}(\Delta_X)$, of a tuple of multivariate correlated, jointly independent and identically…

Information Theory · Computer Science 2020-11-24 Michail Gkagkos , Charalambos D. Charalambous

This paper deals with rate distortion or source coding with fidelity criterion, in measure spaces, for a class of source distributions. The class of source distributions is described by a relative entropy constraint set between the true and…

Information Theory · Computer Science 2013-05-07 Farzad Rezaei , Charalambos D. Charalambous , Photios A. Stavrou

This paper studies the rate-distortion-perception (RDP) tradeoff for a Gaussian vector source coding problem where the goal is to compress the multi-component source subject to distortion and perception constraints. Specifically, the RDP…

Information Theory · Computer Science 2025-03-18 Jingjing Qian , Sadaf Salehkalaibar , Jun Chen , Ashish Khisti , Wei Yu , Wuxian Shi , Yiqun Ge , Wen Tong

Rate-distortion formulation is the information-theoretic approach to the study of signal encoding systems. Since a more general approach to model the nonstationarity exhibited by real-world signals is to use appropriately fitted time…

Information Theory · Computer Science 2019-11-01 Jia-Chyi Wu

The rate-distortion-perception (RDP) tradeoff characterizes the fundamental limits of lossy compression by jointly considering bitrate, reconstruction fidelity, and perceptual quality. While recent neural compression methods have improved…

Information Theory · Computer Science 2026-05-25 Yuhan Wang , Suzhi Bi , Ying-Jun Angela Zhang

A setup involving zero-delay sequential transmission of a vector Markov source over a burst erasure channel is studied. A sequence of source vectors is compressed in a causal fashion at the encoder, and the resulting output is transmitted…

Information Theory · Computer Science 2014-10-10 Farrokh Etezadi , Ashish Khisti , Mitchell Trott

We consider a multiterminal source coding problem in which a source is estimated at a central processing unit from lossy-compressed remote observations. Each lossy-encoded observation is produced by a remote sensor which obtains a noisy…

Information Theory · Computer Science 2016-05-13 Ruiyang Song , Stefano Rini , Alon Kipnis , Andrea J. Goldsmith

Fixed-order perturbative calculations for differential cross sections can suffer from non-physical artifacts: they can be non-positive, non-normalizable, and non-finite, none of which occur in experimental measurements. We propose a…

High Energy Physics - Phenomenology · Physics 2025-12-19 Rikab Gambhir , Radha Mastandrea

In this work we investigate the behavior of the minimal rate needed in order to guarantee a given probability that the distortion exceeds a prescribed threshold, at some fixed finite quantization block length. We show that the excess coding…

Information Theory · Computer Science 2011-02-15 Amir Ingber , Yuval Kochman

Algorithms based on multiple decoding attempts of Reed-Solomon (RS) codes have recently attracted new attention. Choosing decoding candidates based on rate-distortion (R-D) theory, as proposed previously by the authors, currently provides…

Information Theory · Computer Science 2016-11-17 Phong S. Nguyen , Henry D. Pfister , Krishna R. Narayanan

End-to-end image transmission has recently become a crucial trend in intelligent wireless communications, driven by the increasing demand for high bandwidth efficiency. However, existing methods primarily optimize the trade-off between…

Image and Video Processing · Electrical Eng. & Systems 2024-08-27 Kailin Tan , Jincheng Dai , Zhenyu Liu , Sixian Wang , Xiaoqi Qin , Wenjun Xu , Kai Niu , Ping Zhang

We consider transmission of discrete memoryless sources (DMSes) across discrete memoryless channels (DMCs) using variable-length lossy source-channel codes with feedback. The reliability function (optimum error exponent) is shown to be…

Information Theory · Computer Science 2019-04-09 Lan V. Truong , Vincent Y. F. Tan

Analog coding decouples the tasks of protecting against erasures and noise. For erasure correction, it creates an "analog redundancy" by means of band-limited discrete Fourier transform (DFT) interpolation, or more generally, by an…

Information Theory · Computer Science 2016-05-25 Marina Haikin , Ram Zamir

This article focuses on estimating relative transfer functions (RTFs) for beamforming applications. Traditional methods often assume that spectra are uncorrelated, an assumption that is often violated in practical scenarios due to factors…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-18 Giovanni Bologni , Richard C. Hendriks , Richard Heusdens

The state-dependent memoryless channel (SDMC) is employed to model the integrated sensing and communication (ISAC) system, where the transmitter conveys messages to the receiver while simultaneously estimating the state parameter of…

Information Theory · Computer Science 2026-01-14 Lugaoze Feng , Guocheng Lv , Xunan Li , Ye Jin

Many images and videos are primarily processed by computer vision algorithms, involving only occasional human inspection. When this content requires compression before processing, e.g., in distributed applications, coding methods must…

Image and Video Processing · Electrical Eng. & Systems 2025-08-27 Samuel Fernández-Menduiña , Eduardo Pavez , Antonio Ortega

We study the problem of computing the rate-distortion function for sources with feed-forward and the capacity for channels with feedback. The formulas (involving directed information) for the optimal rate-distortion function with…

Information Theory · Computer Science 2007-07-18 Ramji Venkataramanan , S. Sandeep Pradhan

This paper studies a variant of the rate-distortion problem motivated by task-oriented semantic communication and distributed learning systems, where $M$ correlated sources are independently encoded for a central decoder. The decoder has…

Information Theory · Computer Science 2025-01-24 Jiancheng Tang , Qianqian Yang