English
Related papers

Related papers: Single-Letter Characterization of the Mismatched D…

200 papers

We consider the semantic rate-distortion problem motivated by task-oriented video compression. The semantic information corresponding to the task, which is not observable to the encoder, shows impacts on the observations through a joint…

Information Theory · Computer Science 2022-08-15 Tao Guo , Yizhu Wang , Jie Han , Huihui Wu , Bo Bai , Wei Han

This paper investigates a source coding problem in which two terminals communicating through a relay wish to estimate one another's source within some distortion constraint. The relay has access to side information that is correlated with…

Information Theory · Computer Science 2013-10-10 Farideh Ebrahim Rezagah , Elza Erkip

We propose a distributed algorithm based on Alternating Direction Method of Multipliers (ADMM) to minimize the sum of locally known convex functions using communication over a network. This optimization problem emerges in many applications…

Optimization and Control · Mathematics 2016-01-05 Ali Makhdoumi , Asuman Ozdaglar

The error exponent of fixed-length lossy source coding was established by Marton. Ahlswede showed that this exponent can be discontinuous at a rate $R$, depending on the probability distribution $P$ of the given information source and the…

Information Theory · Computer Science 2023-04-25 Yutaka Jitsumatsu

In this paper, we present iterative algorithms that numerically compute the rate-distortion regions of two problems: the two-encoder multiterminal source coding problem and the Chief Executive Officer (CEO) problem, both under logarithmic…

Information Theory · Computer Science 2017-08-25 Yigit Ugur , Inaki Estella Aguerri , Abdellatif Zaidi

We examine the structure of families of distortion balls from the perspective of Kolmogorov complexity. Special attention is paid to the canonical rate-distortion function of a source word which returns the minimal Kolmogorov complexity of…

Information Theory · Computer Science 2009-11-26 Nikolai K. Vereshchagin , Paul M. B. Vitanyi

A receiver wants to compute a function of two correlated sources separately observed by two transmitters. One of the transmitters may send a possibly private message to the other transmitter in a cooperation phase before both transmitters…

Information Theory · Computer Science 2015-04-08 Milad Sefidgaran , Aslan Tchamkerten

This paper revisits the rate-distortion theory from the perspective of optimal weak transport, as recently introduced by Gozlan et al. While the conditions for optimality and the existence of solutions are well-understood in the case of…

Information Theory · Computer Science 2025-01-27 Jiayang Zou , Luyao Fan , Jiayang Gao , Jia Wang

A Causal rate distortion function with a general fidelity criterion is formulated on abstract alphabets and the optimal reconstruction kernel is derived, which consists of a product of causal kernels. In the process, general abstract spaces…

Information Theory · Computer Science 2011-02-17 Charalambos D. Charalambous , Photios A. Stavrou , Christos K. Kourtellaris

We define a graph-based rate optimization problem and consider its computation, which provides a unified approach to the computation of various theoretical limits, including the (conditional) graph entropy, rate-distortion functions and…

Information Theory · Computer Science 2025-03-18 Deheng Yuan , Tao Guo , Zhongyi Huang , Shi Jin

This work continues the study of linear error correcting codes against adversarial insertion deletion errors (insdel errors). Previously, the work of Cheng, Guruswami, Haeupler, and Li \cite{CGHL21} showed the existence of asymptotically…

Information Theory · Computer Science 2023-03-31 Kuan Cheng , Zhengzhong Jin , Xin Li , Zhide Wei , Yu Zheng

One popular approach to soft-decision decoding of Reed-Solomon (RS) codes is based on using multiple trials of a simple RS decoding algorithm in combination with erasing or flipping a set of symbols or bits in each trial. This paper…

Information Theory · Computer Science 2015-03-17 Phong S. Nguyen , Henry D. Pfister , Krishna R. Narayanan

A secrecy system with side information at the decoders is studied in the context of lossy source compression over a noiseless broadcast channel. The decoders have access to different side information sequences that are correlated with the…

Information Theory · Computer Science 2014-10-07 Eva C. Song , Paul Cuff , H. Vincent Poor

In this paper, we consider a distributed remote source coding problem, where a sequence of observations of source vectors is available at the encoder. The problem is to specify the optimal rate for encoding the observations subject to a…

Information Theory · Computer Science 2014-06-05 Adel Zahedi , Jan Ostergaard , Soren Holdt Jensen , Patrick Naylor , Soren Bech

Consider a discrete memoryless multiple source with $m$ components of which $k \leq m$ possibly different sources are sampled at each time instant and jointly compressed in order to reconstruct all the $m$ sources under a given distortion…

Information Theory · Computer Science 2016-07-15 Vinay Praneeth Boda , Prakash Narayan

In this paper we analyze the joint rate distortion function (RDF), for a tuple of correlated sources taking values in abstract alphabet spaces (i.e., continuous) subject to two individual distortion criteria. First, we derive structural…

Information Theory · Computer Science 2021-05-11 Evagoras Stylianou , Charalambos D. Charalambous , Themistoklis Charalambous

In the distributed coding of correlated sources, the problem of characterizing the joint probability distribution of a pair of random variables satisfying an n-letter Markov chain arises. The exact solution of this problem is intractable.…

Information Theory · Computer Science 2016-11-18 W. Kang , S. Ulukus

Motivated by questions in lossy data compression and by theoretical considerations, we examine the problem of estimating the rate-distortion function of an unknown (not necessarily discrete-valued) source from empirical data. Our focus is…

Information Theory · Computer Science 2013-01-18 M. T. Harrison , I. Kontoyiannis

In the classical source coding problem, the compressed source is reconstructed at the decoder with respect to some distortion metric. Motivated by settings in which we are interested in more than simply reconstructing the compressed source,…

Information Theory · Computer Science 2023-10-03 Oğuzhan Kubilay Ülger , Elza Erkip

This paper studies the rate-distortion-perception (RDP) tradeoff for a memoryless source model in the asymptotic limit of large block-lengths. The perception measure is based on a divergence between the distributions of the source and…

Information Theory · Computer Science 2025-04-29 Sadaf Salehkalaibar , Jun Chen , Ashish Khisti , Wei Yu
‹ Prev 1 4 5 6 7 8 10 Next ›