English
Related papers

Related papers: Generalized Gaussian Multiterminal Source Coding: …

200 papers

We show the existence of variable-rate rate-distortion codes that meet the disortion constraint almost surely and are minimax, i.e., strongly, universal with respect to an unknown source distribution and a distortion measure that is…

Information Theory · Computer Science 2022-11-29 Adeel Mahmood , Aaron B. Wagner

The problem of reconstructing a source sequence with the presence of decoder side-information that is mis-synchronized to the source due to deletions is studied in a distributed source coding framework. Motivated by practical applications,…

Information Theory · Computer Science 2016-11-17 Nan Ma , Kannan Ramchandran , David Tse

Lossy transmission over a relay channel in which the relay has access to correlated side information is considered. First, a joint source-channel decode-and-forward scheme is proposed for general discrete memoryless sources and channels.…

Information Theory · Computer Science 2016-11-17 Deniz Gunduz , Elza Erkip , Andrea J. Goldsmith , H. Vincent Poor

We consider zero-delay single-user and multi-user source coding with average distortion constraint and decoder side information. The zero-delay constraint translates into causal (sequential) encoder and decoder pairs as well as the use of…

Information Theory · Computer Science 2013-01-03 Yonatan Kaspi , Neri Merhav

The problem of joint universal source coding and identification is considered in the setting of fixed-rate lossy coding of continuous-alphabet memoryless sources. For a wide class of bounded distortion measures, it is shown that any…

Information Theory · Computer Science 2007-07-13 Maxim Raginsky

We consider lossy compression of a binary symmetric source by means of a low-density generator-matrix code. We derive two lower bounds on the rate distortion function which are valid for any low-density generator-matrix code with a given…

Information Theory · Computer Science 2008-04-11 Shrinivas Kudekar , Ruediger Urbanke

We propose a scheme that universally achieves the smallest possible compression rate for a class of sources with side information, and develop an application of this result for a joint source channel coding problem over a broadcast channel.

Information Theory · Computer Science 2014-09-30 Min Ye , Alexander Barg

In Sequential Massive Random Access (SMRA), a set of correlated sources is jointly encoded and stored on a server, and clients want to access to only a subset of the sources. Since the number of simultaneous clients can be huge, the server…

Information Theory · Computer Science 2018-01-18 Elsa Dupraz , Thomas Maugey , Aline Roumy , Michel Kieffer

In the context of lossy compression, Blau & Michaeli (2019) adopt a mathematical notion of perceptual quality and define the information rate-distortion-perception function, generalizing the classical rate-distortion tradeoff. We consider…

Information Theory · Computer Science 2021-12-23 George Zhang , Jingjing Qian , Jun Chen , Ashish Khisti

We consider a binary erasure version of the n-channel multiple descriptions problem with symmetric descriptions, i.e., the rates of the n descriptions are the same and the distortion constraint depends only on the number of messages…

Information Theory · Computer Science 2016-11-15 Ebad Ahmed , Aaron B. Wagner

An information theoretic formulation of the distributed averaging problem previously studied in computer science and control is presented. We assume a network with m nodes each observing a WGN source. The nodes communicate and perform local…

Information Theory · Computer Science 2010-03-03 Han-I Su , Abbas El Gamal

We consider a joint source channel coding (JSCC) problem in which we desire to transmit an arbitrary memoryless source over an arbitrary additive channel. We propose a mismatched coding architecture that consists of Gaussian codebooks for…

Information Theory · Computer Science 2018-09-03 Lin Zhou , Vincent Y. F. Tan , Mehul Motani

In this work, we consider a distributed source coding problem with a joint distortion criterion depending on the sources and the reconstruction. This includes as a special case the problem of computing a function of the sources to within…

Information Theory · Computer Science 2008-08-21 Dinesh Krithivasan , S. Sandeep Pradhan

In this paper, we use tools from rate-distortion theory to establish new upper bounds on the generalization error of statistical distributed learning algorithms. Specifically, there are $K$ clients whose individually chosen models are…

Machine Learning · Statistics 2022-11-23 Milad Sefidgaran , Romain Chor , Abdellatif Zaidi

In the classical source coding problem, the compressed source is reconstructed at the decoder with respect to some distortion metric. Motivated by settings in which we are interested in more than simply reconstructing the compressed source,…

Information Theory · Computer Science 2023-10-03 Oğuzhan Kubilay Ülger , Elza Erkip

We consider the problem of lossy source coding with a mismatched distortion measure. That is, we investigate what distortion guarantees can be made with respect to distortion measure $\tilde{\rho}$, for a source code designed such that it…

Information Theory · Computer Science 2008-04-07 Urs Niesen , Devavrat Shah , Gregory Wornell

We determine the rate region of the Gaussian scalar-help-vector source-coding problem under a covariance matrix distortion constraint. The rate region is achieved by a Gaussian achievable scheme. We introduce a novel outer bounding…

Information Theory · Computer Science 2010-01-27 Md Saifur Rahman , Aaron B. Wagner

In this paper we propose a new framework for distributed source coding of structured sources, such as sparse signals. Our framework capitalizes on recent advances in the theory of linear inverse problems and signal representations using…

Information Theory · Computer Science 2020-12-02 Maxim Goukhshtein , Petros T. Boufounos , Toshiaki Koike-Akino , Stark C. Draper

We study a new encoding scheme for lossy source compression based on spatially coupled low-density generator-matrix codes. We develop a belief-propagation guided-decimation algorithm, and show that this algorithm allows to approach the…

Information Theory · Computer Science 2012-02-23 Vahid Aref , Nicolas Macris , Rudiger Urbanke , Marc Vuffray

A scenario involving a source, a channel, and a destination, where the destination is interested in {\em both} reliably reconstructing the message transmitted by the source and estimating with a fidelity criterion the state of the channel,…

Information Theory · Computer Science 2011-08-30 Wenyi Zhang , Satish Vedantam , Urbashi Mitra