English
Related papers

Related papers: On More General Distributions of Random Binning fo…

200 papers

Distributed source coding (DSC) addresses the compression of correlated sources without communication links among them. This paper is concerned with the Wyner-Ziv problem: coding of an information source with side information available only…

Information Theory · Computer Science 2011-11-08 Cong Ling , Su Gao , Jean-Claude Belfiore

Compression of integer sets and sequences has been extensively studied for settings where elements follow a uniform probability distribution. In addition, methods exist that exploit clustering of elements in order to achieve higher…

Information Theory · Computer Science 2014-02-11 N. Jesper Larsson

This paper introduces a convenient strategy for coding and predicting sequences of independent, identically distributed random variables generated from a large alphabet of size $m$. In particular, the size of the sample is allowed to be…

Information Theory · Computer Science 2014-01-17 Xiao Yang , Andrew R. Barron

In contrast to time series, graphical data is data indexed by the vertices and edges of a graph. Modern applications such as the internet, social networks, genomics and proteomics generate graphical data, often at large scale. The large…

Information Theory · Computer Science 2021-08-24 Payam Delgosha , Venkat Anantharam

We propose a simple yet effective wireless network coding and decoding technique for a multiple unicast network. It utilizes spatial diversity through cooperation between nodes which carry out distributed encoding operations dictated by…

Information Theory · Computer Science 2012-09-06 Tugcan Aktas , A. Ozgur Yilmaz , Emre Aktas

In problems of lossy source/noisy channel coding with side information, the theoretical bounds are achieved using "good" source/channel codes that can be partitioned into "good" channel/source codes. A scheme that achieves optimality in…

Information Theory · Computer Science 2009-04-07 Lorenzo Cappellari

While deep neural networks are a highly successful model class, their large memory footprint puts considerable strain on energy consumption, communication bandwidth, and storage requirements. Consequently, model size reduction has become an…

Machine Learning · Statistics 2018-10-02 Marton Havasi , Robert Peharz , José Miguel Hernández-Lobato

We consider the problem of zero error source coding with limited feedback when side information is present at the receiver. First, we derive an achievable rate region for arbitrary joint distributions on the source and the side information.…

Information Theory · Computer Science 2010-01-15 Mayank Bakshi , MIchelle Effros

In this paper, a novel learning-based Wyner-Ziv coding framework is considered under a distributed image transmission scenario, where the correlated source is only available at the receiver. Unlike other learnable frameworks, our approach…

Information Theory · Computer Science 2025-02-06 Yuxuan Shi , Shuo Shao , Yongpeng Wu , Wenjun Zhang , Merouane Debbah

In this paper we consider point-to-point and distributed source coding problems where the receiver is only interested in a function of the data sent by the source encoder(s), while knowledge of the function remains unknown to the…

Information Theory · Computer Science 2018-11-27 Sourya Basu , Lav R. Varshney

We consider the problem of distributed compression for correlated quantum sources. The classical version of this problem was solved by Slepian and Wolf, who showed that distributed compression could take full advantage of redundancy in the…

Quantum Physics · Physics 2007-05-23 Charlene Ahn , Andrew Doherty , Patrick Hayden , Andreas Winter

Consider a lossy compression system with $\ell$ distributed encoders and a centralized decoder. Each encoder compresses its observed source and forwards the compressed data to the decoder for joint reconstruction of the target signals under…

Information Theory · Computer Science 2018-07-19 Yizhong Wang , Li Xie , Xuan Zhang , Jun Chen

We consider a multi-way relay network with an orthogonal uplink and correlated sources, and we characterise reliable communication (in the usual Shannon sense) with a single-letter expression. The characterisation is obtained using a joint…

Information Theory · Computer Science 2013-09-18 Roy Timo , Gottfried Lechner , Lawrence Ong , Sarah J. Johnson

Accurate modeling of the correlation between the sources plays a crucial role in the efficiency of distributed source coding (DSC) systems. This correlation is commonly modeled in the binary domain by using a single binary symmetric channel…

Information Theory · Computer Science 2012-11-12 Mojtaba Vaezi , Fabrice Labeau

We propose a new architecture for distributed image compression from a group of distributed data sources. The work is motivated by practical needs of data-driven codec design, low power consumption, robustness, and data privacy. The…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Enmao Diao , Jie Ding , Vahid Tarokh

In this paper, we investigate the problem of distributionally robust source coding, i.e., source coding under uncertainty in the source distribution, discussing both the coding and computational aspects of the problem. We propose two…

Information Theory · Computer Science 2025-07-24 Giuseppe Serra , Photios A. Stavrou , Marios Kountouris

This paper studies the random-coding exponent of joint source-channel coding for a scheme where source messages are assigned to disjoint subsets (referred to as classes), and codewords are independently generated according to a distribution…

Information Theory · Computer Science 2014-02-19 Adrià Tauste Campo , Gonzalo Vazquez-Vilar , Albert Guillén i Fàbregas , Tobias Koch , Alfonso Martinez

The second-order achievable rate region in Slepian-Wolf source coding systems is investigated. The concept of second-order achievable rates, which enables us to make a finer evaluation of achievable rates, has already been introduced and…

Information Theory · Computer Science 2017-03-28 Ryo Nomura , Te Sun Han

This paper investigates the problem of variable-length lossy source coding allowing a positive excess distortion probability and an overflow probability of codeword lengths. Novel one-shot achievability and converse bounds of the optimal…

Information Theory · Computer Science 2018-12-17 Shota Saito , Hideki Yagi , Toshiyasu Matsushima

The minimum average number of bits need to describe a random variable is its entropy, assuming knowledge of the underlying statistics On the other hand, universal compression supposes that the distribution of the random variable, while…

Information Theory · Computer Science 2014-04-02 Maryam Hosseini , Narayana Santhanam
‹ Prev 1 3 4 5 6 7 10 Next ›