English
Related papers

Related papers: Source Coding with Free Bits and the Multi-Way Num…

200 papers

In this first part, a computable outer bound is proved for the multiterminal source coding problem, for a setup with two encoders, discrete memoryless sources, and bounded distortion measures.

Information Theory · Computer Science 2007-07-13 Sergio D. Servetto

The n-way number partitioning problem, a fundamental challenge in combinatorial optimization, has significant implications for applications such as fair division and machine scheduling. Despite these problems being NP-hard, many…

Data Structures and Algorithms · Computer Science 2025-04-04 Samuel Bismuth , Erel Segal-Halevi , Dana Shapira

Huffman coding finds an optimal prefix code for a given probability mass function. Consider situations in which one wishes to find an optimal code with the restriction that all codewords have lengths that lie in a user-specified set of…

Information Theory · Computer Science 2008-01-03 Michael B. Baer

Given a probability distribution over a set of n words to be transmitted, the Huffman Coding problem is to find a minimal-cost prefix free code for transmitting those words. The basic Huffman coding problem can be solved in O(n log n) time…

Data Structures and Algorithms · Computer Science 2008-09-29 Mordecai Golin , Xiaoming Xu , Jiajin Yu

Efficient optimal prefix coding has long been accomplished via the Huffman algorithm. However, there is still room for improvement and exploration regarding variants of the Huffman problem. Length-limited Huffman coding, useful for many…

Information Theory · Computer Science 2007-07-13 Michael B. Baer

We consider the problem of joint source and channel coding of structured data such as natural language over a noisy channel. The typical approach to this problem in both theory and practice involves performing source coding to first…

Information Theory · Computer Science 2018-02-21 Nariman Farsad , Milind Rao , Andrea Goldsmith

The problem of broadcasting a pair of correlated Gaussian sources using optimal separate source and channel codes is studied. Considerable performance gains over previously known separate source-channel schemes are observed. Although…

Information Theory · Computer Science 2011-05-10 Yang Gao , Ertem Tuncel

This paper deals with a universal coding problem for a certain kind of multiterminal source coding system that we call the complementary delivery coding system. In this system, messages from two correlated sources are jointly encoded, and…

Information Theory · Computer Science 2007-10-24 Akisato Kimura , Tomohiko Uyematsu , Shigeaki Kuzuoka

This work discusses the source broadcasting problem, i.e. transmitting a source to many receivers via a broadcast channel. The optimal rate-distortion region for this problem is unknown. The separation approach divides the problem into two…

Information Theory · Computer Science 2014-01-21 Uri Mendlovic , Meir Feder

Graph partitioning is a key fundamental problem in the area of big graph computation. Previous works do not consider the practical requirements when optimizing the big data analysis in real applications. In this paper, motivated by…

Databases · Computer Science 2024-04-10 Baoling Ning , Jianzhong Li

In problems of lossy source/noisy channel coding with side information, the theoretical bounds are achieved using "good" source/channel codes that can be partitioned into "good" channel/source codes. A scheme that achieves optimality in…

Information Theory · Computer Science 2009-04-07 Lorenzo Cappellari

We introduce the new concept of computation coding. Similar to how rate-distortion theory is concerned with the lossy compression of data, computation coding deals with the lossy computation of functions. Particularizing to linear…

Information Theory · Computer Science 2021-02-02 Ralf Müller , Bernhard Gäde , Ali Bereyhi

Computation codes in network information theory are designed for the scenarios where the decoder is not interested in recovering the information sources themselves, but only a function thereof. K\"orner and Marton showed for distributed…

Information Theory · Computer Science 2017-07-28 Jingge Zhu , Sung Hoon Lim , Michael Gastpar

Stochastic encoders for channel coding and lossy source coding are introduced with a rate close to the fundamental limits, where the only restriction is that the channel input alphabet and the reproduction alphabet of the lossy source code…

Information Theory · Computer Science 2016-11-15 Jun Muramatsu

Let (S1,i, S2,i), distributed according to i.i.d p(s1, s2), i = 1, 2, . . . be a memoryless, correlated partial side information sequence. In this work we study channel coding and source coding problems where the partial side information…

Information Theory · Computer Science 2013-04-12 Avihay Shirazi , Uria Basher , Haim Permuter

We consider a new fundamental question regarding the point-to-point memoryless channel. The source-channel separation theorem indicates that random codebook construction for lossy source compression and channel coding can be independently…

Information Theory · Computer Science 2011-10-04 Paul Cuff , Curt Schieler

Consider a multi-source network coding problem with correlated sources. While the fundamental limits are known, achieving them, in general, involves a computational burden due to the complex decoding process. Efficient solutions, on the…

Information Theory · Computer Science 2016-01-27 Salman Salamatian , Asaf Cohen , Muriel Médard

In the problem of variable-length $\delta$-channel resolvability, the channel output is approximated by encoding a variable-length uniform random number under the constraint that the variational distance between the target and approximated…

Information Theory · Computer Science 2018-01-16 Hideki Yagi , Te Sun Han

This paper proves the separation between source-network coding and channel coding in networks of noisy, discrete, memoryless channels. We show that the set of achievable distortion matrices in delivering a family of dependent sources across…

Information Theory · Computer Science 2016-11-17 Shirin Jalali , Michelle Effros

This paper considers the source coding problem with broadcast side information. The side information is sent to two receivers through a noisy broadcast channel. We provide an outer bound of the rate--distortion--bandwidth (RDB) quadruples…

Information Theory · Computer Science 2026-02-19 Yiqi Chen , Holger Boche , Marc Geitz