English
Related papers

Related papers: A New Data Processing Inequality and Its Applicati…

200 papers

This paper presents NgramMarkov, a variant of the Markov constraints. It is dedicated to text generation in constraint programming (CP). It involves a set of n-grams (i.e., sequence of n words) associated with probabilities given by a large…

Computation and Language · Computer Science 2024-08-06 Alexandre Bonlarron , Jean-Charles Régin

As one of the most important types of (weaker) supervised information in machine learning and pattern recognition, pairwise constraint, which specifies whether a pair of data points occur together, has recently received significant…

Computer Vision and Pattern Recognition · Computer Science 2015-02-23 Zhenyong Fu , Zhiwu Lu

It is known that, as opposed to point-to-point channel, separate source and channel coding is not optimal in general for sending correlated sources over multiuser channels. In some works joint source-channel coding has been investigated for…

Information Theory · Computer Science 2016-11-15 Sajjad Bahrami , Behrooz Razeghi , Mostafa Monemizadeh , Ghosheh Abed Hodtani

Emerging wireless AR/VR applications require real-time transmission of correlated high-fidelity speech from multiple resource-constrained devices over unreliable, bandwidth-limited channels. Existing autoencoder-based speech source coding…

Information Theory · Computer Science 2025-01-31 Sagnik Bhattacharya , Muhammad Ahmed Mohsin , Ahsan Bilal , John M. Cioffi

We consider the problem of distributed binary hypothesis testing of two sequences that are generated by an i.i.d. doubly-binary symmetric source. Each sequence is observed by a different terminal. The two hypotheses correspond to different…

Information Theory · Computer Science 2018-01-03 Eli Haim , Yuval Kochman

We present a Markov-chain analysis of blockwise-stochastic algorithms for solving partially block-separable optimization problems. Our main contributions to the extensive literature on these methods are statements about the Markov operators…

Optimization and Control · Mathematics 2023-11-01 D. Russell Luke

This paper studies channel coding for the discrete memoryless multiple-access channel with a given (possibly suboptimal) decoding rule. A multi-letter successive decoding rule depending on an arbitrary non-negative decoding metric is…

Information Theory · Computer Science 2017-12-08 Jonathan Scarlett , Alfonso Martinez , Albert Guillén i Fàbregas

A dealer aims to share a secret with participants so that only predefined subsets can reconstruct it, while others learn nothing. The dealer and participants access correlated randomness and communicate over a one-way, public, rate-limited…

Information Theory · Computer Science 2026-01-27 Rumia Sultana , Remi A. Chou

In this paper we propose a method of proving impossibility results based on applying strong data-processing inequalities to estimate mutual information between sets of variables forming certain Markov random fields. The end result is that…

Information Theory · Computer Science 2020-05-22 Yury Polyanskiy , Yihong Wu

Non-adaptive joint source network coding of correlated sources is discussed in this paper. By studying the information flow in the network, we propose quantized network coding as an alternative for packet forwarding. This technique has both…

Information Theory · Computer Science 2012-12-24 Mahdy Nabaee , Fabrice Labeau

This paper introduces an objective function that seeks to minimise the average total number of bits required to encode the joint state of all of the layers of a Markov source. This type of encoder may be applied to the problem of optimising…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Stephen Luttrell

We tackle the problem of deciding whether two probabilistic programs are equivalent in Probabilistic NetKAT, a formal language for specifying and reasoning about the behavior of packet-switched networks. We show that the problem is…

Programming Languages · Computer Science 2018-03-28 Steffen Smolka , Praveen Kumar , Nate Foster , Justin Hsu , David Kahn , Dexter Kozen , Alexandra Silva

A unified graphical approach to random coding for any memoryless, single-hop, K-user channel with or without common information is defined through two steps. The first step is user virtualization: each user is divided into multiple virtual…

Information Theory · Computer Science 2016-06-21 Stefano Rini , Andrea Goldsmith

This paper deals with a universal coding problem for a certain kind of multiterminal source coding system that we call the complementary delivery coding system. In this system, messages from two correlated sources are jointly encoded, and…

Information Theory · Computer Science 2007-10-24 Akisato Kimura , Tomohiko Uyematsu , Shigeaki Kuzuoka

The coordination of autonomous agents is a critical issue for decentralized communication networks. Instead of transmitting information, the agents interact in a coordinated manner in order to optimize a general objective function. A target…

Information Theory · Computer Science 2016-11-15 Maël Le Treust

Correlation between channel state and source symbol is under investigation for a joint source-channel coding problem. We investigate simultaneously the lossless transmission of information and the empirical coordination of channel inputs…

Information Theory · Computer Science 2016-11-17 Maël Le Treust

We propose a framework for the derivation and evaluation of distributed iterative algorithms for receiver cooperation in interference-limited wireless systems. Our approach views the processing within and collaboration between receivers as…

Information Theory · Computer Science 2012-04-18 Mihai-Alin Badiu , Carles Navarro Manchón , Vasile Bota , Bernard Henri Fleury

We have a set of processors (or agents) and a set of graph networks defined over some vertex set. Each processor can access a subset of the graph networks. Each processor has a demand specified as a pair of vertices $<u, v>$, along with a…

Data Structures and Algorithms · Computer Science 2012-10-08 Venkatesan T. Chakaravarthy , Sambuddha Roy , Yogish Sabharwal

This paper deals with a universal coding problem for a certain kind of multiterminal source coding network called a generalized complementary delivery network. In this network, messages from multiple correlated sources are jointly encoded,…

Information Theory · Computer Science 2009-04-02 Akisato Kimura , Tomohiko Uyematsu , Shigeaki Kuzuoka , Shun Watanabe

A two-terminal interactive distributed source coding problem with alternating messages for function computation at both locations is studied. For any number of messages, a computable characterization of the rate region is provided in terms…

Information Theory · Computer Science 2008-11-13 Nan Ma , Prakash Ishwar