English
Related papers

Related papers: Causal Vector-valued Witsenhausen Counterexamples …

200 papers

This paper investigates the problem of zero-delay joint source-channel coding of a vector Gauss-Markov source over a multiple-input multiple-output (MIMO) additive white Gaussian noise (AWGN) channel with feedback. In contrast to the…

Information Theory · Computer Science 2023-10-19 Barron Han , Oron Sabag , Victoria Kostina , Babak Hassibi

Estimating causal effects from observational data (at either an individual -- or a population -- level) is critical for making many types of decisions. One approach to address this task is to learn decomposed representations of the…

Machine Learning · Computer Science 2021-11-15 Negar Hassanpour , Russell Greiner

We consider the problem of information embedding where the encoder modifies a white Gaussian host signal in a power-constrained manner to encode a message, and the decoder recovers both the embedded message and the modified host signal.…

Information Theory · Computer Science 2016-11-15 Pulkit Grover , Aaron B. Wagner , Anant Sahai

Channel coding for discrete memoryless channels (DMCs) with mean and variance cost constraints has been recently introduced. We show that there is an improvement in coding performance due to cost variability, both with and without feedback.…

Information Theory · Computer Science 2025-07-10 Adeel Mahmood , Aaron B. Wagner

We consider the optimal design of sequential transmission over broadcast channel with nested feedback. Nested feedback means that the channel output of the outer channel is also available at the decoder of the inner channel. We model the…

Information Theory · Computer Science 2010-04-08 Aditya Mahajan

In this work, we investigate the performance of polar codes with the assistance of feedback in communication systems. Although it is well known that feedback does not improve the capacity of memoryless channels, we show that the finite…

Information Theory · Computer Science 2026-04-13 Ling Liu , Qi Cao , Liping Li , Baoming Bai

We consider zero-delay single-user and multi-user source coding with average distortion constraint and decoder side information. The zero-delay constraint translates into causal (sequential) encoder and decoder pairs as well as the use of…

Information Theory · Computer Science 2013-01-03 Yonatan Kaspi , Neri Merhav

Traditional channel coding with feedback constructs and transmits a codeword only after all message bits are available at the transmitter. This paper joins Guo & Kostina and Lalitha et. al. in developing approaches for causal (or…

Information Theory · Computer Science 2021-04-30 Amaael Antonini , Rita Gimeshein , Richard D. Wesel

The design of codes for communicating reliably over a statistically well defined channel is an important endeavor involving deep mathematical research and wide-ranging practical applications. In this work, we present the first family of…

Machine Learning · Computer Science 2018-07-03 Hyeji Kim , Yihan Jiang , Sreeram Kannan , Sewoong Oh , Pramod Viswanath

We consider wireless transmission of images in the presence of channel output feedback. From a Shannon theoretic perspective feedback does not improve the asymptotic end-to-end performance, and separate source coding followed by…

Information Theory · Computer Science 2020-04-13 David Burth Kurka , Deniz Gündüz

We propose a strategic formulation for the joint source-channel coding problem in which the encoder and the decoder are endowed with distinct distortion functions. We provide the solutions in four different scenarios. First, we assume that…

Information Theory · Computer Science 2020-10-26 Maël Le Treust , Tristan Tomala

In this paper, we consider a scalar-help-vector source coding problem for $L+1$ correlated Gaussian memoryless sources. We deal with the case where $L$ encoders observe noisy linear combinations of $K$ correlated Gaussian scalar sources…

Information Theory · Computer Science 2019-11-14 C. Deng , S. Wu , Q. Zhang

Feedback communication is studied from a control-theoretic perspective, mapping the communication problem to a control problem in which the control signal is received through the same noisy channel as in the communication problem, and the…

Information Theory · Computer Science 2010-06-29 Ehsan Ardestanizadeh , Massimo Franceschetti

Sensory observations about the world are invariably ambiguous. Inference about the world's latent variables is thus an important computation for the brain. However, computational constraints limit the performance of these computations.…

Neurons and Cognition · Quantitative Biology 2022-10-13 Lokesh Boominathan , Xaq Pitkow

This paper answers a question raised by Doyle on the relevance of the Witsenhausen counterexample as a toy decentralized control problem. The question has two sides, the first of which focuses on the lack of an external channel in the…

Information Theory · Computer Science 2010-09-15 Pulkit Grover , Anant Sahai

We consider the following communication scenario. An encoder causally observes the Wiener process and decides when and what to transmit about it. A decoder makes real-time estimation of the process using causally received codewords. We…

Information Theory · Computer Science 2020-05-15 Nian Guo , Victoria Kostina

The recently proposed set-up of source coding with a side information "vending machine" allows the decoder to select actions in order to control the quality of the side information. The actions can depend on the message received from the…

Information Theory · Computer Science 2013-01-08 Osvaldo Simeone

There has been substantial progress recently in understanding toy problems of purely implicit signaling. These are problems where the source and the channel are implicit -- the message is generated endogenously by the system, and the plant…

Information Theory · Computer Science 2010-10-26 Pulkit Grover , Anant Sahai

We analyse a communication scenario over a particular causal broadcast channel whose state depends on a modulo sum. The receivers of the broadcast receive channel state information and collaborate to determine the channel state as to decode…

Information Theory · Computer Science 2021-02-16 Stephen DiAdamo , Janis Nötzel

The problem of optimal actuation for channel and source coding was recently formulated and solved in a number of relevant scenarios. In this class of models, actions are taken at encoders or decoders, either to acquire side information in…

Information Theory · Computer Science 2012-07-26 Behzad Ahmadi , Himanshu Asnani , Osvaldo Simeone , Haim H. Permuter