English
Related papers

Related papers: Distributed Information Bottleneck for a Primitive…

200 papers

The information bottleneck channel (or the oblivious relay channel) concerns a channel coding setting where the decoder does not directly observe the channel output. Rather, the channel output is relayed to the decoder by an oblivious relay…

Information Theory · Computer Science 2026-04-28 Yanxiao Liu , Sepehr Heidari Advary , Cheuk Ting Li

In this paper, we first present an outer bound for a general interference channel with a cognitive relay, i.e., a relay that has non-causal knowledge of both independent messages transmitted in the interference channel. This outer bound…

Information Theory · Computer Science 2015-03-17 Stefano Rini , Daniela Tuninetti , Natasha Devroye

In this paper, a Gaussian two-way relay channel, where two source nodes exchange messages with each other through a relay, is considered. We assume that all nodes operate in full-duplex mode and there is no direct channel between the source…

Information Theory · Computer Science 2009-02-17 Wooseok Nam , Sae-Young Chung , Yong H. Lee

We consider the arbitrarily varying Gaussian relay channel with sender frequency division. We determine the random code capacity, and establish lower and upper bounds on the deterministic code capacity. It is observed that when the channel…

Information Theory · Computer Science 2018-06-01 Uzi Pereg , Yossef Steinberg

In this two part paper we consider a wireless network in which a source terminal communicates with a destination and a relay terminal is occasionally present in close proximity to the source without source's knowledge, suggesting oblivious…

Information Theory · Computer Science 2010-07-27 Evgeniy Braginskiy , Avi Steiner , Shlomo Shamai

Training-based transmission over Rayleigh block-fading multiple-input multiple-output (MIMO) channels is investigated. As a training method a combination of a pilot-assisted scheme and a biased signaling scheme is considered. The achievable…

Information Theory · Computer Science 2016-11-18 Keigo Takeuchi , Ralf R. Mueller , Mikko Vehkaperae , Toshiyuki Tanaka

In this paper, we present an analytical framework to derive the performance of a molecular communication system where a transmitter bio-nano-machine (TBN) is communicating with a fully-absorbing spherical receiver bio-nano-machine (RBN) in…

Information Theory · Computer Science 2020-04-07 Nithin V. Sabu , Abhishek K. Gupta

This paper investigates interference-cancellation schemes at the receiver, in which the original data of the interference is known a priori. Such a priori knowledge is common in wireless relay networks. For example, a transmitting relay…

Information Theory · Computer Science 2011-10-17 Shengli Zhang , Soung-Chang Liew , Hui Wang

The study of the fundamental limits of covert communications, where a transmitter Alice wants to send information to a desired recipient Bob without detection of that transmission by an attentive and capable warden Willie, has emerged…

Signal Processing · Electrical Eng. & Systems 2019-01-16 Moslem Forouzesh , Paeiz Azmi , Nader Mokari , Dennis Goeckel

The information bottleneck (IB) method offers an attractive framework for understanding representation learning, however its applications are often limited by its computational intractability. Analytical characterization of the IB method is…

Information Theory · Computer Science 2023-04-03 Vudtiwat Ngampruetikorn , David J. Schwab

Deep Neural Networks (DNNs) are analyzed via the theoretical framework of the information bottleneck (IB) principle. We first show that any DNN can be quantified by the mutual information between the layers and the input and output…

Machine Learning · Computer Science 2015-03-10 Naftali Tishby , Noga Zaslavsky

We investigate the performance of a dual-hop intervehicular communications (IVC) system with relay selection strategy. We assume a generalized fading channel model, known as cascaded Rayleigh (also called n*Rayleigh), which involves the…

Information Theory · Computer Science 2021-01-06 Yahia Alghorani , Ahmed Salim Chekkouri , Djabir Abdeldjalil Chekired , Samuel Pierre

In this paper, we introduce a discrete memoryless State-Dependent Relay Channel with Private Messages (SD-RCPM) as a generalization of the state-dependent relay channel. We investigate two main cases: SD-RCPM with non-causal Channel State…

Information Theory · Computer Science 2016-11-17 Bahareh Akhbari , Mahtab Mirmohseni , Mohammad Reza Aref

This tutorial paper focuses on the variants of the bottleneck problem taking an information theoretic perspective and discusses practical methods to solve it, as well as its connection to coding and learning aspects. The intimate…

Information Theory · Computer Science 2020-02-19 Abdellatif Zaidi , Inaki Estella Aguerri , Shlomo Shamai

This paper studies a Gaussian Z-interference channel with a rate-limited digital relay link from one receiver to another. Achievable rate regions are derived based on a combination of Han-Kobayashi common-private information splitting…

Information Theory · Computer Science 2012-04-26 Lei Zhou , Wei Yu

Emerging 6G industrial networks envision autonomous in-X subnetworks to support efficient and cost-effective short range, localized connectivity for autonomous control operations. Supporting timely transmission of event-driven, critical…

Networking and Internet Architecture · Computer Science 2025-06-16 Samira Abdelrahman , Hossam Farag , Gilberto Berardinelli

We consider a state-dependent full-duplex relay channel with the state of the channel non-causally available at only the relay. In the framework of cooperative wireless networks, some specific terminals can be equipped with cognition…

Information Theory · Computer Science 2016-11-17 Abdellatif Zaidi , Shivaprasad Kotagiri , J. Nicholas Laneman , Luc Vandendorpe

In this paper, fading Gaussian multiuser channels are considered. If the channel is perfectly known to the transmitter, capacity has been established for many cases in which the channels may satisfy certain information theoretic orders such…

Information Theory · Computer Science 2018-10-04 Pin-Hsun Lin , Eduard A. Jorswieck , Rafael F. Schaefer , Martin Mittelbach , Carsten R. Janda

The information bottleneck (IB) method is a technique for extracting information that is relevant for predicting the target random variable from the source random variable, which is typically implemented by optimizing the IB Lagrangian that…

Machine Learning · Computer Science 2020-12-23 Ziqi Pan , Li Niu , Jianfu Zhang , Liqing Zhang

When multiple users share the same resource for physical layer cooperation such as relay terminals in their vicinities, this shared resource may not be always available for every user, and it is critical for transmitting terminals to know…

Information Theory · Computer Science 2015-12-02 Shih-Chun Lin , I-Hsiang Wang