English
Related papers

Related papers: Distributed Information Bottleneck for a Primitive…

200 papers

The information bottleneck (IB) approach to clustering takes a joint distribution $P\!\left(X,Y\right)$ and maps the data $X$ to cluster labels $T$ which retain maximal information about $Y$ (Tishby et al., 1999). This objective results in…

Machine Learning · Statistics 2020-06-02 DJ Strouse , David J Schwab

As shown by M\'edard, the capacity of fading channels with imperfect channel-state information (CSI) can be lower-bounded by assuming a Gaussian channel input $X$ with power $P$ and by upper-bounding the conditional entropy $h(X|Y,\hat{H})$…

Information Theory · Computer Science 2016-11-15 Adriano Pastore , Tobias Koch , Javier Rodríguez Fonollosa

We consider a general spectral coexistence scenario, wherein the channels and transmit signals of both radar and communications systems are unknown at the receiver. In this \textit{dual-blind deconvolution} (DBD) problem, a common receiver…

Signal Processing · Electrical Eng. & Systems 2021-11-12 Edwin Vargas , Kumar Vijay Mishra , Roman Jacome , Brian M. Sadler , Henry Arguello

When data traffic in a wireless network is bursty, small amounts of data sporadically become available for transmission, at times that are unknown at the receivers, and an extra amount of energy must be spent at the transmitters to overcome…

Information Theory · Computer Science 2012-08-09 Ilan Shomorony , Raúl Etkin , Farzad Parvaresh , A. Salman Avestimehr

Consider a relay cascade, i.e. a network where a source node, a sink node and a certain number of intermediate source/relay nodes are arranged on a line and where adjacent node pairs are connected by error-free (q+1)-ary pipes. Suppose the…

Information Theory · Computer Science 2016-11-17 Tobias Lutz , Christoph Hausl , Ralf Kötter

In this paper, we study a remote source coding scenario in which binary phase shift keying (BPSK) modulation sources are corrupted by additive white Gaussian noise (AWGN). An intermediate node, such as a relay, receives these observations…

Information Theory · Computer Science 2024-05-14 Yi Song , Kai Wan , Zhenyu Liao , Giuseppe Caire

We derive minimax testing errors in a distributed framework where the data is split over multiple machines and their communication to a central machine is limited to $b$ bits. We investigate both the $d$- and infinite-dimensional signal…

Statistics Theory · Mathematics 2022-12-13 Botond Szabó , Lasse Vuursteen , Harry van Zanten

The problem of distributed representation learning is one in which multiple sources of information $X_1,\ldots,X_K$ are processed separately so as to learn as much information as possible about some ground truth $Y$. We investigate this…

Machine Learning · Statistics 2019-04-02 Inaki Estella Aguerri , Abdellatif Zaidi

Motivated by fading channels and erasure channels, the problem of reliable communication over deterministic relay networks is studied, in which relay nodes receive a function of the incoming signals and a random network state. An achievable…

Information Theory · Computer Science 2016-11-17 Sung Hoon Lim , Young-Han Kim , Sae-Young Chung

Semantic communication shifts the focus from bit-level accuracy to task-relevant semantic delivery, enabling efficient and intelligent communication for next-generation networks. However, existing multi-modal solutions often process all…

Information Theory · Computer Science 2026-01-01 Yujie Zhou , Cheng Peng , Rulong Wang , Yong Xiao , Yingyu Li , Guangming Shi , Ping Zhang

This paper considers a distributed interference avoidance problem employing frequency assignment in the Gaussian interference channel (IC). We divide the common channel into several subchannels and each user chooses the subchannel with less…

Information Theory · Computer Science 2010-03-23 Zhenhai Jing , Baoming Bai , Xiao Ma , Ying Li

This work studies the Gaussian interference channel (IC) with a relay, which transmits and receives in a band that is orthogonal to the IC. The channel associated with the relay is thus an out-of-band relay channel (OBRC). The focus is on a…

Information Theory · Computer Science 2015-03-17 Ye Tian , Aylin Yener

This letter studies parallel independent Gaussian channels with uncertain eavesdropper channel state information (CSI). Firstly, we evaluate the probability of zero secrecy rate in this system for (i) given instantaneous channel conditions…

Information Theory · Computer Science 2016-02-23 Siddhartha Sarma , Kundan Kandhway , Joy Kuri

A fading broadcast channel is considered where the transmitter employs two antennas and each of the two receivers employs a single receive antenna. It is demonstrated that even if the realization of the fading is precisely known to the…

Information Theory · Computer Science 2007-07-13 Amos Lapidoth , Shlomo Shamai , Michele Wigger

This paper considers base station cooperation (BSC) strategies for the uplink of a multi-user multi-cell high frequency reuse scenario where distributed iterative detection (DID) schemes with soft/hard interference cancellation algorithms…

Information Theory · Computer Science 2014-01-03 Peng Li , Rodrigo C. de Lamare

Task-oriented communications, mostly using learning-based joint source-channel coding (JSCC), aim to design a communication-efficient edge inference system by transmitting task-relevant information to the receiver. However, only…

Information Theory · Computer Science 2023-05-10 Songjie Xie , Shuai Ma , Ming Ding , Yuanming Shi , Mingjian Tang , Youlong Wu

We consider a secure integrated sensing and communication (ISAC) scenario, in which a signal is transmitted through a state-dependent wiretap channel with one legitimate receiver with which the transmitter communicates and one…

Information Theory · Computer Science 2024-09-02 Martin Mittelbach , Rafael F. Schaefer , Matthieu Bloch , Aylin Yener , Onur Günlü

In this paper, outage performance of network topology-aware distributed opportunistic relay selection strategies is studied with focus on the impact of different levels of channel state information (CSI) available at relays. Specifically,…

Information Theory · Computer Science 2013-06-13 Anvar Tukmanov , Said Boussakta , Zhiguo Ding , Abbas Jamalipour

This paper investigates a multi-terminal source coding problem under a logarithmic loss fidelity which does not necessarily lead to an additive distortion measure. The problem is motivated by an extension of the Information Bottleneck…

Information Theory · Computer Science 2021-11-29 Matías Vera , Leonardo Rey Vega , Pablo Piantanida

Multiple groupcasting over the broadcast channel (BC) is studied. In particular, an inner bound is obtained for the $K$-receiver discrete memoryless (DM) BC for the diamond message set which consists of four groupcast messages: one desired…

Information Theory · Computer Science 2020-11-11 Mohamed Salman , Mahesh K. Varanasi