English
Related papers

Related papers: Learning Channel Capacity with Neural Mutual Infor…

200 papers

Channel knowledge map (CKM) is viewed as a digital twin of wireless channels, providing location-specific channel knowledge for environment-aware communications. A fundamental problem in CKM-assisted communications is how to construct the…

Information Theory · Computer Science 2025-12-30 Wenjun Jiang , Xiaojun Yuan , Boyu Teng , Hao Wang , Jing Qian

In this letter, we propose a Gaussian mixture model (GMM)-based channel estimator which is learned on imperfect training data, i.e., the training data are solely comprised of noisy and sparsely allocated pilot observations. In a practical…

Signal Processing · Electrical Eng. & Systems 2023-02-14 Benedikt Fesl , Nurettin Turan , Michael Joham , Wolfgang Utschick

Recent sustainability drives place energy-consumption metrics in centre-stage for the design of future radio access networks (RAN). At the same time, optimising the trade-off between performance and system energy usage by machine-learning…

Systems and Control · Electrical Eng. & Systems 2024-11-05 Kishan Sthankiya , Keith Briggs , Mona Jaber , Richard G. Clegg

Analog compute-in-memory (CIM) systems are promising for deep neural network (DNN) inference acceleration due to their energy efficiency and high throughput. However, as the use of DNNs expands, protecting user input privacy has become…

Cryptography and Security · Computer Science 2023-05-30 Ziyu Wang , Yuting Wu , Yongmo Park , Sangmin Yoo , Xinxin Wang , Jason K. Eshraghian , Wei D. Lu

Deep learning systems have been reported to achieve state-of-the-art performances in many applications, and a key is the existence of well trained classifiers on benchmark datasets. As a main-stream loss function, the cross entropy can…

Machine Learning · Computer Science 2022-09-22 Jirong Yi , Qiaosheng Zhang , Zhen Chen , Qiao Liu , Wei Shao

The cognitive interference channel with confidential messages is studied. Similarly to the classical two-user interference channel, the cognitive interference channel consists of two transmitters whose signals interfere at the two…

Information Theory · Computer Science 2007-10-11 Yingbin Liang , Anelia Somekh-Baruch , H. Vincent Poor , Shlomo Shamai , Sergio Verdu

Capacity formulas and random-coding exponents are derived for a generalized family of Gel'fand-Pinsker coding problems. These exponents yield asymptotic upper bounds on the achievable log probability of error. In our model, information is…

Information Theory · Computer Science 2007-07-13 Pierre Moulin , Ying Wang

We propose generative channel modeling to learn statistical channel models from channel input-output measurements. Generative channel models can learn more complicated distributions and represent the field data more faithfully. They are…

Information Theory · Computer Science 2022-03-17 Tribhuvanesh Orekondy , Arash Behboodi , Joseph B. Soriaga

Channel estimation for hybrid Multiple Input Multiple Output (MIMO) systems at Millimeter-Waves (mmW)/sub-THz is a fundamental, despite challenging, prerequisite for an efficient design of hybrid MIMO precoding/combining. Most works propose…

Information Theory · Computer Science 2021-05-24 Marouan Mizmizi , Dario Tagliaferri , Damiano Badini , Christian Mazzucco , Umberto Spagnolini

Motivated by communication systems with constrained complexity, we consider the problem of input symbol selection for discrete memoryless channels (DMCs). Given a DMC, the goal is to find a subset of its input alphabet, so that the optimal…

Information Theory · Computer Science 2024-07-02 Maximilian Egger , Rawad Bitar , Antonia Wachter-Zeh , Deniz Gündüz , Nir Weinberger

Mutual information (MI) is a promising candidate measure for the assessment and optimization of localization systems, as it captures nonlinear dependencies between random variables. However, the high cost of computing MI, especially for…

Signal Processing · Electrical Eng. & Systems 2025-11-04 Sven Hinderer , Manuel Buchfink , Bin Yang

Estimating mutual information accurately is pivotal across diverse applications, from machine learning to communications and biology, enabling us to gain insights into the inner mechanisms of complex systems. Yet, dealing with…

Machine Learning · Computer Science 2024-11-12 Nunzio A. Letizia , Nicola Novello , Andrea M. Tonello

This paper provides a survey of the state-of-the-art information theoretic analysis for overlay multi-user (more than two pairs) cognitive networks and reports new capacity results. In an overlay scenario, cognitive / secondary users share…

Information Theory · Computer Science 2015-10-26 Diana Maamari , Daniela Tuninetti , Natasha Devroye

The capacity region of the interference channel in which one transmitter non-causally knows the message of the other, termed the cognitive interference channel, has remained open since its inception in 2005. A number of subtly differing…

Information Theory · Computer Science 2015-03-13 Stefano Rini , Daniela Tuninetti , Natasha Devroye

Learning representations that transfer well to diverse downstream tasks remains a central challenge in representation learning. Existing paradigms -- contrastive learning, self-supervised masking, and denoising auto-encoders -- balance this…

Machine Learning · Computer Science 2025-09-29 Micha Livne

Deep reinforcement learning algorithms have recently been used to train multiple interacting agents in a centralised manner whilst keeping their execution decentralised. When the agents can only acquire partial observations and are faced…

Machine Learning · Computer Science 2020-01-27 Emanuele Pesce , Giovanni Montana

Cognitive radios have been proposed as agile technologies to boost the spectrum utilization. This paper tackles the problem of channel estimation and its impact on downlink transmissions in an underlay cognitive radio scenario. We consider…

Information Theory · Computer Science 2015-05-11 Maha Alodeh , Symeon Chatzinotas , Bjorn Ottersten

Wireless network capacity can be regarded as the most important performance metric for wireless communication systems. With the fast development of wireless communication technology, future wireless systems will become more and more…

Information Theory · Computer Science 2022-08-17 Han Hao , Dandan Jiang , Lu Yang , Hao Wu , Bo Bai

The capacity region of the Multicast Cognitive Interference Channel (CIFC) is investigated. This channel consists of two independent transmitters that wish to multicast two different messages, each of them to a different set of users. In…

Information Theory · Computer Science 2016-11-17 Meryem Benammar , Pablo Piantanida , Shlomo Shamai

In this work, we perform unsupervised learning of representations by maximizing mutual information between an input and the output of a deep neural network encoder. Importantly, we show that structure matters: incorporating knowledge about…