English
Related papers

Related papers: Learning Channel Capacity with Neural Mutual Infor…

200 papers

Learning representations that generalize well to unknown downstream tasks is a central challenge in representation learning. Existing approaches such as contrastive learning, self-supervised masking, and denoising auto-encoders address this…

Machine Learning · Computer Science 2025-09-10 Micha Livne

An important problem with machine learning is that when label number n>2, it is very difficult to construct and optimize a group of learning functions, and we wish that optimized learning functions are still useful when prior distribution…

Artificial Intelligence · Computer Science 2022-12-26 Chenguang Lu

The autoencoder concept has fostered the reinterpretation and the design of modern communication systems. It consists of an encoder, a channel, and a decoder block which modify their internal neural structure in an end-to-end learning…

Information Theory · Computer Science 2020-09-14 Nunzio A. Letizia , Andrea M. Tonello

Recently, generative adversarial networks (GANs) have shown promising performance in generating realistic images. However, they often struggle in learning complex underlying modalities in a given dataset, resulting in poor-quality generated…

Computer Vision and Pattern Recognition · Computer Science 2018-05-09 David Keetae Park , Seungjoo Yoo , Hyojin Bahng , Jaegul Choo , Noseong Park

We investigate a general channel estimation problem in the massive multiple-input multiple-output (MIMO) system which employs the hybrid analog/digital precoding structure with limited radio-frequency (RF) chains. By properly designing RF…

Information Theory · Computer Science 2017-12-27 Leyuan Pan , Le Liang , Wei Xu , Xiaodai Dong

A significant amount of research literature is dedicated to interference mitigation in Wireless Mesh Networks (WMNs), with a special emphasis on designing channel allocation (CA) schemes which alleviate the impact of interference on WMN…

Networking and Internet Architecture · Computer Science 2018-08-20 Srikant Manas Kala , Vanlin Sathya , M Pavan Kumar Reddy , Betty Lala , Bheemarjuna Reddy Tamma

The cognitive interference channel is an interference channel in which one transmitter is non-causally provided with the message of the other transmitter. This channel model has been extensively studied in the past years and capacity…

Information Theory · Computer Science 2010-03-24 Stefano Rini , Daniela Tuninetti , Natasha Devroye

This paper proposes a machine learning-assisted channel estimation approach for massive MIMO systems, leveraging DNNs to outperform traditional LS and MMSE methods. In 5G and beyond, accurate channel estimation mitigates pilot contamination…

Signal Processing · Electrical Eng. & Systems 2025-10-16 Haoran He

This work examines the use of two-way training to efficiently discriminate the channel estimation performances at a legitimate receiver (LR) and an unauthorized receiver (UR) in a multiple-input multiple-output (MIMO) wireless system. This…

Information Theory · Computer Science 2015-06-12 Chao-Wei Huang , Tsung-Hui Chang , Xiangyun Zhou , Y. -W. Peter Hong

Channel knowledge map (CKM) is an emerging technique to enable environment-aware wireless communications, in which databases with location-specific channel knowledge are used to facilitate or even obviate real-time channel state information…

Information Theory · Computer Science 2021-08-17 Kun Li , Peiming Li , Yong Zeng , Jie Xu

We study the capacity of discrete memoryless many-to-one interference channels, i.e., K user interference channels where only one receiver faces interference. For a class of many-to-one interference channels, we identify a noisy…

Information Theory · Computer Science 2009-12-17 Viveck R. Cadambe , Syed A. Jafar

Two recently introduced criteria for estimation of generative models are both based on a reduction to binary classification. Noise-contrastive estimation (NCE) is an estimation procedure in which a generative model is trained to be able to…

Machine Learning · Statistics 2015-05-22 Ian J. Goodfellow

This work develops a new method for estimating and optimizing the directed information rate between two jointly stationary and ergodic stochastic processes. Building upon recent advances in machine learning, we propose a recurrent neural…

Information Theory · Computer Science 2022-03-29 Dor Tsur , Ziv Aharoni , Ziv Goldfeld , Haim Permuter

Fundamental limits of the cognitive interference channel (CIC) with two pairs of transmitter-receiver has been under exploration for several years. In this paper, we study the discrete memoryless cognitive interference channel (DM-CIC) in…

Information Theory · Computer Science 2012-10-09 Mojtaba Vaezi

In this paper, a novel framework is proposed to perform data-driven air-to-ground (A2G) channel estimation for millimeter wave (mmWave) communications in an unmanned aerial vehicle (UAV) wireless network. First, an effective channel…

Information Theory · Computer Science 2021-08-03 Qianqian Zhang , Aidin Ferdowsi , Walid Saad , Mehdi Bennis

We point out a limitation of the mutual information neural estimation (MINE) where the network fails to learn at the initial training phase, leading to slow convergence in the number of training iterations. To solve this problem, we propose…

Information Theory · Computer Science 2019-06-03 Chung Chan , Ali Al-Bashabsheh , Hing Pang Huang , Michael Lim , Da Sun Handason Tam , Chao Zhao

Extremely large-scale multiple-input-multiple-output (XL-MIMO) is a promising technique to achieve ultra-high spectral efficiency for future 6G communications. The mixed line-of-sight (LoS) and non-line-of-sight (NLoS) XL-MIMO near-field…

Signal Processing · Electrical Eng. & Systems 2024-06-18 Ming Ye , Xiao Liang , Cunhua Pan , Yinfei Xu , Ming Jiang , Chunguo Li

Deep learning has demonstrated the important roles in improving the system performance and reducing computational complexity for $5$G-and-beyond networks. In this paper, we propose a new channel estimation method with the assistance of deep…

Information Theory · Computer Science 2021-01-19 An Le Ha , Trinh Van Chien , Tien Hoa Nguyen , Wan Choi , Van Duc Nguyen

Understanding the mechanism of generative adversarial networks (GANs) helps us better use GANs for downstream applications. Existing efforts mainly target interpreting unconditional models, leaving it less explored how a conditional GAN…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Yingqing He , Zhiyi Zhang , Jiapeng Zhu , Yujun Shen , Qifeng Chen

A new trend in deep learning, represented by Mutual Information Neural Estimation (MINE) and Information Noise Contrast Estimation (InfoNCE), is emerging. In this trend, similarity functions and Estimated Mutual Information (EMI) are used…

Information Theory · Computer Science 2023-05-25 Chenguang Lu