English
Related papers

Related papers: Learning Channel Capacity with Neural Mutual Infor…

200 papers

Effective task-oriented semantic communications relies on perfect knowledge alignment between transmitters and receivers for accurate recovery of task-related semantic information, which can be susceptible to knowledge misalignment and…

Signal Processing · Electrical Eng. & Systems 2025-01-06 Hong Chen , Fang Fang , Xianbin Wang

In this paper, we propose a new cooperation model for discrete memoryless multiple access channels. Unlike in prior cooperation models (e.g., conferencing encoders), where the transmitters cooperate directly, in this model the transmitters…

Information Theory · Computer Science 2014-04-29 Parham Noorzad , Michelle Effros , Michael Langberg , Tracey Ho

In this paper, we propose CKGAN, a novel generative adversarial network (GAN) variant based on an integral probability metrics framework with characteristic kernel (CKIPM). CKIPM, as a distance between two probability distributions, is…

Machine Learning · Computer Science 2025-04-09 Kuntian Zhang , Simin Yu , Yaoshu Wang , Makoto Onizuka , Chuan Xiao

Channel estimation is crucial in wireless communications. However, in many papers neural networks are frequently tested by training and testing on one example channel or similar channels. This is because data-driven methods often degrade on…

Signal Processing · Electrical Eng. & Systems 2025-07-22 Dianxin Luan , John Thompson

Communicating and sharing intelligence among agents is an important facet of achieving Artificial General Intelligence. As a first step towards this challenge, we introduce a novel framework for image generation: Message Passing Multi-Agent…

Computer Vision and Pattern Recognition · Computer Science 2016-12-06 Arnab Ghosh , Viveka Kulharia , Vinay Namboodiri

The optimal decoder achieving the outage capacity under imperfect channel estimation is investigated. First, by searching into the family of nearest neighbor decoders, which can be easily implemented on most practical coded modulation…

Information Theory · Computer Science 2016-11-17 Pablo Piantanida , Sajad Sadough , Pierre Duhamel

Massive multiple-input multiple-output (M-MIMO) is an enabling technology of 5G wireless communication. The performance of an M-MIMO system is highly dependent on the speed and accuracy of obtaining the channel state information (CSI). The…

Signal Processing · Electrical Eng. & Systems 2018-04-19 Xiaozhen Liu , Jin Sha , Hongxiang Xie , Feifei Gao , Shi Jin , Zaichen Zhang , Xiaohu You , Chuan Zhang

An important class of distance metrics proposed for training generative adversarial networks (GANs) is the integral probability metric (IPM), in which the neural net distance captures the practical GAN training via two neural networks. This…

Machine Learning · Computer Science 2018-11-06 Kaiyi Ji , Yingbin Liang

Semantic communication is emerging as a key enabler for distributed edge intelligence due to its capability to convey task-relevant meaning. However, achieving communication-efficient training and robust inference over wireless links…

Machine Learning · Computer Science 2026-01-22 Hang Zhao , Hongru Li , Dongfang Xu , Shenghui Song , Khaled B. Letaief

We investigate the training and performance of generative adversarial networks using the Maximum Mean Discrepancy (MMD) as critic, termed MMD GANs. As our main theoretical contribution, we clarify the situation with bias in GAN loss…

Machine Learning · Statistics 2021-01-15 Mikołaj Bińkowski , Danica J. Sutherland , Michael Arbel , Arthur Gretton

We propose a higher-level associative memory for learning adversarial networks. Generative adversarial network (GAN) framework has a discriminator and a generator network. The generator (G) maps white noise (z) to data samples while the…

Machine Learning · Computer Science 2016-11-23 Tarik Arici , Asli Celikyilmaz

The rapid growth of digital devices and IoT has intensified the demand for collaborative learning. Since these devices generate sensitive and high-dimensional data, centralized transmission is often impractical, while local learning suffers…

Signal Processing · Electrical Eng. & Systems 2026-03-03 Nikola Stankovic

Variational mutual information (MI) estimators are widely used in unsupervised representation learning methods such as contrastive predictive coding (CPC). A lower bound on MI can be obtained from a multi-class classification problem, where…

Machine Learning · Computer Science 2020-12-04 Jiaming Song , Stefano Ermon

In large scale dynamic wireless networks, the amount of overhead caused by channel estimation (CE) is becoming one of the main performance bottlenecks. This is due to the large number users whose channels should be estimated, the user…

Information Theory · Computer Science 2022-04-19 Mohanad Obeed , Yasser Al-Eryani , Anas Chaaban

We study downlink (DL) channel estimation in a multi-cell Massive multiple-input multiple-output (MIMO) system operating in a time-division duplex. The users must know their effective channel gains to decode their received DL data signals.…

Information Theory · Computer Science 2021-09-07 Amin Ghazanfari , Trinh Van Chien , Emil Björnson , Erik G. Larsson

In network cooperation strategies, nodes work together with the aim of increasing transmission rates or reliability. This paper demonstrates that enabling cooperation between the transmitters of a two-user multiple access channel, via a…

Information Theory · Computer Science 2016-11-17 Parham Noorzad , Michelle Effros , Michael Langberg

In this paper, the problem of training optimization for estimating a multiple-input multiple-output (MIMO) flat fading channel in the presence of spatially and temporally correlated Gaussian noise is studied in an application-oriented…

A two-user symmetric Gaussian Interference Channel (IC) is considered in which a noiseless unidirectional link connects one encoder to the other. Having a constant capacity, the additional link provides partial cooperation between the…

Information Theory · Computer Science 2009-09-16 Hossein Bagheri , Abolfazl S. Motahari , Amir K. Khandani

Lip reading has received an increasing research interest in recent years due to the rapid development of deep learning and its widespread potential applications. One key point to obtain good performance for the lip reading task depends…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Xing Zhao , Shuang Yang , Shiguang Shan , Xilin Chen

In cognitive radio networks, the channel gain between primary transceivers, namely, primary channel gain, is crucial for a cognitive transmitter (CT) to control the transmit power and achieve spectrum sharing. Conventionally, the primary…

Information Theory · Computer Science 2016-11-29 Lin Zhang , Guodong Zhao , Wenli Zhou , Liying Li , Gang Wu , Ying-Chang Liang , Shaoqian Li