English
Related papers

Related papers: Robust Information Bottleneck for Task-Oriented Co…

200 papers

Semantic broadcast communications (Semantic BC) for image transmission have achieved significant performance gains for single-task scenarios. Nevertheless, extending these methods to multi-task scenarios remains challenging, as different…

Signal Processing · Electrical Eng. & Systems 2025-04-29 Zhilin Lu , Rongpeng Li , Zhifeng Zhao , Honggang Zhang

In typical multi-agent reinforcement learning (MARL) problems, communication is important for agents to share information and make the right decisions. However, due to the complexity of training multi-agent communication, existing methods…

Multiagent Systems · Computer Science 2025-05-01 Xuyan Ma , Yawen Wang , Junjie Wang , Xiaofei Xie , Boyu Wu , Shoubin Li , Fanjiang Xu , Qing Wang

Deep neural networks perform well on classification tasks where data streams are i.i.d. and labeled data is abundant. Challenges emerge with non-stationary training data streams such as continual learning. One powerful approach that has…

This work presents a novel robust beamforming design dedicated for dual-functional radar and communication (DFRC) base stations (BSs) in the context of integrated sensing and communications (ISAC). The architecture is intended for…

Signal Processing · Electrical Eng. & Systems 2023-03-15 Ahmad Bazzi , Marwa Chafii

Distributed multi-task learning (DMTL) effectively improves model generalization performance through the collaborative training of multiple related models. However, in large-scale learning scenarios, communication bottlenecks severely limit…

Information Theory · Computer Science 2025-07-25 Minquan Cheng , Yongkang Wang , Lingyu Zhang , Youlong Wu

The receiver design for multi-input multi-output (MIMO) ultra-reliable and low-latency communication (URLLC) systems can be a tough task due to the use of short channel codes and few pilot symbols. Consequently, error propagation can occur…

Signal Processing · Electrical Eng. & Systems 2024-04-12 Yi Sun , Hong Shen , Bingqing Li , Wei Xu , Pengcheng Zhu , Nan Hu , Chunming Zhao

We propose a joint source and channel coding (JSCC) technique for wireless image transmission that does not rely on explicit codes for either compression or error correction; instead, it directly maps the image pixel values to the…

Information Theory · Computer Science 2020-04-10 Eirina Bourtsoulatze , David Burth Kurka , Deniz Gunduz

The information bottleneck principle is an elegant and useful approach to representation learning. In this paper, we investigate the problem of representation learning in the context of reinforcement learning using the information…

Machine Learning · Computer Science 2019-11-14 Pei Yingjun , Hou Xinwen

In this paper, a generalization of deep learning-aided joint source channel coding (Deep-JSCC) approach to secure communications is studied. We propose an end-to-end (E2E) learning-based approach for secure communication against multiple…

Learning effective joint embedding for cross-modal data has always been a focus in the field of multimodal machine learning. We argue that during multimodal fusion, the generated multimodal embedding may be redundant, and the discriminative…

Machine Learning · Computer Science 2022-12-06 Sijie Mai , Ying Zeng , Haifeng Hu

Adversarial learning methods have been proposed for a wide range of applications, but the training of adversarial models can be notoriously unstable. Effectively balancing the performance of the generator and discriminator is critical,…

Machine Learning · Computer Science 2020-08-26 Xue Bin Peng , Angjoo Kanazawa , Sam Toyer , Pieter Abbeel , Sergey Levine

Semantic encoders and decoders for digital semantic communication (SC) often struggle to adapt to variations in unpredictable channel environments and diverse system designs. To address these challenges, this paper proposes a novel…

Signal Processing · Electrical Eng. & Systems 2025-03-20 Yongjeong Oh , Joohyuk Park , Jinho Choi , Jihong Park , Yo-Seb Jeon

Several self-supervised representation learning methods have been proposed for reinforcement learning (RL) with rich observations. For real-world applications of RL, recovering underlying latent states is crucial, particularly when sensory…

Split learning is a privacy-preserving distributed learning paradigm in which an ML model (e.g., a neural network) is split into two parts (i.e., an encoder and a decoder). The encoder shares so-called latent representation, rather than raw…

Machine Learning · Computer Science 2023-09-07 Omar Alhussein , Moshi Wei , Arashmid Akhavain

The goal of semantic communication is to surpass optimal Shannon's criterion regarding a notable problem for future communication which lies in the integration of collaborative efforts between the intelligence of the transmission source and…

Information Theory · Computer Science 2023-10-03 Xinchao Zhong , Sean Longyu Ma , Hong-fu Chou , Arsham Mostaani , Thang X. Vu , Symeon Chatzinotas

We propose deep learning based communication methods for adaptive-bandwidth transmission of images over wireless channels. We consider the scenario in which images are transmitted progressively in layers over time or frequency, and such…

Information Theory · Computer Science 2021-06-15 David Burth Kurka , Deniz Gündüz

Joint source-channel coding (JSCC) offers a promising avenue for enhancing transmission efficiency by jointly incorporating source and channel statistics into the system design. A key advancement in this area is the deep joint source and…

Information Theory · Computer Science 2025-07-22 Maojun Zhang , Haotian Wu , Guangxu Zhu , Richeng Jin , Xiaoming Chen , Deniz Gündüz

Reliably transmitting messages despite information loss due to a noisy channel is a core problem of information theory. One of the most important aspects of real world communication, e.g. via wifi, is that it may happen at varying levels of…

Machine Learning · Computer Science 2020-04-02 Karen Ullrich , Fabio Viola , Danilo Jimenez Rezende

Optimal transport has numerous applications, particularly in machine learning tasks involving generative models. In practice, the transportation process often encounters an information bottleneck, typically arising from the conversion of a…

Information Theory · Computer Science 2024-12-30 Xiqiang Qu , Ruibin Li , Jun Chen , Lei Yu , Xinbing Wang

Molecular Communications (MC) is a bio-inspired communication technique that uses molecules to encode and transfer information. Many efforts have been focused on developing new modulation techniques for MC by exploiting distinguishable…

Emerging Technologies · Computer Science 2022-05-27 M. Serkan Kopuzlu , M. Okan Araz , Ahmet R. Emirdagi , Murat Kuscu