English
Related papers

Related papers: Cross-Modal Generative Semantic Communications for…

200 papers

Semantic communication is poised to play a pivotal role in shaping the landscape of future AI-driven communication systems. Its challenge of extracting semantic information from the original complex content and regenerating semantically…

Machine Learning · Computer Science 2023-09-07 Eleonora Grassucci , Yuki Mitsufuji , Ping Zhang , Danilo Comminiello

Large-scale distributed training requires significant communication bandwidth for gradient exchange that limits the scalability of multi-node training, and requires expensive high-bandwidth network infrastructure. The situation gets even…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Yujun Lin , Song Han , Huizi Mao , Yu Wang , William J. Dally

Learning-based semantic communication (SemCom) has recently emerged as a promising paradigm for improving the transmission efficiency of wireless networks. However, existing methods typically rely on extensive end-to-end training, which is…

Information Theory · Computer Science 2026-03-19 Shunpu Tang , Qianqian Yang , Jihong Park , Zhaoyang Zhang , Kaibin Huang , Deniz Gunduz

Multimodal semantic communication has gained widespread attention due to its ability to enhance downstream task performance. A key challenge in such systems is the effective fusion of features from different modalities, which requires the…

Image and Video Processing · Electrical Eng. & Systems 2025-09-03 Haoshuo Zhang , Yufei Bo , Hongwei Zhang , Meixia Tao

Semantic communication (SemCom) aims to convey the intended meaning of messages rather than merely transmitting bits, thereby offering greater efficiency and robustness, particularly in resource-constrained or noisy environments. In this…

Information Theory · Computer Science 2025-07-08 Chengyang Liang , Dong Li

Satellite-ground semantic communication (SemCom) is expected to play a pivotal role in convergence of communication and AI (ComAI), particularly in enabling intelligent and efficient multi-user data transmission. However, the inherent…

Signal Processing · Electrical Eng. & Systems 2026-01-27 Hui Cao , Rui Meng , Shujun Han , Song Gao , Xiaodong Xu , Ping Zhang

Generative joint source-channel coding (GJSCC) has emerged as a new Deep JSCC paradigm for achieving high-fidelity and robust image transmission under extreme wireless channel conditions, such as ultra-low bandwidth and low signal-to-noise…

Image and Video Processing · Electrical Eng. & Systems 2026-01-07 Kailin Tan , Jincheng Dai , Sixian Wang , Guo Lu , Shuo Shao , Kai Niu , Wenjun Zhang , Ping Zhang

In next-generation wireless networks, supporting real-time applications such as augmented reality, autonomous driving, and immersive Metaverse services demands stringent constraints on bandwidth, latency, and reliability. Existing semantic…

Networking and Internet Architecture · Computer Science 2025-05-30 Guangyuan Liu , Yinqiu Liu , Jiacheng Wang , Hongyang Du , Dusit Niyato , Jiawen Kang , Zehui Xiong , Abbas Jamalipour

Semantic communications has received growing interest since it can remarkably reduce the amount of data to be transmitted without missing critical information. Most existing works explore the semantic encoding and transmission for text and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Danlan Huang , Feifei Gao , Xiaoming Tao , Qiyuan Du , Jianhua Lu

With the rapid evolution of AI Generated Content (AIGC), forged images produced through this technology are inherently more deceptive and require less human intervention compared to traditional Computer-generated Graphics (CG). However,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Ziyi Xi , Wenmin Huang , Kangkang Wei , Weiqi Luo , Peijia Zheng

AI-Generated Content (AIGC), as a novel manner of providing Metaverse services in the forthcoming Internet paradigm, can resolve the obstacles of immersion requirements. Concurrently, edge computing, as an evolutionary paradigm of computing…

Artificial Intelligence · Computer Science 2024-03-26 Yitong Wang , Chang Liu , Jun Zhao

In this paper, we propose a novel design for AI-native goal-oriented communications, exploiting transformer neural networks under dynamic inference constraints on bandwidth and computation. Transformers have become the standard architecture…

Information Theory · Computer Science 2024-05-07 Alessio Devoto , Simone Petruzzi , Jary Pomponi , Paolo Di Lorenzo , Simone Scardapane

Semantic communication (SemCom) with learned encoder-decoder architectures enables end-to-end learning of compact task-oriented representations optimized for the wireless channel, reducing channel resources needed to convey task-relevant…

Information Theory · Computer Science 2026-05-08 Yalin E. Sagduyu , Tugba Erpek

This paper proposes a novel Semantic Communication (SemCom) framework for real-time adaptive-bitrate video streaming by integrating Latent Diffusion Models (LDMs) within the FFmpeg techniques. This solution addresses the challenges of high…

Multimedia · Computer Science 2025-08-04 Zijiang Yan , Jianhua Pei , Hongda Wu , Hina Tabassum , Ping Wang

The next generation of Internet services, such as Metaverse, rely on mixed reality (MR) technology to provide immersive user experiences. However, the limited computation power of MR headset-mounted devices (HMDs) hinders the deployment of…

Signal Processing · Electrical Eng. & Systems 2023-06-29 Hongyang Du , Jiacheng Wang , Dusit Niyato , Jiawen Kang , Zehui Xiong , Dong In Kim

Artificial Intelligence-Generated Content (AIGC) is an automated method for generating, manipulating, and modifying valuable and diverse data using AI algorithms creatively. This survey paper focuses on the deployment of AIGC applications,…

Networking and Internet Architecture · Computer Science 2023-11-01 Minrui Xu , Hongyang Du , Dusit Niyato , Jiawen Kang , Zehui Xiong , Shiwen Mao , Zhu Han , Abbas Jamalipour , Dong In Kim , Xuemin Shen , Victor C. M. Leung , H. Vincent Poor

6G networks promise revolutionary immersive communication experiences including augmented reality (AR), virtual reality (VR), and holographic communications. These applications demand high-dimensional multimodal data transmission and…

Machine Learning · Computer Science 2025-07-08 Yusong Zhang , Yuxuan Sun , Lei Guo , Wei Chen , Bo Ai , Deniz Gunduz

Due to the black-box characteristics of deep learning based semantic encoders and decoders, finding a tractable method for the performance analysis of semantic communications is a challenging problem. In this paper, we propose an…

Machine Learning · Computer Science 2025-05-01 Shuai Ma , Bin Shen , Chuanhui Zhang , Youlong Wu , Hang Li , Shiyin Li , Guangming Shi , Naofal Al-Dhahir

The growing integration of distributed integrated sensing and communication (ISAC) with closed-loop control in intelligent networks demands efficient information transmission under stringent bandwidth constraints. To address this challenge,…

Systems and Control · Electrical Eng. & Systems 2025-12-26 Guangjin Pan , Ayça Özçelikkale , Christian Häger , Musa Furkan Keskin , Henk Wymeersch

Recent advances in deep learning-based joint source-channel coding (DJSCC) have shown promise for end-to-end semantic image transmission. However, most existing schemes primarily focus on optimizing pixel-wise metrics, which often fail to…

Signal Processing · Electrical Eng. & Systems 2024-12-24 Pujing Yang , Guangyi Zhang , Yunlong Cai