English
Related papers

Related papers: Low-Rate Semantic Communication with Codebook-base…

200 papers

Semantic communications, aiming at ensuring the successful delivery of the meaning of information, are expected to be one of the potential techniques for the next generation communications. However, the knowledge forming and synchronizing…

Image and Video Processing · Electrical Eng. & Systems 2024-01-17 Yuan Zheng , Fengyu Wang , Wenjun Xu , Miao Pan , Ping Zhang

This paper develops an edge-device collaborative Generative Semantic Communications (Gen SemCom) framework leveraging pre-trained Multi-modal/Vision Language Models (M/VLMs) for ultra-low-rate semantic communication via textual prompts. The…

Information Theory · Computer Science 2025-05-05 Mengmeng Ren , Li Qiao , Long Yang , Zhen Gao , Jian Chen , Mahdi Boloursaz Mashhadi , Pei Xiao , Rahim Tafazolli , Mehdi Bennis

Recently, learning-based semantic communication (SemCom) has emerged as a promising approach in the upcoming 6G network and researchers have made remarkable efforts in this field. However, existing works have yet to fully explore the…

Signal Processing · Electrical Eng. & Systems 2024-04-01 Shunpu Tang , Qianqian Yang , Deniz Gündüz , Zhaoyang Zhang

While recent neural codecs achieve strong performance at low bitrates when optimized for perceptual quality, their effectiveness deteriorates significantly under ultra-low bitrate conditions. To mitigate this, generative compression methods…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Chuqin Zhou , Xiaoyue Ling , Yunuo Chen , Jincheng Dai , Guo Lu , Wenjun Zhang

Semantic communications is considered as a promising technology to increase the efficiency of next-generation communication systems, particularly targeting human-machine and machine-type communications. In contrast to the source-agnostic…

Information Theory · Computer Science 2023-07-20 Jialong Xu , Tze-Yang Tung , Bo Ai , Wei Chen , Yuxuan Sun , Deniz Gunduz

Ubiquitous image transmission in emerging applications brings huge overheads to limited wireless resources. Since that text has the characteristic of conveying a large amount of information with very little data, the transmission of the…

Multimedia · Computer Science 2024-09-26 Xinfeng Wei , Haonan Tong , Nuocheng Yang , Changchuan Yin

Semantic communication is widely touted as a key technology for propelling the sixth-generation (6G) wireless networks. However, providing effective semantic representation is quite challenging in practice. To address this issue, this…

Information Theory · Computer Science 2024-06-18 Jinke Ren , Zezhong Zhang , Jie Xu , Guanying Chen , Yaping Sun , Ping Zhang , Shuguang Cui

Generative foundation models can revolutionize the design of semantic communication (SemCom) systems allowing high fidelity exchange of semantic information at ultra low rates. In this work, a generative SemCom framework with pretrained…

Signal Processing · Electrical Eng. & Systems 2025-01-15 Chunmei Xu , Mahdi Boloursaz Mashhadi , Yi Ma , Rahim Tafazolli , Jiangzhou Wang

Deep learning (DL) based semantic communication methods have been explored to transmit images efficiently in recent years. In this paper, we propose a generative model based semantic communication to further improve the efficiency of image…

Image and Video Processing · Electrical Eng. & Systems 2022-11-21 Tianxiao Han , Jiancheng Tang , Qianqian Yang , Yiping Duan , Zhaoyang Zhang , Zhiguo Shi

Conventional communication systems, including both separation-based coding and AI-driven joint source-channel coding (JSCC), are largely guided by Shannon's rate-distortion theory. However, relying on generic distortion metrics fails to…

Information Theory · Computer Science 2026-01-21 Tong Wu , Zhiyong Chen , Guo Lu , Li Song , Feng Yang , Meixia Tao , Wenjun Zhang

Most existing semantic communication systems employ analog modulation, which is incompatible with modern digital communication systems. Although several digital transmission approaches have been proposed to address this issue, an end-to-end…

Image and Video Processing · Electrical Eng. & Systems 2025-10-31 Haoshuo Zhang , Yufei Bo , Jianhua Mo , Meixia Tao

Existing speech semantic communication systems mainly based on Joint Source-Channel Coding (JSCC) architectures have demonstrated impressive performance, but their effectiveness remains limited by model structures specifically designed for…

Sound · Computer Science 2025-12-05 Yun Tian , Zhijin Qin , Guocheng Lv , Ye Jin , Kaibin Huang , Zhu Han

Most existing image compression approaches perform transform coding in the pixel space to reduce its spatial redundancy. However, they encounter difficulties in achieving both high-realism and high-fidelity at low bitrate, as the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Zhaoyang Jia , Jiahao Li , Bin Li , Houqiang Li , Yan Lu

Advancements in text-to-image generative AI with large multimodal models are spreading into the field of image compression, creating high-quality representation of images at extremely low bit rates. This work introduces novel components to…

Image and Video Processing · Electrical Eng. & Systems 2025-06-02 Cheng-Lin Wu , Hyomin Choi , Ivan V. Bajić

Deep learning based semantic communication (DeepSC) system has emerged as a promising paradigm for efficient wireless transmission. However, existing image DeepSC methods, frequently encounter challenges in balancing rate-distortion…

Image and Video Processing · Electrical Eng. & Systems 2025-12-08 Yinhuan Huang , Zhijin Qin

Underwater communication is essential for environmental monitoring, marine biology research, and underwater exploration. Traditional underwater communication faces limitations like low bandwidth, high latency, and susceptibility to noise,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Weilong Chen , Wenxuan Xu , Haoran Chen , Xinran Zhang , Zhijin Qin , Yanru Zhang , Zhu Han

Supported by powerful generative models, low-bitrate learned image compression (LIC) models utilizing perceptual metrics have become feasible. Some of the most advanced models achieve high compression rates and superior perceptual quality…

Image and Video Processing · Electrical Eng. & Systems 2024-11-21 Shimon Murai , Heming Sun , Jiro Katto

With the recent advancements in edge artificial intelligence (AI), future sixth-generation (6G) networks need to support new AI tasks such as classification and clustering apart from data recovery. Motivated by the success of deep learning,…

Networking and Internet Architecture · Computer Science 2023-04-06 Zhonghao Lyu , Guangxu Zhu , Jie Xu , Bo Ai , Shuguang Cui

Semantic Communication (SC) is a novel paradigm for data transmission in 6G. However, there are several challenges posed when performing SC in 3D scenarios: 1) 3D semantic extraction; 2) Latent semantic redundancy; and 3) Uncertain channel…

Information Theory · Computer Science 2024-03-12 Feibo Jiang , Yubo Peng , Li Dong , Kezhi Wang , Kun Yang , Cunhua Pan , Xiaohu You

Semantic communication is an increasingly popular framework for wireless image transmission due to its high communication efficiency. With the aid of the joint-source-and-channel (JSC) encoder implemented by neural network, semantic…

Information Theory · Computer Science 2022-12-02 Maojun Zhang , Yang Li , Zezhong Zhang , Guangxu Zhu , Caijun Zhong