English
Related papers

Related papers: Low-Rate Semantic Communication with Codebook-base…

200 papers

Semantic communication is focused on optimizing the exchange of information by transmitting only the most relevant data required to convey the intended message to the receiver and achieve the desired communication goal. For example, if we…

Information Theory · Computer Science 2024-02-05 Fatemeh Zahra Safaeipour , Morteza Hashemi

With the help of powerful generative models, Semantic Image Compression (SIC) has achieved impressive performance at ultra-low bitrate. However, due to coarse-grained visual-semantic alignment and inherent randomness, the reliability of SIC…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Chenhao Wu , Qingbo Wu , Haoran Wei , Shuai Chen , Mingzhou He , King Ngi Ngan , Fanman Meng , Hongliang Li

The surge in connected devices in 6G with typical complex tasks requiring multi-user cooperation, such as smart agriculture and smart cities, poses significant challenges to unsustainable traditional communication. Fortunately, the booming…

Networking and Internet Architecture · Computer Science 2025-02-24 Wanting Yang , Zehui Xiong , Shiwen Mao , Tony Q. S. Quek , Ping Zhang , Merouane Debbah , Rahim Tafazolli

A large number of annotated training images is crucial for training successful scene text recognition models. However, collecting sufficient datasets can be a labor-intensive and costly process, particularly for low-resource languages. To…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Yangchen Xie , Xinyuan Chen , Hongjian Zhan , Palaiahankote Shivakum , Bing Yin , Cong Liu , Yue Lu

Recent developments in Deep learning based Joint Source-Channel Coding (DeepJSCC) have demonstrated impressive capabilities within wireless semantic communications system. However, existing DeepJSCC methodologies exhibit limited…

Image and Video Processing · Electrical Eng. & Systems 2024-11-18 Liang Zhang , Danlan Huang , Xinyi Zhou , Feng Ding , Sheng Wu , Zhiqing Wei

Semantic communication (SemCom) has emerged as a promising technique for the next-generation communication systems, in which the generation at the receiver side is allowed with semantic features' recovery. However, the majority of existing…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Chengyang Liang , Dong Li

While semantic communication succeeds in efficiently transmitting due to the strong capability to extract the essential semantic information, it is still far from the intelligent or human-like communications. In this paper, we introduce an…

Signal Processing · Electrical Eng. & Systems 2023-03-23 Huiqiang Xie , Zhijin Qin , Geoffrey Ye Li

Foundation model-based semantic transmission has recently shown great potential in wireless image communication. However, existing methods exhibit two major limitations: (i) they overlook the varying importance of semantic components for…

Image and Video Processing · Electrical Eng. & Systems 2025-09-30 Fangyu Liu , Peiwen Jiang , Wenjin Wang , Chao-Kai Wen , Shi Jin , Jun Zhang

Semantic communication (SC) can achieve superior coding and transmission performance based on the knowledge contained in the semantic knowledge base (KB). However, conventional KBs consist of source KBs and channel KBs, which are often…

Signal Processing · Electrical Eng. & Systems 2026-04-08 Wuxia Hu , Caili Guo , Yang Yang , Chunyan Feng , Kuiyuan Ding , Shiwen Mao

While traditional and neural video codecs (NVCs) have achieved remarkable rate-distortion performance, improving perceptual quality at low bitrates remains challenging. Some NVCs incorporate perceptual or adversarial objectives but still…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Naifu Xue , Zhaoyang Jia , Jiahao Li , Bin Li , Zihan Zheng , Yuan Zhang , Yan Lu

Data-driven semantic communication is based on superficial statistical patterns, thereby lacking interpretability and generalization, especially for applications with the presence of unseen data. To address these challenges, we propose a…

Machine Learning · Computer Science 2025-07-04 Zhaoyu Zhang , Lingyi Wang , Wei Wu , Fuhui Zhou , Qihui Wu

With the rapid growth of multimedia data volume, there is an increasing need for efficient video transmission in applications such as virtual reality and future video streaming services. Semantic communication is emerging as a vital…

Image and Video Processing · Electrical Eng. & Systems 2025-02-18 Qiyuan Du , Yiping Duan , Qianqian Yang , Xiaoming Tao , Mérouane Debbah

Task-oriented semantic communication enhances transmission efficiency by conveying semantic information rather than exact messages. Deep learning (DL)-based semantic communication can effectively cultivate the essential semantic knowledge…

Machine Learning · Computer Science 2025-05-27 Run Gu , Wei Xu , Zhaohui Yang , Dusit Niyato , Aylin Yener

Semantic communications learned on background knowledge bases (KBs) have been identified as a promising technology for communications between intelligent agents. Existing works assume that transceivers of semantic communications share the…

Networking and Internet Architecture · Computer Science 2023-01-10 Yanhu Wang , Shuaishuai Guo

Integrating speech understanding and generation is a pivotal step toward building unified speech models. However, the different representations required for these two tasks currently pose significant compatibility challenges. Typically,…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-08 Guanrou Yang , Tian Tan , Qian Chen , Zhikang Niu , Yakun Song , Ziyang Ma , Yushen Chen , Zeyu Xie , Tianrui Wang , Yifan Yang , Wenxi Chen , Qi Chen , Wenrui Liu , Shan Yang , Xie Chen

Recent advances in video generation techniques have given rise to an emerging paradigm of generative video coding for Ultra-Low Bitrate (ULB) scenarios by leveraging powerful generative priors. However, most existing methods are limited by…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Zhitao Wang , Hengyu Man , Wenrui Li , Xingtao Wang , Xiaopeng Fan , Debin Zhao

Semantic communication (SemCom) demonstrates strong superiority over conventional bit-level accurate transmission, by only attempting to recover the essential semantic information of data. In this paper, in order to tackle the…

Information Theory · Computer Science 2023-10-02 Siyu Tong , Xiaoxue Yu , Rongpeng Li , Kun Lu , Zhifeng Zhao , Honggang Zhang

Multimodal semantic communication has great potential to enhance downstream task performance by integrating complementary information across modalities. This paper introduces ProMSC-MIS, a novel Prompt-based Multimodal Semantic…

Multimedia · Computer Science 2025-08-28 Haoshuo Zhang , Yufei Bo , Meixia Tao

In this paper, we propose a new wireless video communication scheme to achieve high-efficiency video transmission over noisy channels. It exploits the idea of model division multiple access (MDMA) and extracts common semantic features…

Multimedia · Computer Science 2023-05-26 Zhicheng Bao , Haotai Liang , Chen Dong , Xiaodong Xu , Geng Liu

The importance of Radio Access Network (RAN) in support Artificial Intelligence (AI) application services has grown significantly, underscoring the need for an integrated approach that considers not only network efficiency but also AI…

Systems and Control · Electrical Eng. & Systems 2025-08-19 Jinhyuk Choi , Jihong Park , Seungeun Oh , Seong-Lyun Kim