English
Related papers

Related papers: Multi-Modal Semantic Communication

200 papers

3D semantic maps have played an increasingly important role in high-precision robot localization and scene understanding. However, real-time construction of semantic maps requires mobile edge devices with extremely high computing power,…

Robotics · Computer Science 2024-12-03 Jiaxing Zhang , Luosong Guo , Kun Zhu , Houming Qiu

Traditional single-modality sensing faces limitations in accuracy and capability, and its decoupled implementation with communication systems increases latency in bandwidth-constrained environments. Additionally, single-task-oriented…

Machine Learning · Computer Science 2025-03-13 Yubo Peng , Luping Xiang , Kun Yang , Feibo Jiang , Kezhi Wang , Dapeng Oliver Wu

Semantic communication has become a popular research area due its high spectrum efficiency and error-correction performance. Some studies use deep learning to extract semantic features, which usually form end-to-end semantic communication…

Signal Processing · Electrical Eng. & Systems 2022-10-04 Peiwen Jiang , Chao-Kai Wen , Shi Jin , Geoffrey Ye Li

Semantic communication (SemCom) powered by generative artificial intelligence enables highly efficient and reliable information transmission. However, it still necessitates the transmission of substantial amounts of data when dealing with…

Information Theory · Computer Science 2025-06-17 Guojun Huang , Jiancheng An , Lu Gan , Dusit Niyato , Mérouane Debbah , Tie Jun Cui

This work presents a novel semantic transmission framework in wireless networks, leveraging the joint processing technique. Our framework enables multiple cooperating base stations to efficiently transmit semantic information to multiple…

Information Theory · Computer Science 2024-01-03 Xumin Pu , Tiantian Lei , Wanli Wen , Qianbin Chen

Semantic communication is an emerging paradigm that focuses on understanding and delivering semantics, or meaning of messages. Most existing semantic communication solutions define semantic meaning as the meaning of object labels recognized…

Networking and Internet Architecture · Computer Science 2022-03-17 Jingming Liang , Yong Xiao , Yingyu Li , Guangming Shi , Mehdi Bennis

With the rapid growth of intelligent services, communication targets are shifting from humans to artificial intelligent (AI) agents, which require new paradigms to enable real-time perception, decision-making, and collaboration. Semantic…

Artificial Intelligence · Computer Science 2025-10-02 Kaiwen Yu , Mengying Sun , Zhijin Qin , Xiaodong Xu , Ping Yang , Yue Xiao , Gang Wu

Semantic communication has gained attention as a key enabler for intelligent and context-aware communication. However, one of the key challenges of semantic communications is the need to tailor the resource allocation to meet the specific…

Information Theory · Computer Science 2024-01-22 Ouiame Marnissi , Hajar EL Hammouti , El Houcine Bergou

Communication systems to date primarily aim at reliably communicating bit sequences. Such an approach provides efficient engineering designs that are agnostic to the meanings of the messages or to the goal that the message exchange aims to…

Semantic communication (SemCom) aims to convey the meaning behind a transmitted message by transmitting only semantically-relevant information. This semantic-centric design helps to minimize power usage, bandwidth consumption, and…

Signal Processing · Electrical Eng. & Systems 2023-04-26 Tilahun M. Getu , Georges Kaddoum , Mehdi Bennis

Semantic communications offer promising prospects for enhancing data transmission efficiency. However, existing schemes have predominantly concentrated on point-to-point transmissions. In this paper, we aim to investigate the validity of…

Signal Processing · Electrical Eng. & Systems 2024-06-26 Yanhu Wang , Shuaishuai Guo , Anming Dong , Hui Zhao

The growing demands of artificial intelligence and immersive media require communication beyond bit-level accuracy to meaning awareness. Conventional optical systems that focused on syntactic precision suffer significant inefficiencies.…

Multimodal semantic communication has gained widespread attention due to its ability to enhance downstream task performance. A key challenge in such systems is the effective fusion of features from different modalities, which requires the…

Image and Video Processing · Electrical Eng. & Systems 2025-09-03 Haoshuo Zhang , Yufei Bo , Hongwei Zhang , Meixia Tao

While semantic communications have shown the potential in the case of single-modal single-users, its applications to the multi-user scenario remain limited. In this paper, we investigate deep learning (DL) based multi-user semantic…

Signal Processing · Electrical Eng. & Systems 2021-12-21 Huiqiang Xie , Zhijin Qin , Xiaoming Tao , Khaled B. Letaief

Semantic communication is an increasingly popular framework for wireless image transmission due to its high communication efficiency. With the aid of the joint-source-and-channel (JSC) encoder implemented by neural network, semantic…

Information Theory · Computer Science 2022-12-02 Maojun Zhang , Yang Li , Zezhong Zhang , Guangxu Zhu , Caijun Zhong

Semantic communications have gained significant attention as a promising approach to address the transmission bottleneck, especially with the continuous development of 6G techniques. Distinct from the well investigated physical channel…

Signal Processing · Electrical Eng. & Systems 2024-03-15 Xiang Peng , Zhijin Qin , Xiaoming Tao , Jianhua Lu , Khaled B. Letaief

Sensing and communication are fundamental enablers of next-generation networks. While communication technologies have advanced significantly, sensing remains limited to conventional parameter estimation and is far from fully explored.…

Signal Processing · Electrical Eng. & Systems 2026-04-01 Xiaoqi Zhang , J. Andrew Zhang , Chang Liu , Weijie Yuan , Geoffrey Ye Li , Moeness G. Amin

As digital technologies advance, communication networks face challenges in handling the vast data generated by intelligent devices. Autonomous vehicles, smart sensors, and IoT systems necessitate new paradigms. This thesis addresses these…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Francesco Pezone

Metaverse over wireless networks is an emerging use case of the sixth generation (6G) wireless systems, posing unprecedented challenges in terms of its multi-modal data transmissions with stringent latency and reliability requirements.…

Networking and Internet Architecture · Computer Science 2022-12-15 Jihong Park , Jinho Choi , Seong-Lyun Kim , Mehdi Bennis

Semantic communication has gained significant attention from researchers as a promising technique to replace conventional communication in the next generation of communication systems, primarily due to its ability to reduce communication…

Information Theory · Computer Science 2025-02-07 Loc X. Nguyen , Ye Lin Tun , Yan Kyaw Tun , Minh N. H. Nguyen , Chaoning Zhang , Zhu Han , Choong Seon Hong