English
Related papers

Related papers: Multi-Modal Semantic Communication

200 papers

Multi-task semantic communication can serve multiple learning tasks using a shared encoder model. Existing models have overlooked the intricate relationships between features extracted during an encoding process of tasks. This paper…

Machine Learning · Computer Science 2025-01-07 Xi Yu , Tiejun Lv , Weicai Li , Wei Ni , Dusit Niyato , Ekram Hossain

Semantic communication (SemCom) aims to enhance the resource efficiency of next-generation networks by transmitting the underlying meaning of messages, focusing on information relevant to the end user. Existing literature on SemCom…

Networking and Internet Architecture · Computer Science 2025-04-30 Nasrin Gholami , Neda Moghim , Behrouz Shahgholi Ghahfarokhi , Pouyan Salavati , Christo Kurisummoottil Thomas , Sachin Shetty , Tahereh Rahmati

Cooperative perception, which has a broader perception field than single-vehicle perception, has played an increasingly important role in autonomous driving to conduct 3D object detection. Through vehicle-to-vehicle (V2V) communication…

Information Theory · Computer Science 2023-11-14 Yucheng Sheng , Hao Ye , Le Liang , Shi Jin , Geoffrey Ye Li

Visual transformers have driven major progress in remote sensing image analysis, particularly in object detection and segmentation. Recent vision-language and multimodal models further extend these capabilities by incorporating auxiliary…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yu Li , Guilherme N. DeSouza , Praveen Rao , Chi-Ren Shyu

Deep learning enabled semantic communications have shown great potential to significantly improve transmission efficiency and alleviate spectrum scarcity, by effectively exchanging the semantics behind the data. Recently, the emergence of…

Signal Processing · Electrical Eng. & Systems 2024-03-20 Huiqiang Xie , Zhijin Qin , Xiaoming Tao , Zhu Han

The task-oriented semantic communication systems have achieved significant performance gain, however, the paradigm that employs a model for a specific task might be limited, since the system has to be updated once the task is changed or…

Signal Processing · Electrical Eng. & Systems 2022-06-02 Guangyi Zhang , Qiyu Hu , Zhijin Qin , Yunlong Cai , Guanding Yu

Semantic communications are expected to improve the transmission efficiency in Internet of Things (IoT) networks. However, the distributed nature of networks and heterogeneity of devices challenge the secure utilization of semantic…

Signal Processing · Electrical Eng. & Systems 2024-12-12 Weihao Zeng , Xinyu Xu , Qianyun Zhang , Jiting Shi , Zhenyu Guan , Shufeng Li , Zhijin Qin

Semantic communication has emerged as a promising paradigm for next-generation wireless systems, improving the communication efficiency by transmitting high-level semantic features. However, reliance on unimodal representations can degrade…

Signal Processing · Electrical Eng. & Systems 2025-09-11 Haoran Chang , Mingzhe Chen , Huaxia Wang , Qianqian Zhang

The rapid advancement of generative artificial intelligence has spurred innovative approaches to semantic communication, giving rise to a new paradigm known as generative semantic communication (GSC). The integration of flexible cross-modal…

Signal Processing · Electrical Eng. & Systems 2025-11-03 Yiru Wang , Wanting Yang , Fangli Mou , Zehui Xiong , Zide Fan , Shiwen Mao , Tony Q. S. Quek

Task-oriented semantic communication is an emerging technology that transmits only the relevant semantics of a message instead of the whole message to achieve a specific task. It reduces latency, compresses the data, and is more robust in…

Networking and Internet Architecture · Computer Science 2024-03-21 Eslam Eldeeb , Mohammad Shehab , Hirley Alves

Establishing correspondences between images remains a challenging task, especially under large appearance changes due to different viewpoints or intra-class variations. In this work, we introduce a strong semantic image matching learner,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Seungwook Kim , Juhong Min , Minsu Cho

Multi-label image and video classification are fundamental yet challenging tasks in computer vision. The main challenges lie in capturing spatial or temporal dependencies between labels and discovering the locations of discriminative…

Computer Vision and Pattern Recognition · Computer Science 2020-03-30 Renchun You , Zhiyao Guo , Lei Cui , Xiang Long , Yingze Bao , Shilei Wen

Foundation model-based semantic transmission has recently shown great potential in wireless image communication. However, existing methods exhibit two major limitations: (i) they overlook the varying importance of semantic components for…

Image and Video Processing · Electrical Eng. & Systems 2025-09-30 Fangyu Liu , Peiwen Jiang , Wenjin Wang , Chao-Kai Wen , Shi Jin , Jun Zhang

In the evolving landscape of 6G networks, semantic communications are poised to revolutionize data transmission by prioritizing the transmission of semantic meaning over raw data accuracy. This paper presents a Vision Transformer…

Image and Video Processing · Electrical Eng. & Systems 2025-03-24 Muhammad Ahmed Mohsin , Muhammad Jazib , Zeeshan Alam , Muhmmad Farhan Khan , Muhammad Saad , Muhammad Ali Jamshed

Semantic communication is a new paradigm that exploits deep learning models to enable end-to-end communications processes, and recent studies have shown that it can achieve better noise resiliency compared with traditional communication…

Signal Processing · Electrical Eng. & Systems 2023-06-28 Wenyu Zhang , Kaiyuan Bai , Sherali Zeadally , Haijun Zhang , Hua Shao , Hui Ma , Victor C. M. Leung

In the realm of semantic communication, the significance of encoded features can vary, while wireless channels are known to exhibit fluctuations across multiple subchannels in different domains. Consequently, critical features may traverse…

Signal Processing · Electrical Eng. & Systems 2024-01-29 Kequan Zhou , Guangyi Zhang , Yunlong Cai , Qiyu Hu , Guanding Yu , A. Lee Swindlehurst

Semantic communication is viewed as a revolutionary paradigm that can potentially transform how we design and operate wireless communication systems. However, despite a recent surge of research activities in this area, the research…

Artificial Intelligence · Computer Science 2022-11-29 Christina Chaccour , Walid Saad , Merouane Debbah , Zhu Han , H. Vincent Poor

Semantic-aware communication is a novel paradigm that draws inspiration from human communication focusing on the delivery of the meaning of messages. It has attracted significant interest recently due to its potential to improve the…

Networking and Internet Architecture · Computer Science 2023-09-06 Yong Xiao , Yiwei Liao , Yingyu Li , Guangming Shi , H. Vincent Poor , Walid Saad , Merouane Debbah , Mehdi Bennis

As a paradigm shift towards pervasive intelligence, semantic communication (SemCom) has shown great potentials to improve communication efficiency and provide user-centric services by delivering task-oriented semantic meanings. However, the…

Signal Processing · Electrical Eng. & Systems 2025-05-02 Hao Wei , Wen Wang , Wanli Ni , Wenjun Xu , Yongming Huang , Dusit Niyato , Ping Zhang

The exponential growth of wireless users and bandwidth constraints necessitates innovative communication paradigms for next-generation networks. Semantic Communication (SemCom) emerges as a promising solution by transmitting extracted…

Signal Processing · Electrical Eng. & Systems 2026-05-06 Ishtiaque Ahmed , Yingzhuo Sun , Jingwen Fu , Alper Kose , Leila Musavian , Ming Xiao , Berna Ozbek