English
Related papers

Related papers: Multi-Modal Semantic Communication

200 papers

Multimodal semantic communication has great potential to enhance downstream task performance by integrating complementary information across modalities. This paper introduces ProMSC-MIS, a novel Prompt-based Multimodal Semantic…

Multimedia · Computer Science 2025-08-28 Haoshuo Zhang , Yufei Bo , Meixia Tao

Semantic communication represents a promising technique towards reducing communication costs, especially when dealing with image segmentation, but it still lacks a balance between computational efficiency and bandwidth requirements while…

Networking and Internet Architecture · Computer Science 2025-07-22 Ebrahim Abu-Helalah , Jordi Serra , Jordi Perez-Romero

Achieving more powerful semantic representations and semantic understanding is one of the key problems in improving the performance of semantic communication systems. This work focuses on enhancing the semantic understanding of the text…

Signal Processing · Electrical Eng. & Systems 2025-04-03 Mengli Tao , Jiancun Fan , Jie Luo , Huiqiang Xie

Semantic communication focuses on conveying the task-relevant meaning rather than exact bitwise recovery. For image transmission with a generative receiver, relying only on text descriptions can be insufficient to preserve instance-specific…

Information Theory · Computer Science 2026-01-27 Xuesong Wang , Xinyan Xie , Mo Li , Zhaoqian Liu

Deep learning (DL) based semantic communication methods have been explored for the efficient transmission of images, text, and speech in recent years. In contrast to traditional wireless communication methods that focus on the transmission…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-26 Tianxiao Han , Qianqian Yang , Zhiguo Shi , Shibo He , Zhaoyang Zhang

Semantic communications could improve the transmission efficiency significantly by exploring the semantic information. In this paper, we make an effort to recover the transmitted speech signals in the semantic communication systems, which…

Signal Processing · Electrical Eng. & Systems 2021-09-09 Zhenzi Weng , Zhijin Qin

Semantic communication, an intelligent communication paradigm that aims to transmit useful information in the semantic domain, is facilitated by deep learning techniques. Robust semantic features can be learned and transmitted in an analog…

Signal Processing · Electrical Eng. & Systems 2024-01-05 Lei Guo , Wei Chen , Yuxuan Sun , Bo Ai

Semantic communications has received growing interest since it can remarkably reduce the amount of data to be transmitted without missing critical information. Most existing works explore the semantic encoding and transmission for text and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Danlan Huang , Feifei Gao , Xiaoming Tao , Qiyuan Du , Jianhua Lu

Recent advancements in generative artificial intelligence have introduced groundbreaking approaches to innovating next-generation semantic communication, which prioritizes conveying the meaning of a message rather than merely transmitting…

Artificial Intelligence · Computer Science 2025-05-19 Achintha Wijesinghe , Weiwei Wang , Suchinthaka Wanninayaka , Songyang Zhang , Zhi Ding

Semantic communication has emerged as a promising approach for improving efficient transmission in the next generation of wireless networks. Inspired by the success of semantic communication in different areas, we aim to provide a new…

Image and Video Processing · Electrical Eng. & Systems 2023-12-11 Zhenguo Zhang , Qianqian Yang , Shibo He , Jiming Chen

Traditional joint source-channel coding employs static learned semantic representations that cannot dynamically adapt to evolving source distributions. Shared semantic memories between transmitter and receiver can potentially enable…

Signal Processing · Electrical Eng. & Systems 2025-11-14 Karim Nasreddine , Christo Kurisummoottil Thomas , Walid Saad

Semantic communications have been utilized to execute numerous intelligent tasks by transmitting task-related semantic information instead of bits. In this article, we propose a semantic-aware speech-to-text transmission system for the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-08 Zhenzi Weng , Zhijin Qin , Huiqiang Xie , Xiaoming Tao , Khaled B. Letaief

We propose semantic communication over wireless channels for various modalities, e.g., text and images, in a task-oriented communications setup where the task is classification. We present two approaches based on memory and learning. Both…

Information Theory · Computer Science 2024-02-01 Emrecan Kutay , Aylin Yener

Recently, semantic communications are envisioned as a key enabler of future 6G networks. Back to Shannon's information theory, the goal of communication has long been to guarantee the correct reception of transmitted messages irrespective…

Information Theory · Computer Science 2021-10-18 Mohamed Sana , Emilio Calvanese Strinati

The rapid development of generative artificial intelligence (AI) has introduced significant opportunities for enhancing the efficiency and accuracy of image transmission within semantic communication systems. Despite these advancements,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Qiyu Ma , Wanli Ni , Zhijin Qin

Existing deep learning-enabled semantic communication systems often rely on shared background knowledge between the transmitter and receiver that includes empirical data and their associated semantic information. In practice, the semantic…

Information Theory · Computer Science 2022-10-19 Hongwei Zhang , Shuo Shao , Meixia Tao , Xiaoyan Bi , Khaled B. Letaief

Deep learning (DL) based semantic communication methods have been explored for the efficient transmission of images, text, and speech in recent years. In contrast to traditional wireless communication methods that focus on the transmission…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-08 Tianxiao Han , Qianqian Yang , Zhiguo Shi , Shibo He , Zhaoyang Zhang

Semantic communication is emerging as a key paradigm for 6G networks, where the goal is not to perfectly reconstruct bits but to preserve the meaning that matters for a given task. This shift can improve bandwidth efficiency, robustness,…

Networking and Internet Architecture · Computer Science 2026-03-16 Tuğçe Bilen , Ian F. Akyildiz

Semantic communications, aiming at ensuring the successful delivery of the meaning of information, are expected to be one of the potential techniques for the next generation communications. However, the knowledge forming and synchronizing…

Image and Video Processing · Electrical Eng. & Systems 2024-01-17 Yuan Zheng , Fengyu Wang , Wenjun Xu , Miao Pan , Ping Zhang

Semantic communication aims to facilitate purposeful information exchange among diverse intelligent entities, including humans, machines, and organisms. It emphasizes precise semantic transmission over data fidelity, striving for meaningful…

Cryptography and Security · Computer Science 2024-07-09 Yuntao Wang