English
Related papers

Related papers: Multi-Modal Semantic Communication

200 papers

The last seventy years have witnessed the transition of communication from Shannon's theoretical concept to current high-efficient practical systems. Classical communication systems address the capability-deficiency issue mainly by…

Information Theory · Computer Science 2022-03-31 Kai Niu , Jincheng Dai , Shengshi Yao , Sixian Wang , Zhongwei Si , Xiaoqi Qin , Ping Zhang

Semantic- and task-oriented communication has emerged as a promising approach to reducing the latency and bandwidth requirements of next-generation mobile networks by transmitting only the most relevant information needed to complete a…

Information Theory · Computer Science 2024-09-27 Deniz Gündüz , Michèle A. Wigger , Tze-Yang Tung , Ping Zhang , Yong Xiao

The increasing deployment of agentic artificial intelligence (AI) systems has intensified the demand for efficient agent to agent communication, particularly over bandwidth limited wireless links. In embodied AI applications, agents must…

Signal Processing · Electrical Eng. & Systems 2026-04-16 Peiwen Jiang , Yushuo Feng , Jiajia Guo , Chao-Kai Wen , Shi Jin

Molecular communication (MC) provides a foundational framework for information transmission in the Internet of Bio-Nano Things (IoBNT), where efficiency and reliability are crucial. However, the inherent limitations of molecular channels,…

Signal Processing · Electrical Eng. & Systems 2025-04-02 Hanlin Cai , Ozgur B. Akan

Semantic communication, as a promising technology, has emerged to break through the Shannon limit, which is envisioned as the key enabler and fundamental paradigm for future 6G networks and applications, e.g., smart healthcare. In this…

Image and Video Processing · Electrical Eng. & Systems 2022-09-27 Jiawen Kang , Hongyang Du , Zonghang Li , Zehui Xiong , Shiyao Ma , Dusit Niyato , Yuan Li

Fine-grained cross-modal alignment aims to establish precise local correspondences between vision and language, forming a cornerstone for visual question answering and related multimodal applications. Current approaches face challenges in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Xinyu Mao , Junsi Li , Haoji Zhang , Yu Liang , Ming Sun

In existing semantic communication systems for image transmission, some images are generally reconstructed with considerably low quality. As a result, the reliable transmission of each image cannot be guaranteed, bringing significant…

Signal Processing · Electrical Eng. & Systems 2023-06-28 Guangyi Zhang , Qiyu Hu , Yunlong Cai , Guanding Yu

In this paper, we propose a novel design for AI-native goal-oriented communications, exploiting transformer neural networks under dynamic inference constraints on bandwidth and computation. Transformers have become the standard architecture…

Information Theory · Computer Science 2024-05-07 Alessio Devoto , Simone Petruzzi , Jary Pomponi , Paolo Di Lorenzo , Simone Scardapane

Feature modeling of different modalities is a basic problem in current research of cross-modal information retrieval. Existing models typically project texts and images into one embedding space, in which semantically similar information…

Multimedia · Computer Science 2019-06-13 Jing Yu , Chenghao Yang , Zengchang Qin , Zhuoqian Yang , Yue Hu , Weifeng Zhang

Despite the widespread adoption of vision sensors in edge applications, such as surveillance, the transmission of video data consumes substantial spectrum resources. Semantic communication (SC) offers a solution by extracting and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Yubo Peng , Luping Xiang , Kun Yang , Kezhi Wang , Merouane Debbah

Transfer learning aims at building robust prediction models by transferring knowledge gained from one problem to another. In the semantic Web, learning tasks are enhanced with semantic representations. We exploit their semantics to augment…

Machine Learning · Computer Science 2019-06-25 Freddy Lecue , Jiaoyan Chen , Jeff Z. Pan , Huajun Chen

Semantic communication has gained significant attention with the advances in machine learning. Most semantic communication works focus on either task execution or data reconstruction, with some recent works combining the two. In this work,…

Signal Processing · Electrical Eng. & Systems 2025-10-24 Maximilian H. V. Tillmann , Avinash Kankari , Carsten Bockelmann , Armin Dekorsy

Semantic communication (SC) is recognized as a promising approach for enabling reliable communication with minimal data transfer while maintaining seamless connectivity for a group of wireless users. Unlocking the advantages of SC for…

Information Theory · Computer Science 2024-06-24 Nitisha Singh , Christo Kurisummoottil Thomas , Walid Saad , Emilio Calvanese Strinati

Semantic communication, augmented by knowledge bases (KBs), offers substantial reductions in transmission overhead and resilience to errors. However, existing methods predominantly rely on end-to-end training to construct KBs, often failing…

Image and Video Processing · Electrical Eng. & Systems 2024-10-25 Peiwen Jiang , Chao-Kai Wen , Shi Jin , Jun Zhang

Wireless connectivity has traditionally been regarded as an opaque data pipe carrying messages, whose context-dependent meaning and effectiveness have been ignored. Nevertheless, in emerging cyber-physical and autonomous networked systems,…

Information Theory · Computer Science 2021-03-11 Marios Kountouris , Nikolaos Pappas

With the booming development of generative artificial intelligence (GAI), semantic communication (SemCom) has emerged as a new paradigm for reliable and efficient communication. This paper considers a multi-user downlink SemCom system,…

Networking and Internet Architecture · Computer Science 2025-07-03 Jiayi Lu , Wanting Yang , Zehui Xiong , Rahim Tafazolli , Tony Q. S. Quek , Mérouane Debbah , Dong In Kim

Traditional image/video compression aims to reduce the transmission/storage cost with signal fidelity as high as possible. However, with the increasing demand for machine analysis and semantic monitoring in recent years, semantic fidelity…

Image and Video Processing · Electrical Eng. & Systems 2022-09-07 Jiguo Li , Chuanmin Jia , Xinfeng Zhang , Siwei Ma , Wen Gao

The traditional communications transmit all the source data represented by bits, regardless of the content of source and the semantic information required by the receiver. However, in some applications, the receiver only needs part of the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-30 Zhenzi Weng , Zhijin Qin , Geoffrey Ye Li

Semantic communication (SC) is emerging as a pivotal innovation within the 6G framework, aimed at enabling more intelligent transmission. This development has led to numerous studies focused on designing advanced systems through powerful…

Signal Processing · Electrical Eng. & Systems 2024-12-30 Guangyi Zhang , Kequan Zhou , Yunlong Cai , Qiyu Hu , Guanding Yu

Multimodal wearable sensor data classification plays an important role in ubiquitous computing and has a wide range of applications in scenarios from healthcare to entertainment. However, most existing work in this field employs…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Xiang Zhang , Lina Yao , Chaoran Huang , Sen Wang , Mingkui Tan , Guodong Long , Can Wang