English
Related papers

Related papers: Multimodal Trustworthy Semantic Communication for …

200 papers

Real-time unmanned aerial vehicle (UAV) video streaming is essential for time-sensitive applications, including remote surveillance, emergency response, and environmental monitoring. However, it faces challenges such as limited bandwidth,…

Image and Video Processing · Electrical Eng. & Systems 2025-07-10 Xuyang Chen , Chong Huang , Daquan Feng , Lei Luo , Yao Sun , Xiang-Gen Xia

Recent advances in multimodal learning have largely relied on pairwise contrastive objectives to align different modalities, such as text, video, and audio, in a shared embedding space. While effective in bi-modal setups, these approaches…

Artificial Intelligence · Computer Science 2025-08-19 Haochen You , Baojing Liu

Semantic communication aims to facilitate purposeful information exchange among diverse intelligent entities, including humans, machines, and organisms. It emphasizes precise semantic transmission over data fidelity, striving for meaningful…

Cryptography and Security · Computer Science 2024-07-09 Yuntao Wang

As communication systems transition from symbol transmission to conveying meaningful information, sixth-generation (6G) networks emphasize semantic communication. This approach prioritizes high-level semantic information, improving…

Signal Processing · Electrical Eng. & Systems 2025-01-27 Zhe Xiang , Fei Yu , Quan Deng , Yuandi Li , Zhiguo Wan

We propose Vision-Language Feature-based Multimodal Semantic Communication (VLF-MSC), a unified system that transmits a single compact vision-language representation to support both image and text generation at the receiver. Unlike existing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Gwangyeon Ahn , Jiwan Seo , Joonhyuk Kang

We study the problem of secure joint source-channel coding for multimodal semantic sources transmitted over noisy wiretap channels. The source model consists of $m$ modalities (e.g., image, audio, and sensor data), all represented as random…

Information Theory · Computer Science 2026-05-26 Denis Kozlov , Mahtab Mirmohseni , Rahim Tafazolli

Intelligent task-oriented semantic communications~(SemComs) have witnessed great progress with the development of deep learning~(DL), where multi-task SemComs that perform multiple tasks simultaneously attach great importance due to its…

Signal Processing · Electrical Eng. & Systems 2025-09-12 Jiangjing Hu , Fengyu Wang , Wenjun Xu , Hui Gao , Ping Zhang

Semantic communication serves as a novel paradigm and attracts the broad interest of researchers. One critical aspect of it is the multi-user semantic communication theory, which can further promote its application to the practical network…

Signal Processing · Electrical Eng. & Systems 2023-11-21 Weizhi Li , Haotai Liang , Chen Dong , Xiaodong Xu , Ping Zhang , Kaijun Liu

Visual Text-to-Speech (VTTS) aims to take the environmental image as the prompt to synthesize the reverberant speech for the spoken content. The challenge of this task lies in understanding the spatial environment from the image. Many…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Rui Liu , Shuwei He , Yifan Hu , Haizhou Li

Semantic Communication (SemCom), leveraging its significant advantages in transmission efficiency and reliability, has emerged as a core technology for constructing future intellicise (intelligent and concise) wireless networks. However,…

Cryptography and Security · Computer Science 2026-05-08 Rui Meng , Song Gao , Bingxuan Xu , Xiaodong Xu , Jianqiao Chen , Nan Ma , Pei Xiao , Ping Zhang , Rahim Tafazolli

End-to-end semantic communications (ESC) rely on deep neural networks (DNN) to boost communication efficiency by only transmitting the semantics of data, showing great potential for high-demand mobile applications. We argue that central to…

Signal Processing · Electrical Eng. & Systems 2023-05-15 Guoshun Nan , Zhichun Li , Jinli Zhai , Qimei Cui , Gong Chen , Xin Du , Xuefei Zhang , Xiaofeng Tao , Zhu Han , Tony Q. S. Quek

Despite the superior capabilities of Multimodal Large Language Models (MLLMs) across diverse tasks, they still face significant trustworthiness challenges. Yet, current literature on the assessment of trustworthy MLLMs remains limited,…

Computation and Language · Computer Science 2024-12-09 Yichi Zhang , Yao Huang , Yitong Sun , Chang Liu , Zhe Zhao , Zhengwei Fang , Yifan Wang , Huanran Chen , Xiao Yang , Xingxing Wei , Hang Su , Yinpeng Dong , Jun Zhu

The rapid development of low-altitude economy has driven the proliferation of Unmanned Aerial Vehicle (UAV) applications, including logistics, inspection, and emergency response. However, transmitting high-volume image data from UAVs to…

Image and Video Processing · Electrical Eng. & Systems 2026-05-14 Kexin Zhang , Lixin Li , Yuna Yan , Xin Zhang , Wensheng Lin , Rui Li , Dongwei Zhao , Zhu Han

Image semantic communication (ISC) has garnered significant attention for its potential to achieve high efficiency in visual content transmission. However, existing ISC systems based on joint source-channel coding face challenges in…

Information Theory · Computer Science 2024-08-08 Xijun Wang , Dongshan Ye , Chenyuan Feng , Howard H. Yang , Xiang Chen , Tony Q. S. Quek

Learning visual semantic similarity is a critical challenge in bridging the gap between images and texts. However, there exist inherent variations between vision and language data, such as information density, i.e., images can contain…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yang Liu , Mengyuan Liu , Shudong Huang , Jiancheng Lv

Semantic communication is a new paradigm that exploits deep learning models to enable end-to-end communications processes, and recent studies have shown that it can achieve better noise resiliency compared with traditional communication…

Signal Processing · Electrical Eng. & Systems 2023-06-28 Wenyu Zhang , Kaiyuan Bai , Sherali Zeadally , Haijun Zhang , Hua Shao , Hui Ma , Victor C. M. Leung

Intelligent transportation systems (ITS) are expected to effectively create a stand-alone network for secure communication among autonomous agents. In such a dynamic and fast-changing network with high-speed agents, verifying the…

This paper investigates movable antenna (MA) empowered secure transmission in near-field multiple-input multiple-output (MIMO) communication systems, where the base station (BS) equipped with an MA array transmits confidential information…

Information Theory · Computer Science 2025-09-03 Yaodong Ma , Kai Liu , Yanming Liu , Lipeng Zhu

Multimedia content has become ubiquitous on social media platforms, leading to the rise of multimodal misinformation (MM) and the urgent need for effective strategies to detect and prevent its spread. In recent years, the challenge of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Stefanos-Iordanis Papadopoulos , Christos Koutlis , Symeon Papadopoulos , Panagiotis C. Petrantonakis

The rapid advancement of generative artificial intelligence has spurred innovative approaches to semantic communication, giving rise to a new paradigm known as generative semantic communication (GSC). The integration of flexible cross-modal…

Signal Processing · Electrical Eng. & Systems 2025-11-03 Yiru Wang , Wanting Yang , Fangli Mou , Zehui Xiong , Zide Fan , Shiwen Mao , Tony Q. S. Quek
‹ Prev 1 4 5 6 7 8 10 Next ›