English
Related papers

Related papers: Sema: Semantic Transport for Real-Time Multimodal …

200 papers

Metaverse over wireless networks is an emerging use case of the sixth generation (6G) wireless systems, posing unprecedented challenges in terms of its multi-modal data transmissions with stringent latency and reliability requirements.…

Networking and Internet Architecture · Computer Science 2022-12-15 Jihong Park , Jinho Choi , Seong-Lyun Kim , Mehdi Bennis

Intelligent Connected Vehicles (ICVs) rely on high-speed data transmission for efficient and safety-critical services. However, the scarcity of wireless resources limits the capabilities of ICVs. Semantic Communication (SemCom) systems can…

Signal Processing · Electrical Eng. & Systems 2025-12-30 Daiqi Zhang , Bizhu Wang , Wenqi Zhang , Chen Sun , Xiaodong Xu

Millimeter-wave (mmWave) and terahertz (THz) communication systems require large antenna arrays and use narrow directive beams to ensure sufficient receive signal power. However, selecting the optimal beams for these large antenna arrays…

Information Theory · Computer Science 2024-02-23 Shoaib Imran , Gouranga Charan , Ahmed Alkhateeb

Semantic communication represents a promising technique towards reducing communication costs, especially when dealing with image segmentation, but it still lacks a balance between computational efficiency and bandwidth requirements while…

Networking and Internet Architecture · Computer Science 2025-07-22 Ebrahim Abu-Helalah , Jordi Serra , Jordi Perez-Romero

Semantic communication (SemCom) has emerged as a transformative paradigm for efficient information transmission by emphasizing the exchange of task-relevant meaning rather than raw data. While diffusion-based SemCom models have demonstrated…

Information Theory · Computer Science 2026-04-07 Chengyang Liang , Dong Li

Autonomous vehicles require motion forecasting of their surrounding multiagents (pedestrians and vehicles) to make optimal decisions for navigation. The existing methods focus on techniques to utilize the positions and velocities of these…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Vidyaa Krishnan Nivash , Ahmed H. Qureshi

This work presents a novel semantic transmission framework in wireless networks, leveraging the joint processing technique. Our framework enables multiple cooperating base stations to efficiently transmit semantic information to multiple…

Information Theory · Computer Science 2024-01-03 Xumin Pu , Tiantian Lei , Wanli Wen , Qianbin Chen

Foundation model-based semantic transmission has recently shown great potential in wireless image communication. However, existing methods exhibit two major limitations: (i) they overlook the varying importance of semantic components for…

Image and Video Processing · Electrical Eng. & Systems 2025-09-30 Fangyu Liu , Peiwen Jiang , Wenjin Wang , Chao-Kai Wen , Shi Jin , Jun Zhang

Existing deep learning-enabled semantic communication systems often rely on shared background knowledge between the transmitter and receiver that includes empirical data and their associated semantic information. In practice, the semantic…

Information Theory · Computer Science 2022-10-19 Hongwei Zhang , Shuo Shao , Meixia Tao , Xiaoyan Bi , Khaled B. Letaief

Speech enhancement (SE) aims to extract the clean waveform from noise-contaminated measurements to improve the speech quality and intelligibility. Although learning-based methods can perform much better than traditional counterparts, the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-23 Haoyin Yan , Jie Zhang , Cunhang Fan , Yeping Zhou , Peiqi Liu

Semantic segmentation is a fundamental task in computer vision with wide-ranging applications, including autonomous driving and robotics. While RGB-based methods have achieved strong performance with CNNs and Transformers, their…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Fuqiang Gu , Yuanke Li , Xianlei Long , Kangping Ji , Chao Chen , Qingyi Gu , Zhenliang Ni

Semantic communication is an increasingly popular framework for wireless image transmission due to its high communication efficiency. With the aid of the joint-source-and-channel (JSC) encoder implemented by neural network, semantic…

Information Theory · Computer Science 2022-12-02 Maojun Zhang , Yang Li , Zezhong Zhang , Guangxu Zhu , Caijun Zhong

Trajectory prediction in autonomous driving relies on accurate representation of all relevant contexts of the driving scene, including traffic participants, road topology, traffic signs, as well as their semantic relations to each other.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Zhigang Sun , Zixu Wang , Lavdim Halilaj , Juergen Luettin

Semantic communication emphasizes the transmission of meaning rather than raw symbols. It offers a promising solution to alleviate network congestion and improve transmission efficiency. In this paper, we propose a wireless image…

Signal Processing · Electrical Eng. & Systems 2025-07-17 Chen Zhu , Siyun Liang , Zhouxiang Zhao , Jianrong Bao , Zhaohui Yang , Zhaoyang Zhang , Dusit Niyato

The rapid advancement in large foundation models is propelling the paradigm shifts across various industries. One significant change is that agents, instead of traditional machines or humans, will be the primary participants in the future…

Signal Processing · Electrical Eng. & Systems 2025-07-30 Zhuoran Xiao , Chenhui Ye , Yijia Feng , Yunbo Hu , Tianyu Jiao , Liyu Cai , Guangyi Liu

A visual metaphor constitutes a high-order form of human creativity, employing cross-domain semantic fusion to transform abstract concepts into impactful visual rhetoric. Despite the remarkable progress of generative AI, existing models…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yu Xu , Yuxin Zhang , Juan Cao , Lin Gao , Chunyu Wang , Oliver Deussen , Tong-Yee Lee , Fan Tang

This paper proposes a novel Semantic Communication (SemCom) framework for real-time adaptive-bitrate video streaming by integrating Latent Diffusion Models (LDMs) within the FFmpeg techniques. This solution addresses the challenges of high…

Multimedia · Computer Science 2025-08-04 Zijiang Yan , Jianhua Pei , Hongda Wu , Hina Tabassum , Ping Wang

Multi-modal semantic segmentation significantly enhances AI agents' perception and scene understanding, especially under adverse conditions like low-light or overexposed environments. Leveraging additional modalities (X-modality) like…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Zifu Wan , Pingping Zhang , Yuhao Wang , Silong Yong , Simon Stepputtis , Katia Sycara , Yaqi Xie

The International Telecommunication Union (ITU) identifies "Artificial Intelligence (AI) and Communication" as one of six key usage scenarios for 6G. Agentic AI, characterized by its ca-pabilities in multi-modal environmental sensing,…

In visual semantic navigation, the robot navigates to a target object with egocentric visual observations and the class label of the target is given. It is a meaningful task inspiring a surge of relevant research. However, most of the…

Artificial Intelligence · Computer Science 2021-09-21 Xinzhu Liu , Di Guo , Huaping Liu , Fuchun Sun