English
Related papers

Related papers: Synchronous Multi-modal Semantic Communication Sys…

200 papers

By integrating recent advances in large language models (LLMs) and generative models into the emerging semantic communication (SC) paradigm, in this article we put forward to a novel framework of language-oriented semantic communication…

Signal Processing · Electrical Eng. & Systems 2023-09-21 Hyelin Nam , Jihong Park , Jinho Choi , Mehdi Bennis , Seong-Lyun Kim

Semantic communications is considered as a promising technology to increase the efficiency of next-generation communication systems, particularly targeting human-machine and machine-type communications. In contrast to the source-agnostic…

Information Theory · Computer Science 2023-07-20 Jialong Xu , Tze-Yang Tung , Bo Ai , Wei Chen , Yuxuan Sun , Deniz Gunduz

Semantic communications are expected to accomplish various semantic tasks with relatively less spectrum resource by exploiting the semantic feature of source data. To simultaneously serve both the data transmission and semantic tasks, joint…

Information Theory · Computer Science 2023-08-15 Jianhao Huang , Dongxu Li , Chuan Huang , Xiaoqi Qin , Wei Zhang

Speech codecs serve as a crucial bridge in unifying speech and text language models. Existing codec methods face several challenges in semantic encoding, such as residual paralinguistic information (e.g., timbre, emotion), insufficient…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-06 Chunyu Qiang , Haoyu Wang , Cheng Gong , Tianrui Wang , Ruibo Fu , Tao Wang , Ruilong Chen , Jiangyan Yi , Zhengqi Wen , Chen Zhang , Longbiao Wang , Jianwu Dang , Jianhua Tao

In this paper, we propose a cross-layer encrypted semantic communication (CLESC) framework for panoramic video transmission, incorporating feature extraction, encoding, encryption, cyclic redundancy check (CRC), and retransmission processes…

Image and Video Processing · Electrical Eng. & Systems 2024-11-21 Haixiao Gao , Mengying Sun , Xiaodong Xu , Bingxuan Xu , Shujun Han , Bizhu Wang , Sheng Jiang , Chen Dong , Ping Zhang

Semantic communication has emerged as new paradigm shifts in 6G from the conventional syntax-oriented communications. Recently, the wireless broadcast technology has been introduced to support semantic communication system toward higher…

Signal Processing · Electrical Eng. & Systems 2024-02-01 Mingze Gong , Shuoyao Wang , Fangwei Ye , Suzhi Bi

Semantic communication can improve transmission efficiency by focusing on task-relevant information. However, under packet-based communication protocols, any error typically results in the loss of an entire packet, making semantic…

Systems and Control · Electrical Eng. & Systems 2025-11-24 Xiao Yang , Shuai Ma , Yong Liang , Guangming Shi

Semantic communication is an increasingly popular framework for wireless image transmission due to its high communication efficiency. With the aid of the joint-source-and-channel (JSC) encoder implemented by neural network, semantic…

Information Theory · Computer Science 2022-12-02 Maojun Zhang , Yang Li , Zezhong Zhang , Guangxu Zhu , Caijun Zhong

Speech tokenization enables discrete representation and facilitates speech language modeling. However, existing neural codecs capture low-level acoustic features, overlooking the semantic and contextual cues inherent to human speech. While…

Multimodal semantic communication has gained widespread attention due to its ability to enhance downstream task performance. A key challenge in such systems is the effective fusion of features from different modalities, which requires the…

Image and Video Processing · Electrical Eng. & Systems 2025-09-03 Haoshuo Zhang , Yufei Bo , Hongwei Zhang , Meixia Tao

Semantic Communication (SC) is a novel paradigm for data transmission in 6G. However, there are several challenges posed when performing SC in 3D scenarios: 1) 3D semantic extraction; 2) Latent semantic redundancy; and 3) Uncertain channel…

Information Theory · Computer Science 2024-03-12 Feibo Jiang , Yubo Peng , Li Dong , Kezhi Wang , Kun Yang , Cunhua Pan , Xiaohu You

Existing semantic communication schemes primarily focus on single-hop scenarios, overlooking the challenges of multi-hop wireless image transmission. As semantic communication is inherently lossy, distortion accumulates over multiple hops,…

Information Theory · Computer Science 2026-01-29 Bingyan Xie , Jihong Park , Yongpeng Wu , Wenjun Zhang , Tony Quek

Compression artifacts from standard video codecs often degrade perceptual quality. We propose a lightweight, semantic-aware pre-processing framework that enhances perceptual fidelity by selectively addressing these distortions. Our method…

Image and Video Processing · Electrical Eng. & Systems 2026-02-02 Han-Yu Lin , Li-Wei Chen , Hung-Shin Lee

We consider the problem of joint source-channel coding for semantic communication from a rateless perspective, the purpose of which is to settle the balance between reliability (distortion/perception) and effectiveness (rate) of…

Information Retrieval · Computer Science 2025-01-23 Cheng Peng , Rulong Wang , Yong Xiao

Real-time and contactless monitoring of vital signs, such as respiration and heartbeat, alongside reliable communication, is essential for modern healthcare systems, especially in remote and privacy-sensitive environments. Traditional…

Signal Processing · Electrical Eng. & Systems 2025-10-15 Yinchao Yang , Yahao Ding , Zhaohui Yang , Chongwen Huang , Zhaoyang Zhang , Dusit Niyato , Mohammad Shikh-Bahaei

Recent advances in integrated sensing and communication (ISAC) unmanned aerial vehicles (UAVs) have enabled their widespread deployment in critical applications such as emergency management. This paper investigates the challenge of…

Information Theory · Computer Science 2025-03-26 Ziji Guo , Haonan Tong , Zhilong Zhang , Danpu Liu

Semantic communication aims to transmit information most relevant to a task rather than raw data, offering significant gains in communication efficiency for applications such as telepresence, augmented reality, and remote sensing. Recent…

Machine Learning · Computer Science 2025-12-18 Matin Mortaheb , Erciyes Karakaya , Sennur Ulukus

Multimodal Emotion Recognition in Conversation (MERC) aims to predict speakers' emotions by integrating textual, acoustic, and visual cues. Existing approaches either struggle to capture complex cross-modal interactions or experience…

Multimedia · Computer Science 2026-03-24 Xiaosen Lyu , Jiayu Xiong , Yuren Chen , Wanlong Wang , Xiaoqing Dai , Jing Wang

Semantic Communication (SC) combined with Vehicular edge computing (VEC) provides an efficient edge task processing paradigm for Internet of Vehicles (IoV). Focusing on highway scenarios, this paper proposes a Tripartite Cooperative…

Machine Learning · Computer Science 2025-12-11 Jingbo Zhang , Maoxin Ji , Qiong Wu , Pingyi Fan , Kezhi Wang , Wen Chen

Interactive computer vision (CV) plays a crucial role in various real-world applications, whose performance is highly dependent on communication networks. Nonetheless, the data-oriented characteristics of conventional communications often…

Information Theory · Computer Science 2026-03-30 Bin Chen , Wenbo Yu , Qinshan Zhang , Tianqu Zhuang , Hao Wu , Yong Jiang , Shu-Tao Xia