English
Related papers

Related papers: Demo: Real-Time Semantic Communications with a Vis…

200 papers

Semantic communication has emerged as a promising paradigm for next-generation wireless systems, improving the communication efficiency by transmitting high-level semantic features. However, reliance on unimodal representations can degrade…

Signal Processing · Electrical Eng. & Systems 2025-09-11 Haoran Chang , Mingzhe Chen , Huaxia Wang , Qianqian Zhang

Semantic communications have been utilized to execute numerous intelligent tasks by transmitting task-related semantic information instead of bits. In this article, we propose a semantic-aware speech-to-text transmission system for the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-08 Zhenzi Weng , Zhijin Qin , Huiqiang Xie , Xiaoming Tao , Khaled B. Letaief

This paper aims to design robust Edge Intelligence using semantic communication for time-critical IoT applications. We systematically analyze the effect of image DCT coefficients on inference accuracy and propose the channel-agnostic…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Andrea Cavagna , Nan Li , Alexandros Iosifidis , Qi Zhang

The transformer structure employed in large language models (LLMs), as a specialized category of deep neural networks (DNNs) featuring attention mechanisms, stands out for their ability to identify and highlight the most relevant aspects of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Matin Mortaheb , Erciyes Karakaya , Mohammad A. Amir Khojastepour , Sennur Ulukus

In this paper, we investigate video signal transmission through an FPGA-based free-space optical (FSO) communication system prototype. We use a channel emulator that models the turbulence, scintillation, and power attenuation of the FSO…

Networking and Internet Architecture · Computer Science 2020-05-15 Hong-Bae Jeon , Hyung-Joo Moon , Soo-Min Kim , Do-Hoon Kwon , Joon-Woo Lee , Sang-Kook Han , Chan-Byoung Chae

Diffusion models have been extensively utilized in AI-generated content (AIGC) in recent years, thanks to the superior generation capabilities. Combining with semantic communications, diffusion models are used for tasks such as denoising,…

Machine Learning · Computer Science 2025-07-10 Lei Guo , Wei Chen , Yuxuan Sun , Bo Ai , Nikolaos Pappas , Tony Q. S. Quek

Recently, deep learning enabled semantic communications have been developed to understand transmission content from semantic level, which realize effective and accurate information transfer. Aiming to the vision of sixth generation (6G)…

Signal Processing · Electrical Eng. & Systems 2024-03-04 Zhengyu Zhang , Ruisi He , Mi Yang , Xuejian Zhang , Ziyi Qi , Yuan Yuan , Bo Ai

Traditional communication systems focus on the transmission process, and the context-dependent meaning has been ignored. The fact that 5G system has approached Shannon limit and the increasing amount of data will cause communication…

Signal Processing · Electrical Eng. & Systems 2022-02-22 Chen Dong , Haotai Liang , Xiaodong Xu , Shujun Han , Bizhu Wang , Ping Zhang

Reliable image transmission over wireless channels is particularly challenging at extremely low transmission rates, where conventional compression and channel coding schemes fail to preserve adequate visual quality. To address this issue,…

Information Theory · Computer Science 2025-10-27 Shengkang Chen , Tong Wu , Zhiyong Chen , Feng Yang , Meixia Tao , Wenjun Zhang

Semantic communication has become a popular research area due its high spectrum efficiency and error-correction performance. Some studies use deep learning to extract semantic features, which usually form end-to-end semantic communication…

Signal Processing · Electrical Eng. & Systems 2022-10-04 Peiwen Jiang , Chao-Kai Wen , Shi Jin , Geoffrey Ye Li

Semantic communication, augmented by knowledge bases (KBs), offers substantial reductions in transmission overhead and resilience to errors. However, existing methods predominantly rely on end-to-end training to construct KBs, often failing…

Image and Video Processing · Electrical Eng. & Systems 2024-10-25 Peiwen Jiang , Chao-Kai Wen , Shi Jin , Jun Zhang

We propose and validate a novel optical semantic transmission scheme using multimode fiber (MMF). By leveraging the frequency sensitivity of intermodal dispersion in MMFs, we achieve high-dimensional semantic encoding and decoding in the…

Signal Processing · Electrical Eng. & Systems 2024-09-04 Zheng Gao , Ting Jiang , Mingming Zhang , Hao Wu , Ming Tang

Semantic communications represent a new paradigm of next-generation networking that shifts bit-wise data delivery to conveying the semantic meanings for bandwidth efficiency. To effectively accommodate various potential downstream tasks at…

Computation and Language · Computer Science 2025-05-14 Fupei Guo , Achintha Wijesinghe , Songyang Zhang , Zhi Ding

Although existing semantic communication systems have achieved great success, they have not considered that the channel is time-varying wherein deep fading occurs occasionally. Moreover, the importance of each semantic feature differs from…

Signal Processing · Electrical Eng. & Systems 2023-05-08 Kequan Zhou , Guangyi Zhang , Yunlong Cai , Qiyu Hu , Guanding Yu

We introduce the GANformer, a novel and efficient type of transformer, and explore it for the task of visual generative modeling. The network employs a bipartite structure that enables long-range interactions across the image, while…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Drew A. Hudson , C. Lawrence Zitnick

Codebook-based generative semantic communication attracts increasing attention, since only indices are required to be transmitted when the codebook is shared between transmitter and receiver. However, due to the fact that the semantic…

Information Theory · Computer Science 2025-08-12 Peigen Ye , Yaping Sun , Shumin Yao , Hao Chen , Xiaodong Xu , Shuguang Cui

There is a recent interest in neural network (NN)-based communication algorithms which have shown to achieve (beyond) state-of-the-art performance for a variety of problems or lead to reduced implementation complexity. However, most work on…

Information Theory · Computer Science 2019-02-20 Fayçal Ait Aoudia , Jakob Hoydis

Satellite communications can provide massive connections and seamless coverage, but they also face several challenges, such as rain attenuation, long propagation delays, and co-channel interference. To improve transmission efficiency and…

Signal Processing · Electrical Eng. & Systems 2024-10-27 Peiwen Jiang , Chao-Kai Wen , Xiao Li , Shi Jin , Geoffrey Ye Li

Semantic communication (SC) is emerging as a pivotal innovation within the 6G framework, aimed at enabling more intelligent transmission. This development has led to numerous studies focused on designing advanced systems through powerful…

Signal Processing · Electrical Eng. & Systems 2024-12-30 Guangyi Zhang , Kequan Zhou , Yunlong Cai , Qiyu Hu , Guanding Yu

Semantic communication focuses on conveying the task-relevant meaning rather than exact bitwise recovery. For image transmission with a generative receiver, relying only on text descriptions can be insufficient to preserve instance-specific…

Information Theory · Computer Science 2026-01-27 Xuesong Wang , Xinyan Xie , Mo Li , Zhaoqian Liu