English
Related papers

Related papers: VQ-DeepISC: Vector Quantized-Enabled Digital Seman…

200 papers

The rapid development of artificial intelligence has significantly advanced semantic communications, particularly in wireless image transmission. However, most existing approaches struggle to precisely distinguish and prioritize image…

Image and Video Processing · Electrical Eng. & Systems 2024-10-24 Jiarun Ding , Peiwen Jiang , Chao-Kai Wen , Shi Jin

Although semantic communications have exhibited satisfactory performance for a large number of tasks, the impact of semantic noise and the robustness of the systems have not been well investigated. Semantic noise refers to the misleading…

Signal Processing · Electrical Eng. & Systems 2023-04-20 Qiyu Hu , Guangyi Zhang , Zhijin Qin , Yunlong Cai , Guanding Yu , Geoffrey Ye Li

Semantic communications utilize the transceiver computing resources to alleviate scarce transmission resources, such as bandwidth and energy. Although the conventional deep learning (DL) based designs may achieve certain transmission…

Signal Processing · Electrical Eng. & Systems 2023-02-28 Shuai Ma , Weining Qiao , Youlong Wu , Hang Li , Guangming Shi , Dahua Gao , Yuanming Shi , Shiyin Li , Naofal Al-Dhahir

Codebook-based generative semantic communication attracts increasing attention, since only indices are required to be transmitted when the codebook is shared between transmitter and receiver. However, due to the fact that the semantic…

Information Theory · Computer Science 2025-08-12 Peigen Ye , Yaping Sun , Shumin Yao , Hao Chen , Xiaodong Xu , Shuguang Cui

Recently, numerous end-to-end optimized image compression neural networks have been developed and proved themselves as leaders in rate-distortion performance. The main strength of these learnt compression methods is in powerful nonlinear…

Image and Video Processing · Electrical Eng. & Systems 2023-04-26 Xi Zhang , Xiaolin Wu

Semantic communications has received growing interest since it can remarkably reduce the amount of data to be transmitted without missing critical information. Most existing works explore the semantic encoding and transmission for text and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Danlan Huang , Feifei Gao , Xiaoming Tao , Qiyuan Du , Jianhua Lu

Semantic communications is considered as a promising technology to increase the efficiency of next-generation communication systems, particularly targeting human-machine and machine-type communications. In contrast to the source-agnostic…

Information Theory · Computer Science 2023-07-20 Jialong Xu , Tze-Yang Tung , Bo Ai , Wei Chen , Yuxuan Sun , Deniz Gunduz

Semantic communication is proposed and expected to improve the efficiency of massive data transmission over sixth generation (6G) networks. However, existing image semantic communication schemes are primarily focused on optimizing…

Multimedia · Computer Science 2025-06-09 Zehao Chen , Xinfeng Wei , Haonan Tong , Zhaohui Yang , Changchuan Yin

Recent developments in Deep learning based Joint Source-Channel Coding (DeepJSCC) have demonstrated impressive capabilities within wireless semantic communications system. However, existing DeepJSCC methodologies exhibit limited…

Image and Video Processing · Electrical Eng. & Systems 2024-11-18 Liang Zhang , Danlan Huang , Xinyi Zhou , Feng Ding , Sheng Wu , Zhiqing Wei

Recent progress in deep learning (DL)-based joint source-channel coding (DeepJSCC) has led to a new paradigm of semantic communications. Two salient features of DeepJSCC-based semantic communications are the exploitation of semantic-aware…

Information Theory · Computer Science 2023-01-02 Yulin Shao , Deniz Gunduz

Semantic communications are expected to accomplish various semantic tasks with relatively less spectrum resource by exploiting the semantic feature of source data. To simultaneously serve both the data transmission and semantic tasks, joint…

Information Theory · Computer Science 2023-08-15 Jianhao Huang , Dongxu Li , Chuan Huang , Xiaoqi Qin , Wei Zhang

Vector quantization is common in deep models, yet its hard assignments block gradients and hinder end-to-end training. We propose DiVeQ, which treats quantization as adding an error vector that mimics the quantization distortion, keeping…

Machine Learning · Computer Science 2026-05-27 Mohammad Hassan Vali , Tom Bäckström , Arno Solin

In this paper, we develop a deep learning based semantic communication system for speech transmission, named DeepSC-ST. We take the speech recognition and speech synthesis as the transmission tasks of the communication system, respectively.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-03 Zhenzi Weng , Zhijin Qin , Xiaoming Tao , Chengkang Pan , Guangyi Liu , Geoffrey Ye Li

Deep learning-based joint source-channel coding (deep JSCC) has been demonstrated to be an effective approach for wireless image transmission. Nevertheless, most existing work adopts an autoencoder framework to optimize conventional…

Signal Processing · Electrical Eng. & Systems 2025-03-25 Mingyu Yang , Bowen Liu , Boyang Wang , Hun-Seok Kim

The advent of 6G networks demands unprecedented levels of intelligence, adaptability, and efficiency to address challenges such as ultra-high-speed data transmission, ultra-low latency, and massive connectivity in dynamic environments.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Chen Zhu , Kang Liang , Jianrong Bao , Zhouxiang Zhao , Zhaohui Yang , Zhaoyang Zhang , Mohammad Shikh-Bahaei

Foundation model-based semantic transmission has recently shown great potential in wireless image communication. However, existing methods exhibit two major limitations: (i) they overlook the varying importance of semantic components for…

Image and Video Processing · Electrical Eng. & Systems 2025-09-30 Fangyu Liu , Peiwen Jiang , Wenjin Wang , Chao-Kai Wen , Shi Jin , Jun Zhang

This paper studies the problem of the lightweight image semantic communication system that is deployed on Internet of Things (IoT) devices. In the considered system model, devices must use semantic communication techniques to support user…

Neural and Evolutionary Computing · Computer Science 2024-01-17 Guoxin Ma , Haonan Tong , Nuocheng Yang , Changchuan Yin

Deep learning (DL) based semantic communication methods have been explored for the efficient transmission of images, text, and speech in recent years. In contrast to traditional wireless communication methods that focus on the transmission…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-26 Tianxiao Han , Qianqian Yang , Zhiguo Shi , Shibo He , Zhaoyang Zhang

Human motion data is inherently rich and complex, containing both semantic content and subtle stylistic features that are challenging to model. We propose a novel method for effective disentanglement of the style and content in human motion…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Fatemeh Zargarbashi , Dhruv Agrawal , Jakob Buhmann , Martin Guay , Stelian Coros , Robert W. Sumner

We focus on tackling weakly supervised semantic segmentation with scribble-level annotation. The regularized loss has been proven to be an effective solution for this task. However, most existing regularized losses only leverage static…

Computer Vision and Pattern Recognition · Computer Science 2021-08-04 Bingfeng Zhang , Jimin Xiao , Yao Zhao