English
Related papers

Related papers: Low-Rate Semantic Communication with Codebook-base…

200 papers

Joint source-channel coding (JSCC) is an effective approach for semantic communication. However, current JSCC methods are difficult to integrate with existing communication network architectures, where application and network providers are…

Information Theory · Computer Science 2025-07-18 Wenzheng Kong , Wenyi Zhang

In the new paradigm of semantic communication (SC), the focus is on delivering meanings behind bits by extracting semantic information from raw data. Recent advances in data-to-text models facilitate language-oriented SC, particularly for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Giordano Cicchetti , Eleonora Grassucci , Jihong Park , Jinho Choi , Sergio Barbarossa , Danilo Comminiello

In this paper, we introduce a large model-empowered streaming semantic communication system for speech transmission across various languages, named LSSC-ST. Specifically, we devise an edge-device collaborative semantic communication…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-24 Zhenzi Weng , Zhijin Qin , Geoffrey Ye Li

Semantic- and task-oriented communication has emerged as a promising approach to reducing the latency and bandwidth requirements of next-generation mobile networks by transmitting only the most relevant information needed to complete a…

Information Theory · Computer Science 2024-09-27 Deniz Gündüz , Michèle A. Wigger , Tze-Yang Tung , Ping Zhang , Yong Xiao

Recent works have shown that joint source-channel coding (JSCC) schemes using deep neural networks (DNNs), called DeepJSCC, provide promising results in wireless image transmission. However, these methods mostly focus on the distortion of…

Image and Video Processing · Electrical Eng. & Systems 2022-11-28 Ecenaz Erdemir , Tze-Yang Tung , Pier Luigi Dragotti , Deniz Gunduz

Deep learning (DL)-based joint source-channel coding (JSCC) methods have achieved remarkable success in wireless image transmission. However, these methods either focus on conventional distortion metrics that do not necessarily yield high…

Image and Video Processing · Electrical Eng. & Systems 2026-02-27 Ming Ye , Kui Cai , Cunhua Pan , Zhen Mei , Wanting Yang , Chunguo Li

As one novel approach to realize end-to-end wireless image semantic transmission, deep learning-based joint source-channel coding (deep JSCC) method is emerging in both deep learning and communication communities. However, current deep JSCC…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Jun Wang , Sixian Wang , Jincheng Dai , Zhongwei Si , Dekun Zhou , Kai Niu

The traditional communications transmit all the source data represented by bits, regardless of the content of source and the semantic information required by the receiver. However, in some applications, the receiver only needs part of the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-30 Zhenzi Weng , Zhijin Qin , Geoffrey Ye Li

Traditional video codecs optimized for pixel fidelity collapse at ultra-low bitrates and produce severe artifacts. This failure arises from a fundamental misalignment between pixel accuracy and human perception. We propose a semantic video…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Lingdong Wang , Guan-Ming Su , Divya Kothandaraman , Tsung-Wei Huang , Mohammad Hajiesmaili , Ramesh K. Sitaraman

Generative image compression has recently shown impressive perceptual quality, but often suffers from semantic deviations caused by generative hallucinations at ultra-low bitrate (bpp < 0.05), limiting its reliable deployment in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Kaile Wang , Lijun He , Haisheng Fu , Haixia Bi , Fan Li

Transferring large amount of high resolution images over limited bandwidth is an important but very challenging task. Compressing images using extremely low bitrates (<0.1 bpp) has been studied but it often results in low quality images of…

Image and Video Processing · Electrical Eng. & Systems 2022-11-16 Zhihong Pan , Xin Zhou , Hao Tian

Joint source-channel coding (JSCC) is a promising paradigm for next-generation communication systems, particularly in challenging transmission environments. In this paper, we propose a novel standard-compatible JSCC framework for the…

Information Theory · Computer Science 2025-01-07 Xue Han , Yongpeng Wu , Zhen Gao , Biqian Feng , Yuxuan Shi , Deniz Gündüz , Wenjun Zhang

Semantic communication, when examined through the lens of joint source-channel coding (JSCC), maps source messages directly into channel input symbols, where the measure of success is defined by end-to-end distortion rather than traditional…

Information Theory · Computer Science 2024-07-09 Tze-Yang Tung , Homa Esfahanizadeh , Jinfeng Du , Harish Viswanathan

Effective task-oriented semantic communications relies on perfect knowledge alignment between transmitters and receivers for accurate recovery of task-related semantic information, which can be susceptible to knowledge misalignment and…

Signal Processing · Electrical Eng. & Systems 2025-01-06 Hong Chen , Fang Fang , Xianbin Wang

The task-oriented semantic communication systems have achieved significant performance gain, however, the paradigm that employs a model for a specific task might be limited, since the system has to be updated once the task is changed or…

Signal Processing · Electrical Eng. & Systems 2022-06-02 Guangyi Zhang , Qiyu Hu , Zhijin Qin , Yunlong Cai , Guanding Yu

Semantic communication is a promising technology to improve communication efficiency by transmitting only the semantic information of the source data. However, traditional semantic communication methods primarily focus on data…

Sound · Computer Science 2024-10-07 Jiahao Zheng , Jinke Ren , Peng Xu , Zhihao Yuan , Jie Xu , Fangxin Wang , Gui Gui , Shuguang Cui

From the perspective of joint source-channel coding (JSCC), there has been significant research on utilizing semantic communication, which inherently possesses analog characteristics, within digital device environments. However, a…

Signal Processing · Electrical Eng. & Systems 2025-02-04 Yoon Huh , Hyowoon Seo , Wan Choi

Recent advances in text-to-image generative models provide the ability to generate high-quality images from short text descriptions. These foundation models, when pre-trained on billion-scale datasets, are effective for various downstream…

Machine Learning · Computer Science 2023-07-06 Eric Lei , Yiğit Berkay Uslu , Hamed Hassani , Shirin Saeedi Bidokhti

Most existing approaches for image and video compression perform transform coding in the pixel space to reduce redundancy. However, due to the misalignment between the pixel-space distortion and human perception, such schemes often face the…

Image and Video Processing · Electrical Eng. & Systems 2025-05-23 Linfeng Qi , Zhaoyang Jia , Jiahao Li , Bin Li , Houqiang Li , Yan Lu

As digital technologies advance, communication networks face challenges in handling the vast data generated by intelligent devices. Autonomous vehicles, smart sensors, and IoT systems necessitate new paradigms. This thesis addresses these…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Francesco Pezone