English
Related papers

Related papers: Codebook-enabled Generative End-to-end Semantic Co…

200 papers

In the evolving landscape of 6G networks, semantic communications are poised to revolutionize data transmission by prioritizing the transmission of semantic meaning over raw data accuracy. This paper presents a Vision Transformer…

Image and Video Processing · Electrical Eng. & Systems 2025-03-24 Muhammad Ahmed Mohsin , Muhammad Jazib , Zeeshan Alam , Muhmmad Farhan Khan , Muhammad Saad , Muhammad Ali Jamshed

Automatic generation of high-quality commit messages for code commits can substantially facilitate software developers' works and coordination. However, the semantic gap between source code and natural language poses a major challenge for…

Computation and Language · Computer Science 2021-06-22 Lun Yiu Nie , Cuiyun Gao , Zhicong Zhong , Wai Lam , Yang Liu , Zenglin Xu

By integrating recent advances in large language models (LLMs) and generative models into the emerging semantic communication (SC) paradigm, in this article we put forward to a novel framework of language-oriented semantic communication…

Signal Processing · Electrical Eng. & Systems 2023-09-21 Hyelin Nam , Jihong Park , Jinho Choi , Mehdi Bennis , Seong-Lyun Kim

In recent years, with the rapid development of deep learning and natural language processing technologies, semantic communication has become a topic of great interest in the field of communication. Although existing deep learning-based…

Computation and Language · Computer Science 2023-04-18 Bingyan Wang , Rongpeng Li , Jianhang Zhu , Zhifeng Zhao , Honggang Zhang

Semantic communication has been introduced into collaborative perception systems for autonomous driving, offering a promising approach to enhancing data transmission efficiency and robustness. Despite its potential, existing semantic…

Signal Processing · Electrical Eng. & Systems 2025-12-30 Jipeng Gan , Le Liang , Hua Zhang , Chongtao Guo , Shi Jin

Semantic- and task-oriented communication has emerged as a promising approach to reducing the latency and bandwidth requirements of next-generation mobile networks by transmitting only the most relevant information needed to complete a…

Information Theory · Computer Science 2024-09-27 Deniz Gündüz , Michèle A. Wigger , Tze-Yang Tung , Ping Zhang , Yong Xiao

The emerging field semantic communication is driving the research of end-to-end data transmission. By utilizing the powerful representation ability of deep learning models, learned data transmission schemes have exhibited superior…

Information Theory · Computer Science 2023-05-25 Jincheng Dai , Sixian Wang , Ke Yang , Kailin Tan , Xiaoqi Qin , Zhongwei Si , Kai Niu , Ping Zhang

Semantic Communication (SC) is a novel paradigm for data transmission in 6G. However, there are several challenges posed when performing SC in 3D scenarios: 1) 3D semantic extraction; 2) Latent semantic redundancy; and 3) Uncertain channel…

Information Theory · Computer Science 2024-03-12 Feibo Jiang , Yubo Peng , Li Dong , Kezhi Wang , Kun Yang , Cunhua Pan , Xiaohu You

On one hand, recent advances in chatbots has led to a rising popularity in using these models for coding tasks. On the other hand, modern generative image models primarily rely on text encoders to translate semantic concepts into visual…

Sound · Computer Science 2025-09-15 Jorge E. León , Miguel Carrasco

Deep learning-empowered semantic communication is regarded as a promising candidate for future 6G networks. Although existing semantic communication systems have achieved superior performance compared to traditional methods, the end-to-end…

Artificial Intelligence · Computer Science 2023-11-07 Peng Yi , Yang Cao , Xin Kang , Ying-Chang Liang

In this paper, we propose a novel semantic-aided image communication framework for supporting the compatibility with practical separation-based coding architectures. Particularly, the deep learning (DL)-based joint source-channel coding…

Information Theory · Computer Science 2025-05-01 Mingkai Xu , Yongpeng Wu , Yuxuan Shi , Xiang-Gen Xia , Merouane Debbah , Wenjun Zhang , Ping Zhang

The end-to-end image communication system has been widely studied in the academic community. The escalating demands on image communication systems in terms of data volume, environmental complexity, and task precision require enhanced…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Senran Fan , Zhicheng Bao , Chen Dong , Haotai Liang , Xiaodong Xu , Ping Zhang

Learning-based semantic communication (SemCom) has recently emerged as a promising paradigm for improving the transmission efficiency of wireless networks. However, existing methods typically rely on extensive end-to-end training, which is…

Information Theory · Computer Science 2026-03-19 Shunpu Tang , Qianqian Yang , Jihong Park , Zhaoyang Zhang , Kaibin Huang , Deniz Gunduz

As one novel approach to realize end-to-end wireless image semantic transmission, deep learning-based joint source-channel coding (deep JSCC) method is emerging in both deep learning and communication communities. However, current deep JSCC…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Jun Wang , Sixian Wang , Jincheng Dai , Zhongwei Si , Dekun Zhou , Kai Niu

Neural Audio Codecs, initially designed as a compression technique, have gained more attention recently for speech generation. Codec models represent each audio frame as a sequence of tokens, i.e., discrete embeddings. The discrete and…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-31 Alexander H. Liu , Qirui Wang , Yuan Gong , James Glass

Neural speech codecs aim to compress input signals into minimal bits while maintaining content quality in a low-latency manner. However, existing neural codecs often trade model complexity for reconstruction performance. These codecs…

Sound · Computer Science 2024-10-04 Yuzhe Gu , Enmao Diao

Conventional communication systems, including both separation-based coding and AI-driven joint source-channel coding (JSCC), are largely guided by Shannon's rate-distortion theory. However, relying on generic distortion metrics fails to…

Information Theory · Computer Science 2026-01-21 Tong Wu , Zhiyong Chen , Guo Lu , Li Song , Feng Yang , Meixia Tao , Wenjun Zhang

This paper investigates a key challenge faced by joint source-channel coding (JSCC) in digital semantic communication (SemCom): the incompatibility between existing JSCC schemes that yield continuous encoded representations and digital…

Information Theory · Computer Science 2025-11-12 Yujie Zhou , Rulong Wang , Yong Xiao , Yingyu Li , Guangming Shi

Efficient video transmission is essential for seamless communication and collaboration within the visually-driven digital landscape. To achieve low latency and high-quality video transmission over a bandwidth-constrained noisy wireless…

Image and Video Processing · Electrical Eng. & Systems 2025-03-03 Nan Li , Yansha Deng , Dusit Niyato

Semantic communication aims to transmit information most relevant to a task rather than raw data, offering significant gains in communication efficiency for applications such as telepresence, augmented reality, and remote sensing. Recent…

Machine Learning · Computer Science 2025-12-18 Matin Mortaheb , Erciyes Karakaya , Sennur Ulukus