English
Related papers

Related papers: Language-Oriented Communication with Semantic Codi…

200 papers

Advancements in text-to-image generative AI with large multimodal models are spreading into the field of image compression, creating high-quality representation of images at extremely low bit rates. This work introduces novel components to…

Image and Video Processing · Electrical Eng. & Systems 2025-06-02 Cheng-Lin Wu , Hyomin Choi , Ivan V. Bajić

Semantic- and task-oriented communication has emerged as a promising approach to reducing the latency and bandwidth requirements of next-generation mobile networks by transmitting only the most relevant information needed to complete a…

Information Theory · Computer Science 2024-09-27 Deniz Gündüz , Michèle A. Wigger , Tze-Yang Tung , Ping Zhang , Yong Xiao

With the recent advancements in edge artificial intelligence (AI), future sixth-generation (6G) networks need to support new AI tasks such as classification and clustering apart from data recovery. Motivated by the success of deep learning,…

Networking and Internet Architecture · Computer Science 2023-04-06 Zhonghao Lyu , Guangxu Zhu , Jie Xu , Bo Ai , Shuguang Cui

This paper develops an edge-device collaborative Generative Semantic Communications (Gen SemCom) framework leveraging pre-trained Multi-modal/Vision Language Models (M/VLMs) for ultra-low-rate semantic communication via textual prompts. The…

Information Theory · Computer Science 2025-05-05 Mengmeng Ren , Li Qiao , Long Yang , Zhen Gao , Jian Chen , Mahdi Boloursaz Mashhadi , Pei Xiao , Rahim Tafazolli , Mehdi Bennis

Semantic communication is a novel communication paradigm which draws inspiration from human communication focusing on the delivery of the meaning of a message to the intended users. It has attracted significant interest recently due to its…

Networking and Internet Architecture · Computer Science 2022-03-17 Yong Xiao , Yingyu Li , Guangming Shi , H. Vincent Poor

Semantic communication has drawn substantial attention as a promising paradigm to achieve effective and intelligent communications. However, efficient image semantic communication encounters challenges with a lower testing compression ratio…

Information Theory · Computer Science 2024-05-10 Shuling Li , Yaping Sun , Jinbei Zhang , Kechao Cai , Shuguang Cui , Xiaodong Xu

Generative semantic communication models are reshaping semantic communication frameworks by moving beyond pixel-wise optimization to align with human perception. However, many existing approaches prioritize image-level perceptual quality,…

Signal Processing · Electrical Eng. & Systems 2025-04-08 Kailang Ye , Mingze Gong , Shuoyao Wang , Daquan Feng

Semantic communication is an emerging research area that has gained a wide range of attention recently. Despite this growing interest, there remains a notable absence of a comprehensive and widely-accepted framework for characterizing…

Information Theory · Computer Science 2025-09-03 Yulin Shao , Qi Cao , Deniz Gunduz

In this paper, we develop a deep learning based semantic communication system for speech transmission, named DeepSC-ST. We take the speech recognition and speech synthesis as the transmission tasks of the communication system, respectively.…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-03 Zhenzi Weng , Zhijin Qin , Xiaoming Tao , Chengkang Pan , Guangyi Liu , Geoffrey Ye Li

Semantic-oriented communication has been considered as a promising to boost the bandwidth efficiency by only transmitting the semantics of the data. In this paper, we propose a multi-level semantic aware communication system for wireless…

Image and Video Processing · Electrical Eng. & Systems 2023-12-11 Zhenguo Zhang , Qianqian Yang , Shibo He , Mingyang Sun , Jiming Chen

The traditional communications transmit all the source data represented by bits, regardless of the content of source and the semantic information required by the receiver. However, in some applications, the receiver only needs part of the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-30 Zhenzi Weng , Zhijin Qin , Geoffrey Ye Li

6G networks promise revolutionary immersive communication experiences including augmented reality (AR), virtual reality (VR), and holographic communications. These applications demand high-dimensional multimodal data transmission and…

Machine Learning · Computer Science 2025-07-08 Yusong Zhang , Yuxuan Sun , Lei Guo , Wei Chen , Bo Ai , Deniz Gunduz

Semantic communication has emerged as a promising technology for enhancing communication efficiency. However, most existing research emphasizes single-task reconstruction, neglecting model adaptability and generalization across multi-task…

Information Theory · Computer Science 2025-04-01 Weiwen Yuan , Jinke Ren , Chongjie Wang , Ruichen Zhang , Jun Wei , Dong In Kim , Shuguang Cui

We consider a semantic communication system for speech signals, named DeepSC-S. Motivated by the breakthroughs in deep learning (DL), we make an effort to recover the transmitted speech signals in the semantic communication systems, which…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-09 Zhenzi Weng , Zhijin Qin , Geoffrey Ye Li

In this paper, we propose a novel semantic-aided image communication framework for supporting the compatibility with practical separation-based coding architectures. Particularly, the deep learning (DL)-based joint source-channel coding…

Information Theory · Computer Science 2025-05-01 Mingkai Xu , Yongpeng Wu , Yuxuan Shi , Xiang-Gen Xia , Merouane Debbah , Wenjun Zhang , Ping Zhang

Natural language is widely used to describe, prompt, and control audio systems, but rarely serves as the representation carrying audio itself. We introduce lexical acoustic coding (LAC), a framework in which pre-trained LLM sender and…

Machine Learning · Computer Science 2026-05-12 Emanuele Rossi , Emanuele Rodolà

Semantic communication is proposed and expected to improve the efficiency of massive data transmission over sixth generation (6G) networks. However, existing image semantic communication schemes are primarily focused on optimizing…

Multimedia · Computer Science 2025-06-09 Zehao Chen , Xinfeng Wei , Haonan Tong , Zhaohui Yang , Changchuan Yin

Large language models (LLMs) have showcased remarkable prowess in code generation. However, automated code generation is still challenging since it requires a high-level semantic mapping between natural language requirements and codes. Most…

Computation and Language · Computer Science 2023-10-24 Yingwei Ma , Yue Yu , Shanshan Li , Yu Jiang , Yong Guo , Yuanliang Zhang , Yutao Xie , Xiangke Liao

Recently, learning-based semantic communication (SemCom) has emerged as a promising approach in the upcoming 6G network and researchers have made remarkable efforts in this field. However, existing works have yet to fully explore the…

Signal Processing · Electrical Eng. & Systems 2024-04-01 Shunpu Tang , Qianqian Yang , Deniz Gündüz , Zhaoyang Zhang

Joint source-channel coding (JSCC) is a promising paradigm for next-generation communication systems, particularly in challenging transmission environments. In this paper, we propose a novel standard-compatible JSCC framework for the…

Information Theory · Computer Science 2025-01-07 Xue Han , Yongpeng Wu , Zhen Gao , Biqian Feng , Yuxuan Shi , Deniz Gündüz , Wenjun Zhang