English
Related papers

Related papers: Editable-DeepSC: Cross-Modal Editable Semantic Com…

200 papers

This paper presents an adaptive framework for edge inference based on a dynamically configurable transformer-powered deep joint source channel coding (DJSCC) architecture. Motivated by a practical scenario where a resource constrained edge…

Machine Learning · Computer Science 2025-05-26 Alessio Devoto , Jary Pomponi , Mattia Merluzzi , Paolo Di Lorenzo , Simone Scardapane

Semantic communications utilize the transceiver computing resources to alleviate scarce transmission resources, such as bandwidth and energy. Although the conventional deep learning (DL) based designs may achieve certain transmission…

Signal Processing · Electrical Eng. & Systems 2023-02-28 Shuai Ma , Weining Qiao , Youlong Wu , Hang Li , Guangming Shi , Dahua Gao , Yuanming Shi , Shiyin Li , Naofal Al-Dhahir

Semantic communications seeks to transfer information from a source while conveying a desired meaning to its destination. We model the transmitter-receiver functionalities as an autoencoder followed by a task classifier that evaluates the…

Cryptography and Security · Computer Science 2022-12-21 Yalin E. Sagduyu , Tugba Erpek , Sennur Ulukus , Aylin Yener

With the development of deep learning (DL), natural language processing (NLP) makes it possible for us to analyze and understand a large amount of language texts. Accordingly, we can achieve a semantic communication in terms of joint…

Computation and Language · Computer Science 2021-11-30 Qingyang Zhou , Rongpeng Li , Zhifeng Zhao , Chenghui Peng , Honggang Zhang

Discrete representation has emerged as a powerful tool in task-oriented semantic communication (ToSC), offering compact, interpretable, and efficient representations well-suited for low-power edge intelligence scenarios. Its inherent…

Signal Processing · Electrical Eng. & Systems 2025-08-07 Anbang Zhang , Shuaishuai Guo , Chenyuan Feng , Hongyang Du , Haojin Li , Chen Sun , Haijun Zhang

Deep learning based semantic communication has achieved significant progress in wireless image transmission, but most existing schemes rely on fixed models and thus lack robustness to diverse image contents and dynamic channel conditions.…

Machine Learning · Computer Science 2026-04-06 Haowen Wan , Qianqian Yang

Semantic communications have been utilized to execute numerous intelligent tasks by transmitting task-related semantic information instead of bits. In this article, we propose a semantic-aware speech-to-text transmission system for the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-08 Zhenzi Weng , Zhijin Qin , Huiqiang Xie , Xiaoming Tao , Khaled B. Letaief

Differing from the conventional communication system paradigm that models information source as a sequence of (i.i.d. or stationary) random variables, the semantic approach aims at extracting and sending the high-level features of the…

Information Theory · Computer Science 2025-01-22 Mingxiao Li , Kaiming Shen , Shuguang Cui

In the new paradigm of semantic communication (SC), the focus is on delivering meanings behind bits by extracting semantic information from raw data. Recent advances in data-to-text models facilitate language-oriented SC, particularly for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Giordano Cicchetti , Eleonora Grassucci , Jihong Park , Jinho Choi , Sergio Barbarossa , Danilo Comminiello

The rapid development of deep learning (DL) and widespread applications of Internet-of-Things (IoT) have made the devices smarter than before, and enabled them to perform more intelligent tasks. However, it is challenging for any IoT device…

Signal Processing · Electrical Eng. & Systems 2020-11-26 Huiqiang Xie , Zhijin Qin

We propose a general method for semantic representation of images and other data using progressive coding. Semantic coding allows for specific pieces of information to be selectively encoded into a set of measurements that can be highly…

Signal Processing · Electrical Eng. & Systems 2023-09-29 Eva Riherd , Raghu Mudumbai , Weiyu Xu

A large body of recent work targets semantically conditioned image generation. Most such methods focus on the narrower task of pose transfer and ignore the more challenging task of subject transfer that consists in not only transferring the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Nicolas Dufour , David Picard , Vicky Kalogeiton

Deep learning based semantic communication (DeepSC) system has emerged as a promising paradigm for efficient wireless transmission. However, existing image DeepSC methods, frequently encounter challenges in balancing rate-distortion…

Image and Video Processing · Electrical Eng. & Systems 2025-12-08 Yinhuan Huang , Zhijin Qin

This paper explores the concept of information importance in multi-modal task-oriented semantic communication systems, emphasizing the need for high accuracy and efficiency to fulfill task-specific objectives. At the transmitter, generative…

Signal Processing · Electrical Eng. & Systems 2025-02-25 Yi Ma , Chunmei Xu , Zhenyu Liu , Siqi Zhang , Rahim Tafazolli

Semantic communication is a novel communication paradigm which draws inspiration from human communication focusing on the delivery of the meaning of a message to the intended users. It has attracted significant interest recently due to its…

Networking and Internet Architecture · Computer Science 2022-03-17 Yong Xiao , Yingyu Li , Guangming Shi , H. Vincent Poor

Semantic communication in the 6G era has been deemed a promising communication paradigm to break through the bottleneck of traditional communications. However, its applications for the multi-user scenario, especially the broadcasting case,…

Machine Learning · Computer Science 2022-09-21 Han Hu , Xingwu Zhu , Fuhui Zhou , Wei Wu , Rose Qingyang Hu , Hongbo Zhu

Semantic communication has shown great potential in boosting the effectiveness and reliability of communications. However, its systems to date are mostly enabled by deep learning, which requires demanding computing resources. This article…

Information Theory · Computer Science 2023-12-04 Zhijin Qin , Jingkai Ying , Dingxi Yang , Hengjiang Wang , Xiaoming Tao

Multimodal semantic communication has great potential to enhance downstream task performance by integrating complementary information across modalities. This paper introduces ProMSC-MIS, a novel Prompt-based Multimodal Semantic…

Multimedia · Computer Science 2025-08-28 Haoshuo Zhang , Yufei Bo , Meixia Tao

Semantic communication, when examined through the lens of joint source-channel coding (JSCC), maps source messages directly into channel input symbols, where the measure of success is defined by end-to-end distortion rather than traditional…

Information Theory · Computer Science 2024-07-09 Tze-Yang Tung , Homa Esfahanizadeh , Jinfeng Du , Harish Viswanathan

Semantic communication has gained significant attention from researchers as a promising technique to replace conventional communication in the next generation of communication systems, primarily due to its ability to reduce communication…

Information Theory · Computer Science 2025-02-07 Loc X. Nguyen , Ye Lin Tun , Yan Kyaw Tun , Minh N. H. Nguyen , Chaoning Zhang , Zhu Han , Choong Seon Hong