English
Related papers

Related papers: Latent Feature-Guided Conditional Diffusion for Ge…

200 papers

Semantic communication has gained significant attention recently due to its advantages in achieving higher transmission efficiency by focusing on semantic information instead of bit-level information. However, current AI-based semantic…

Signal Processing · Electrical Eng. & Systems 2023-12-04 Shuyi Chen , Yingzhe Hui , Yifan Qin , Yueyi Yuan , Weixiao Meng , Xuewen Luo , Hsiao-Hwa Chen

Recent DiT-based text-to-image models increasingly adopt LLMs as text encoders, yet text conditioning remains largely static and often utilizes only a single LLM layer, despite pronounced semantic hierarchy across LLM layers and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Bozhou Li , Yushuo Guan , Haolin Li , Bohan Zeng , Yiyan Ji , Yue Ding , Pengfei Wan , Kun Gai , Yuanxing Zhang , Wentao Zhang

Semantic communication, when examined through the lens of joint source-channel coding (JSCC), maps source messages directly into channel input symbols, where the measure of success is defined by end-to-end distortion rather than traditional…

Information Theory · Computer Science 2024-07-09 Tze-Yang Tung , Homa Esfahanizadeh , Jinfeng Du , Harish Viswanathan

Foundation model-based semantic transmission has recently shown great potential in wireless image communication. However, existing methods exhibit two major limitations: (i) they overlook the varying importance of semantic components for…

Image and Video Processing · Electrical Eng. & Systems 2025-09-30 Fangyu Liu , Peiwen Jiang , Wenjin Wang , Chao-Kai Wen , Shi Jin , Jun Zhang

Joint source-channel coding (JSCC) offers a promising avenue for enhancing transmission efficiency by jointly incorporating source and channel statistics into the system design. A key advancement in this area is the deep joint source and…

Information Theory · Computer Science 2025-07-22 Maojun Zhang , Haotian Wu , Guangxu Zhu , Richeng Jin , Xiaoming Chen , Deniz Gündüz

Semantic communication focuses on conveying the task-relevant meaning rather than exact bitwise recovery. For image transmission with a generative receiver, relying only on text descriptions can be insufficient to preserve instance-specific…

Information Theory · Computer Science 2026-01-27 Xuesong Wang , Xinyan Xie , Mo Li , Zhaoqian Liu

Remote sensing image change captioning (RSICC) aims to articulate the changes in objects of interest within bi-temporal remote sensing images using natural language. Given the limitations of current RSICC methods in expressing general…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Yongshuo Zhu , Lu Li , Keyan Chen , Chenyang Liu , Fugen Zhou , Zhenwei Shi

Recently, learning-based semantic communication (SemCom) has emerged as a promising approach in the upcoming 6G network and researchers have made remarkable efforts in this field. However, existing works have yet to fully explore the…

Signal Processing · Electrical Eng. & Systems 2024-04-01 Shunpu Tang , Qianqian Yang , Deniz Gündüz , Zhaoyang Zhang

Semantic communication, rather than on a bit-by-bit recovery of the transmitted messages, focuses on the meaning and the goal of the communication itself. In this paper, we propose a novel semantic image coding scheme that preserves the…

Information Theory · Computer Science 2024-02-23 Francesco Pezone , Osman Musa , Giuseppe Caire , Sergio Barbarossa

Deep learning-based joint source-channel coding (deep JSCC) has been demonstrated to be an effective approach for wireless image transmission. Nevertheless, most existing work adopts an autoencoder framework to optimize conventional…

Signal Processing · Electrical Eng. & Systems 2025-03-25 Mingyu Yang , Bowen Liu , Boyang Wang , Hun-Seok Kim

Semantic communications, aiming at ensuring the successful delivery of the meaning of information, are expected to be one of the potential techniques for the next generation communications. However, the knowledge forming and synchronizing…

Image and Video Processing · Electrical Eng. & Systems 2024-01-17 Yuan Zheng , Fengyu Wang , Wenjun Xu , Miao Pan , Ping Zhang

The importance of Radio Access Network (RAN) in support Artificial Intelligence (AI) application services has grown significantly, underscoring the need for an integrated approach that considers not only network efficiency but also AI…

Systems and Control · Electrical Eng. & Systems 2025-08-19 Jinhyuk Choi , Jihong Park , Seungeun Oh , Seong-Lyun Kim

With the recent advancements in edge artificial intelligence (AI), future sixth-generation (6G) networks need to support new AI tasks such as classification and clustering apart from data recovery. Motivated by the success of deep learning,…

Networking and Internet Architecture · Computer Science 2023-04-06 Zhonghao Lyu , Guangxu Zhu , Jie Xu , Bo Ai , Shuguang Cui

Multimodal semantic communication has great potential to enhance downstream task performance by integrating complementary information across modalities. This paper introduces ProMSC-MIS, a novel Prompt-based Multimodal Semantic…

Multimedia · Computer Science 2025-08-28 Haoshuo Zhang , Yufei Bo , Meixia Tao

Semantic communications could improve the transmission efficiency significantly by exploring the semantic information. In this paper, we make an effort to recover the transmitted speech signals in the semantic communication systems, which…

Signal Processing · Electrical Eng. & Systems 2021-09-09 Zhenzi Weng , Zhijin Qin

Generative foundation AI models have recently shown great success in synthesizing natural signals with high perceptual quality using only textual prompts and conditioning signals to guide the generation process. This enables semantic…

Information Theory · Computer Science 2024-08-20 Li Qiao , Mahdi Boloursaz Mashhadi , Zhen Gao , Chuan Heng Foh , Pei Xiao , Mehdi Bennis

Deep learning (DL) based semantic communication methods have been explored for the efficient transmission of images, text, and speech in recent years. In contrast to traditional wireless communication methods that focus on the transmission…

Audio and Speech Processing · Electrical Eng. & Systems 2022-05-26 Tianxiao Han , Qianqian Yang , Zhiguo Shi , Shibo He , Zhaoyang Zhang

Underwater communication is essential for environmental monitoring, marine biology research, and underwater exploration. Traditional underwater communication faces limitations like low bandwidth, high latency, and susceptibility to noise,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Weilong Chen , Wenxuan Xu , Haoran Chen , Xinran Zhang , Zhijin Qin , Yanru Zhang , Zhu Han

We propose a novel framework to learn how to communicate with intent, i.e., to transmit messages over a wireless communication channel based on the end-goal of the communication. This stays in stark contrast to classical communication…

Signal Processing · Electrical Eng. & Systems 2022-11-24 Miguel Angel Gutierrez-Estevez , Yiqun Wu , Chan Zhou

The end-to-end image communication system has been widely studied in the academic community. The escalating demands on image communication systems in terms of data volume, environmental complexity, and task precision require enhanced…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Senran Fan , Zhicheng Bao , Chen Dong , Haotai Liang , Xiaodong Xu , Ping Zhang