English
Related papers

Related papers: Foundation Model-Based Adaptive Semantic Image Tra…

200 papers

Semantic communication is an increasingly popular framework for wireless image transmission due to its high communication efficiency. With the aid of the joint-source-and-channel (JSC) encoder implemented by neural network, semantic…

Information Theory · Computer Science 2022-12-02 Maojun Zhang , Yang Li , Zezhong Zhang , Guangxu Zhu , Caijun Zhong

Multi-node communication, which refers to the interaction among multiple devices, has attracted lots of attention in many Internet-of-Things (IoT) scenarios. However, its huge amounts of data flows and inflexibility for task extension have…

Machine Learning · Computer Science 2023-08-09 Bingyan Xie , Yongpeng Wu , Yuxuan Shi , Derrick Wing Kwan Ng , Wenjun Zhang

Widely adopted medical image segmentation methods, although efficient, are primarily deterministic and remain poorly amenable to natural language prompts. Thus, they lack the capability to estimate multiple proposals, human interaction, and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Yuan Lin , Murong Xu , Marc Hölle , Chinmay Prabhakar , Andreas Maier , Vasileios Belagiannis , Bjoern Menze , Suprosanna Shit

Latest diffusion-based methods for many image restoration tasks outperform traditional models, but they encounter the long-time inference problem. To tackle it, this paper proposes a Wavelet-Based Diffusion Model (WaveDM). WaveDM learns the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Yi Huang , Jiancheng Huang , Jianzhuang Liu , Mingfu Yan , Yu Dong , Jiaxi Lv , Chaoqi Chen , Shifeng Chen

Deep neural network (DNN)-based algorithms are emerging as an important tool for many physical and MAC layer functions in future wireless communication systems, including for large multi-antenna channels. However, training such models…

Information Theory · Computer Science 2025-10-17 Taekyun Lee , Juseong Park , Hyeji Kim , Jeffrey G. Andrews

Wireless image transmission underpins diverse networked intelligent services and becomes an increasingly critical issue. Existing works have shown that deep learning-based joint source-channel coding (JSCC) is an effective framework to…

Signal Processing · Electrical Eng. & Systems 2025-09-16 Haozhen Li , Ruide Zhang , Rongqing Zhang , Xiang Cheng

This paper proposes a novel Semantic Communication (SemCom) framework for real-time adaptive-bitrate video streaming by integrating Latent Diffusion Models (LDMs) within the FFmpeg techniques. This solution addresses the challenges of high…

Multimedia · Computer Science 2025-08-04 Zijiang Yan , Jianhua Pei , Hongda Wu , Hina Tabassum , Ping Wang

With the rapid development of Artificial Intelligent Internet of Things (AIoT), the image data from AIoT devices has been witnessing the explosive increasing. In this paper, a novel deep image semantic communication model is proposed for…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Li Ping Qian , Yi Zhang , Sikai Lyu , Huijie Zhu , Yuan Wu , Xuemin Sherman Shen , Xiaoniu Yang

Semantic communication has undergone considerable evolution due to the recent rapid development of artificial intelligence (AI), significantly enhancing both communication robustness and efficiency. Despite these advancements, most current…

Image and Video Processing · Electrical Eng. & Systems 2024-05-24 Jiarun Ding , Peiwen Jiang , Chao-Kai Wen , Shi Jin

This paper introduces WavesFM, a novel Wireless Foundation Model (WFM) framework, capable of supporting a wide array of communication, sensing, and localization tasks. Our proposed architecture combines a shared Vision Transformer (ViT)…

Signal Processing · Electrical Eng. & Systems 2025-04-22 Ahmed Aboulfotouh , Elsayed Mohammed , Hatem Abou-Zeid

The emerging field semantic communication is driving the research of end-to-end data transmission. By utilizing the powerful representation ability of deep learning models, learned data transmission schemes have exhibited superior…

Information Theory · Computer Science 2023-05-25 Jincheng Dai , Sixian Wang , Ke Yang , Kailin Tan , Xiaoqi Qin , Zhongwei Si , Kai Niu , Ping Zhang

Semantic communication has emerged as a promising technology for enhancing communication efficiency. However, most existing research emphasizes single-task reconstruction, neglecting model adaptability and generalization across multi-task…

Information Theory · Computer Science 2025-04-01 Weiwen Yuan , Jinke Ren , Chongjie Wang , Ruichen Zhang , Jun Wei , Dong In Kim , Shuguang Cui

The end-to-end image communication system has been widely studied in the academic community. The escalating demands on image communication systems in terms of data volume, environmental complexity, and task precision require enhanced…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Senran Fan , Zhicheng Bao , Chen Dong , Haotai Liang , Xiaodong Xu , Ping Zhang

Diffusion models have recently been shown to excel in many image reconstruction tasks that involve inverse problems based on a forward measurement operator. A common framework uses task-agnostic unconditional models that are later…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Alper Güngör , Bahri Batuhan Bilecen , Tolga Çukur

Multimodal semantic communication has great potential to enhance downstream task performance by integrating complementary information across modalities. This paper introduces ProMSC-MIS, a novel Prompt-based Multimodal Semantic…

Multimedia · Computer Science 2025-08-28 Haoshuo Zhang , Yufei Bo , Meixia Tao

To achieve continuous massive data transmission with significantly reduced data payload, the users can adopt semantic communication techniques to compress the redundant information by transmitting semantic features instead. However, current…

Signal Processing · Electrical Eng. & Systems 2024-01-30 Youcheng Zeng , Xinxin He , Xu Chen , Haonan Tong , Zhaohui Yang , Yijun Guo , Jianjun Hao

Semantic communication focuses on conveying the task-relevant meaning rather than exact bitwise recovery. For image transmission with a generative receiver, relying only on text descriptions can be insufficient to preserve instance-specific…

Information Theory · Computer Science 2026-01-27 Xuesong Wang , Xinyan Xie , Mo Li , Zhaoqian Liu

Semantic communication aims to transmit information most relevant to a task rather than raw data, offering significant gains in communication efficiency for applications such as telepresence, augmented reality, and remote sensing. Recent…

Machine Learning · Computer Science 2025-12-18 Matin Mortaheb , Erciyes Karakaya , Sennur Ulukus

In this paper, we propose a novel semantic-aided image communication framework for supporting the compatibility with practical separation-based coding architectures. Particularly, the deep learning (DL)-based joint source-channel coding…

Information Theory · Computer Science 2025-05-01 Mingkai Xu , Yongpeng Wu , Yuxuan Shi , Xiang-Gen Xia , Merouane Debbah , Wenjun Zhang , Ping Zhang

Recently, deep learning enabled semantic communications have been developed to understand transmission content from semantic level, which realize effective and accurate information transfer. Aiming to the vision of sixth generation (6G)…

Signal Processing · Electrical Eng. & Systems 2024-03-04 Zhengyu Zhang , Ruisi He , Mi Yang , Xuejian Zhang , Ziyi Qi , Yuan Yuan , Bo Ai