English
Related papers

Related papers: Image Generative Semantic Communication with Multi…

200 papers

Recently, semantic communication has been investigated to boost the performance of end-to-end image transmission systems. However, existing semantic approaches are generally based on deep learning and belong to lossy transmission.…

Signal Processing · Electrical Eng. & Systems 2023-08-23 Guangyi Zhang , Qiyu Hu , Yunlong Cai , Guanding Yu

Camera sensors have been widely used in intelligent robotic systems. Developing camera sensors with high sensing efficiency has always been important to reduce the power, memory, and other related resources. Inspired by recent success on…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Bowen Zhang , Zhijin Qin , Geoffrey Ye Li

Semantic image synthesis, translating semantic layouts to photo-realistic images, is a one-to-many mapping problem. Though impressive progress has been recently made, diverse semantic synthesis that can efficiently produce semantic-level…

Computer Vision and Pattern Recognition · Computer Science 2021-03-12 Zhentao Tan , Menglei Chai , Dongdong Chen , Jing Liao , Qi Chu , Bin Liu , Gang Hua , Nenghai Yu

Image-based single-modality compression learning approaches have demonstrated exceptionally powerful encoding and decoding capabilities in the past few years , but suffer from blur and severe semantics loss at extremely low bitrates. To…

Image and Video Processing · Electrical Eng. & Systems 2023-04-27 Xuhao Jiang , Weimin Tan , Tian Tan , Bo Yan , Liquan Shen

This paper investigates semantic communications between a transmitter and a receiver, where original data, such as videos of interest to the receiver, is stored at the transmitter. Although significant process has been made in semantic…

Information Theory · Computer Science 2024-11-21 Xunze Liu , Yifei Sun , Zhaorui Wang , Lizhao You , Haoyuan Pan , Fangxin Wang , Shuguang Cui

Semantic communications have gained significant attention as a promising approach to address the transmission bottleneck, especially with the continuous development of 6G techniques. Distinct from the well investigated physical channel…

Signal Processing · Electrical Eng. & Systems 2024-03-15 Xiang Peng , Zhijin Qin , Xiaoming Tao , Jianhua Lu , Khaled B. Letaief

Deep learning based semantic communication has achieved significant progress in wireless image transmission, but most existing schemes rely on fixed models and thus lack robustness to diverse image contents and dynamic channel conditions.…

Machine Learning · Computer Science 2026-04-06 Haowen Wan , Qianqian Yang

Despite significant advancements in traditional syntactic communications based on Shannon's theory, these methods struggle to meet the requirements of 6G immersive communications, especially under challenging transmission conditions. With…

Signal Processing · Electrical Eng. & Systems 2025-09-30 Hang Yin , Li Qiao , Yu Ma , Shuo Sun , Kan Li , Zhen Gao , Dusit Niyato

This paper proposes a novel knowledge-Base (KB) assisted semantic communication framework for image transmission. At the receiver, a Facebook AI Similarity Search (FAISS) based vector database is constructed by extracting semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Chongyang Li , Yanmei He , Tianqian Zhang , Mingjian He , Shouyin Liu

Image fusion methods and metrics for their evaluation have conventionally used pixel-based or low-level features. However, for many applications, the aim of image fusion is to effectively combine the semantic content of the input images.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-14 P. R. Hill , D. R. Bull

We present semantic attribute matching networks (SAM-Net) for jointly establishing correspondences and transferring attributes across semantically similar images, which intelligently weaves the advantages of the two tasks while overcoming…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Seungryong Kim , Dongbo Min , Somi Jeong , Sunok Kim , Sangryul Jeon , Kwanghoon Sohn

Semantic communication enables intelligent agents to extract meaning (or semantics) of information via interaction, to carry out collaborative tasks. In this paper, we study semantic communication from a topological space perspective, in…

Signal Processing · Electrical Eng. & Systems 2022-11-01 Qiyang Zhao , Mehdi Bennis , Merouane Debbah , Daniel Benevides da Costa

Semantic communication allows the receiver to know the intention instead of the bit information itself, which is an emerging technique to support real-time human-machine and machine-to-machine interactions for future wireless…

Information Theory · Computer Science 2023-01-05 Zhaohui Yang , Mingzhe Chen , Gaolei Li , Yang Yang , Zhaoyang Zhang

Semantic communication is an increasingly popular framework for wireless image transmission due to its high communication efficiency. With the aid of the joint-source-and-channel (JSC) encoder implemented by neural network, semantic…

Information Theory · Computer Science 2022-12-02 Maojun Zhang , Yang Li , Zezhong Zhang , Guangxu Zhu , Caijun Zhong

Underwater communication is essential for environmental monitoring, marine biology research, and underwater exploration. Traditional underwater communication faces limitations like low bandwidth, high latency, and susceptibility to noise,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Weilong Chen , Wenxuan Xu , Haoran Chen , Xinran Zhang , Zhijin Qin , Yanru Zhang , Zhu Han

In the new paradigm of semantic communication (SC), the focus is on delivering meanings behind bits by extracting semantic information from raw data. Recent advances in data-to-text models facilitate language-oriented SC, particularly for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Giordano Cicchetti , Eleonora Grassucci , Jihong Park , Jinho Choi , Sergio Barbarossa , Danilo Comminiello

Foundation model-based semantic transmission has recently shown great potential in wireless image communication. However, existing methods exhibit two major limitations: (i) they overlook the varying importance of semantic components for…

Image and Video Processing · Electrical Eng. & Systems 2025-09-30 Fangyu Liu , Peiwen Jiang , Wenjin Wang , Chao-Kai Wen , Shi Jin , Jun Zhang

Semantic communication has emerged as a promising paradigm for next-generation wireless systems, improving the communication efficiency by transmitting high-level semantic features. However, reliance on unimodal representations can degrade…

Signal Processing · Electrical Eng. & Systems 2025-09-11 Haoran Chang , Mingzhe Chen , Huaxia Wang , Qianqian Zhang

Recently, the ever-increasing demand for bandwidth in multi-modal communication systems requires a paradigm shift. Powered by deep learning, semantic communications are applied to multi-modal scenarios to boost communication efficiency and…

Signal Processing · Electrical Eng. & Systems 2023-05-19 Yangshuo He , Guanding Yu , Yunlong Cai

Feature modeling of different modalities is a basic problem in current research of cross-modal information retrieval. Existing models typically project texts and images into one embedding space, in which semantically similar information…

Multimedia · Computer Science 2019-06-13 Jing Yu , Chenghao Yang , Zengchang Qin , Zhuoqian Yang , Yue Hu , Weifeng Zhang