English
Related papers

Related papers: Semantic Communication via Rate Distortion Percept…

200 papers

Semantic communication is an increasingly popular framework for wireless image transmission due to its high communication efficiency. With the aid of the joint-source-and-channel (JSC) encoder implemented by neural network, semantic…

Information Theory · Computer Science 2022-12-02 Maojun Zhang , Yang Li , Zezhong Zhang , Guangxu Zhu , Caijun Zhong

With the exponential surge in traffic data and the pressing need for ultra-low latency in emerging intelligence applications, it is envisioned that 6G networks will demand disruptive communication technologies to foster ubiquitous…

Information Theory · Computer Science 2024-08-12 Youlong Wu , Yuanmin Shi , Shuai Ma , Chunxiao Jiang , Wei Zhang , Khaled B. Letaief

This paper proposes a novel knowledge-Base (KB) assisted semantic communication framework for image transmission. At the receiver, a Facebook AI Similarity Search (FAISS) based vector database is constructed by extracting semantic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Chongyang Li , Yanmei He , Tianqian Zhang , Mingjian He , Shouyin Liu

In the evolving landscape of 6G networks, semantic communications are poised to revolutionize data transmission by prioritizing the transmission of semantic meaning over raw data accuracy. This paper presents a Vision Transformer…

Image and Video Processing · Electrical Eng. & Systems 2025-03-24 Muhammad Ahmed Mohsin , Muhammad Jazib , Zeeshan Alam , Muhmmad Farhan Khan , Muhammad Saad , Muhammad Ali Jamshed

Rate-distortion theory provides bounds for compressing data produced by an information source to a specified encoding rate that is strictly less than the source's entropy. This necessarily entails some loss, or distortion, between the…

Quantum Physics · Physics 2019-02-06 Sina Salek , Daniela Cadamuro , Philipp Kammerlander , Karoline Wiesner

Semantic communication initiates a new direction for future communication. In this paper, we aim to establish a systematic framework of semantic information theory (SIT). First, we propose a semantic communication model and define the…

Information Theory · Computer Science 2024-01-26 Kai Niu , Ping Zhang

Differing from the conventional communication system paradigm that models information source as a sequence of (i.i.d. or stationary) random variables, the semantic approach aims at extracting and sending the high-level features of the…

Information Theory · Computer Science 2025-01-22 Mingxiao Li , Kaiming Shen , Shuguang Cui

Extracting relevant information from data is crucial for all forms of learning. The information bottleneck (IB) method formalizes this, offering a mathematically precise and conceptually appealing framework for understanding learning…

Machine Learning · Computer Science 2021-10-27 Vudtiwat Ngampruetikorn , David J. Schwab

Semantic communication (SemCom) has emerged as a promising paradigm for 6G wireless systems by transmitting task-relevant information rather than raw bits, yet existing approaches remain vulnerable to dual sources of uncertainty: semantic…

Networking and Internet Architecture · Computer Science 2026-01-26 Long Tan Le , Senura Hansaja Wanasekara , Zerun Niu , Nguyen H. Tran , Phuong Vo , Walid Saad , Dusit Niyato , Zhu Han , Choong Seon Hong , H. Vincent Poor

Representation learning of graph-structured data is challenging because both graph structure and node features carry important information. Graph Neural Networks (GNNs) provide an expressive way to fuse information from network structure…

Machine Learning · Computer Science 2020-10-27 Tailin Wu , Hongyu Ren , Pan Li , Jure Leskovec

The exponential growth of IoT devices presents critical challenges in bandwidth-constrained wireless networks, particularly regarding efficient data transmission and privacy preservation. This paper presents a novel federated semantic…

Networking and Internet Architecture · Computer Science 2025-06-23 Samer Lahoud , Kinda Khawam

The muti-layer information bottleneck (IB) problem, where information is propagated (or successively refined) from layer to layer, is considered. Based on information forwarded by the preceding layer, each stage of the network is required…

Machine Learning · Statistics 2017-11-15 Qianqian Yang , Pablo Piantanida , Deniz Gündüz

This paper analyzes the fundamental limit of the strategic semantic communication problem in which a transmitter obtains a limited number of indirect observation of an intrinsic semantic information source and can then influence the…

Information Theory · Computer Science 2022-08-09 Yong Xiao , Xu Zhang , Yingyu Li , Guangming Shi , Tamer Basar

Multi-node communication, which refers to the interaction among multiple devices, has attracted lots of attention in many Internet-of-Things (IoT) scenarios. However, its huge amounts of data flows and inflexibility for task extension have…

Machine Learning · Computer Science 2023-08-09 Bingyan Xie , Yongpeng Wu , Yuxuan Shi , Derrick Wing Kwan Ng , Wenjun Zhang

Semantic Communication (SC) is an emerging technology that has attracted much attention in the sixth-generation (6G) mobile communication systems. However, few literature has fully considered the perceptual quality of the reconstructed…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Kexin Zhang , Lixin Li , Wensheng Lin , Yuna Yan , Wenchi Cheng , Zhu Han

Information bottleneck (IB) is a paradigm to extract information in one target random variable from another relevant random variable, which has aroused great interest due to its potential to explain deep neural networks in terms of…

Information Theory · Computer Science 2023-08-23 Lingyi Chen , Shitong Wu , Wenhao Ye , Huihui Wu , Hao Wu , Wenyi Zhang , Bo Bai , Yining Sun

Recently, semantic communication has been widely applied in wireless image transmission systems as it can prioritize the preservation of meaningful semantic information in images over the accuracy of transmitted symbols, leading to improved…

Information Theory · Computer Science 2023-04-20 Shunpu Tang , Qianqian Yang , Lisheng Fan , Xianfu Lei , Yansha Deng , Arumugam Nallanathan

We introduce a new semantic communication mechanism - SemanticRL, whose key idea is to preserve the semantic information instead of strictly securing the bit-level precision. Unlike previous methods that mainly concentrate on the network or…

Machine Learning · Computer Science 2022-04-04 Kun Lu , Rongpeng Li , Xianfu Chen , Zhifeng Zhao , Honggang Zhang

Recently, integrating the local modeling capabilities of Convolutional Neural Networks (CNNs) with the global dependency strengths of Transformers has created a sensation in the semantic segmentation community. However, substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Yangyang Qiu , Guoan Xu , Guangwei Gao , Zhenhua Guo , Yi Yu , Chia-Wen Lin

Recent years, many researches attempt to open the black box of deep neural networks and propose a various of theories to understand it. Among them, Information Bottleneck (IB) theory claims that there are two distinct phases consisting of…

Machine Learning · Statistics 2021-02-22 Junjie Li , Ding Liu