English
Related papers

Related papers: Rate-Distortion-Perception Theory for Semantic Com…

200 papers

We consider a setting of non-cooperative communication where a receiver wants to recover randomly generated sequences of symbols that are observed by a strategic sender. The sender aims to maximize an average utility that may not align with…

Information Theory · Computer Science 2025-03-03 Anuj S. Vora , Ankur A. Kulkarni

Semantic-aware communication is a novel paradigm that draws inspiration from human communication focusing on the delivery of the meaning of messages. It has attracted significant interest recently due to its potential to improve the…

Networking and Internet Architecture · Computer Science 2023-09-06 Yong Xiao , Yiwei Liao , Yingyu Li , Guangming Shi , H. Vincent Poor , Walid Saad , Merouane Debbah , Mehdi Bennis

We introduce a new measure of information-theoretic secrecy based on rate-distortion theory and study it in the context of the Shannon cipher system. Whereas rate-distortion theory is traditionally concerned with a single reconstruction…

Information Theory · Computer Science 2014-11-25 Curt Schieler , Paul Cuff

Semantic communication systems often use an end-to-end neural network to map input data into continuous symbols. These symbols, which are essentially neural network features, usually have fixed dimensions and heavy-tailed distributions.…

Information Theory · Computer Science 2025-12-17 Hanju Yoo , Dongha Choi , Songkuk Kim , Chan-Byoung Chae , Robert W. Heath

Semantic communication technology is regarded as a method surpassing the Shannon limit of bit transmission, capable of effectively enhancing transmission efficiency. However, current approaches that directly map content to transmission…

Signal Processing · Electrical Eng. & Systems 2025-11-12 Kaiwen Yu , Renhe Fan , Gang Wu , Zhijin Qin

Secrecy in communication systems is measured herein by the distortion that an adversary incurs. The transmitter and receiver share secret key, which they use to encrypt communication and ensure distortion at an adversary. A model is…

Information Theory · Computer Science 2015-04-14 Curt Schieler , Paul Cuff

In 1940s, Claude Shannon developed the information theory focusing on quantifying the maximum data rate that can be supported by a communication channel. Guided by this, the main theme of wireless system design up until 5G was the data rate…

Information Theory · Computer Science 2021-10-04 Qiao Lan , Dingzhu Wen , Zezhong Zhang , Qunsong Zeng , Xu Chen , Petar Popovski , Kaibin Huang

Recently, semantic communications have drawn great attention as the groundbreaking concept surpasses the limited capacity of Shannon's theory. Specifically, semantic communications probably become crucial in realizing visual tasks that…

Networking and Internet Architecture · Computer Science 2025-10-23 Jeonghun Park , Sung Whan Yoon

As one of the potential key technologies of 6G, semantic communication is still in its infancy and there are many open problems, such as semantic entropy definition and semantic channel coding theory. To address these challenges, we…

Information Theory · Computer Science 2025-02-20 Shuai Ma , Chuanhui Zhang , Huayan Qi , Hang Li , Yue Bi , Guangming Shi , Naofal Al-Dhahir

A new channel coding approach was proposed in [1] for random multiple access communication over the discrete-time memoryless channel. The coding approach allows users to choose their communication rates independently without sharing the…

Information Theory · Computer Science 2016-11-15 Zheng Wang , Jie Luo

Semantic communications can reduce the resource consumption by transmitting task-related semantic information extracted from source messages. However, when the source messages are utilized for various tasks, e.g., wireless sensing data for…

Signal Processing · Electrical Eng. & Systems 2023-03-28 Hongyang Du , Jiacheng Wang , Dusit Niyato , Jiawen Kang , Zehui Xiong , Junshan Zhang , Xuemin , Shen

In some rate-distortion-type problems, the required fidelity of information is affected by past actions. As a result, the distortion function depends not only on the instantaneous distortion between a source symbol and its representation…

Information Theory · Computer Science 2026-01-30 Hamidreza Abin , Amin Gohari , Andrew W. Eckford

We study the following semi-deterministic setting of the joint source-channel coding problem: a deterministic source sequence (a.k.a. individual sequence) is transmitted via a memoryless channel, using delay-limited encoder and decoder,…

Information Theory · Computer Science 2021-09-29 Neri Merhav

We study a setting where a receiver must design a questionnaire to recover a sequence of symbols known to strategic sender, whose utility may not be incentive compatible. We allow the receiver the possibility of selecting the alternatives…

Information Theory · Computer Science 2022-09-16 Anuj S. Vora , Ankur A. Kulkarni

Semantic communication is an emerging paradigm that focuses on understanding and delivering semantics, or meaning of messages. Most existing semantic communication solutions define semantic meaning as the meaning of object labels recognized…

Networking and Internet Architecture · Computer Science 2022-03-17 Jingming Liang , Yong Xiao , Yingyu Li , Guangming Shi , Mehdi Bennis

Shannon theory models communication as the reliable transfer of symbol sequences, with performance governed by capacity and rate-distortion limits. When both endpoints possess strong predictors -- as in modern large language models and…

Information Theory · Computer Science 2026-02-12 Ozgur Ercetin , Mohaned Chraiti

Semantic communications has received growing interest since it can remarkably reduce the amount of data to be transmitted without missing critical information. Most existing works explore the semantic encoding and transmission for text and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Danlan Huang , Feifei Gao , Xiaoming Tao , Qiyuan Du , Jianhua Lu

In image compression, with recent advances in generative modeling, existence of a trade-off between the rate and perceptual quality has been brought to light, where the perceptual quality is measured by the closeness of the output and…

Information Theory · Computer Science 2025-07-22 Yassine Hamdi , Aaron B. Wagner , Deniz Gündüz

The explosion of data has resulted in more and more associated text being transmitted along with images. Inspired by from distributed source coding, many works utilize image side information to enhance image compression. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Shiyu Qin , Bin Chen , Yujun Huang , Baoyi An , Tao Dai , Shu-Tao Xia

The development of emerging applications, such as autonomous transportation systems, are expected to result in an explosive growth in mobile data traffic. As the available spectrum resource becomes more and more scarce, there is a growing…

Networking and Internet Architecture · Computer Science 2022-02-15 Wanting Yang , Zi Qin Liew , Wei Yang Bryan Lim , Zehui Xiong , Dusit Niyato , Xuefen Chi , Xianbin Cao , Khaled B. Letaief