English
Related papers

Related papers: Rate-Distortion-Perception Theory for Semantic Com…

200 papers

Classical communication paradigms focus on accurately transmitting bits over a noisy channel, and Shannon theory provides a fundamental theoretical limit on the rate of reliable communications. In this approach, bits are treated equally,…

Information Theory · Computer Science 2022-06-03 Jincheng Dai , Ping Zhang , Kai Niu , Sixian Wang , Zhongwei Si , Xiaoqi Qin

Shannon's channel coding theorem characterizes the maximal rate of information that can be reliably transmitted over a communication channel when optimal encoding and decoding strategies are used. In many scenarios, however, practical…

Information Theory · Computer Science 2023-07-06 Jonathan Scarlett , Albert Guillén i Fàbregas , Anelia Somekh-Baruch , Alfonso Martinez

Semantic communications are considered a promising beyond-Shannon/bit paradigm to reduce network traffic and increase reliability, thus making wireless networks more energy efficient, robust, and sustainable. However, the performance is…

The goal of this paper is to promote the idea that including semantic and goal-oriented aspects in future 6G networks can produce a significant leap forward in terms of system effectiveness and sustainability. Semantic communication goes…

Networking and Internet Architecture · Computer Science 2021-02-18 Emilio Calvanese Strinati , Sergio Barbarossa

Semantic communication aims to convey meaning rather than bit-perfect reproduction, representing a paradigm shift from traditional communication. This paper investigates distribution learning in semantic communication where receivers must…

Machine Learning · Computer Science 2025-08-15 Samer Lahoud , Kinda Khawam

This paper applies Information Theoretic analysis to packet-based random multiple access communication systems. A new channel coding approach is proposed for coding within each data packet with built-in support for bursty traffic…

Information Theory · Computer Science 2016-11-17 Jie Luo , Anthony Ephremides

With the exponential surge in traffic data and the pressing need for ultra-low latency in emerging intelligence applications, it is envisioned that 6G networks will demand disruptive communication technologies to foster ubiquitous…

Information Theory · Computer Science 2024-08-12 Youlong Wu , Yuanmin Shi , Shuai Ma , Chunxiao Jiang , Wei Zhang , Khaled B. Letaief

Lossy compression algorithms are typically designed and analyzed through the lens of Shannon's rate-distortion theory, where the goal is to achieve the lowest possible distortion (e.g., low MSE or high SSIM) at any given bit rate. However,…

Machine Learning · Computer Science 2019-07-31 Yochai Blau , Tomer Michaeli

Semantic communication has emerged as a promising technology to break the Shannon limit by extracting the meaning of source data and sending relevant semantic information only. However, some mobile devices may have limited computation and…

Information Theory · Computer Science 2023-11-17 Tianyu Liu , Changsheng You , Zeyang Hu , Chenyu Wu , Yi Gong , Kaibin Huang

Shannon information theory is established based on probability and bits, and the communication technology based on this theory realizes the information age. The original goal of Shannon's information theory is to describe and transmit…

Signal Processing · Electrical Eng. & Systems 2023-03-28 Guangming Shi , Dahua Gao , Shuai Ma , Minxi Yang , Yong Xiao , Xuemei Xie

In generative communication, the transmitter sends a compact generative description, such as model parameters or a latent representation, rather than raw data. The receiver uses this description to form a posterior belief over the…

Information Theory · Computer Science 2026-05-14 Angeles Vazquez-Castro , Faheem Dustin Quazi , Zhu Han

In image compression, with recent advances in generative modeling, the existence of a trade-off between the rate and the perceptual quality has been brought to light, where the perception is measured by the closeness of the output…

Information Theory · Computer Science 2023-05-23 Yassine Hamdi , Deniz Gündüz

The traditional communications transmit all the source data represented by bits, regardless of the content of source and the semantic information required by the receiver. However, in some applications, the receiver only needs part of the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-30 Zhenzi Weng , Zhijin Qin , Geoffrey Ye Li

Information theory has provided foundations for the theories of several application areas critical for modern society, including communications, computer storage, and AI. A key aspect of Shannon's 1948 theory is a sharp lower bound on the…

As a new communication paradigm, semantic communication has received widespread attention in communication fields. However, since the decoding of semantic signals relies on contextual knowledge, misalignment between the starting position of…

Signal Processing · Electrical Eng. & Systems 2023-12-19 Xiaoyi Liu , Haotai Liang , Chen Dong , Xiaodong Xu

In Shannon theory, semantic aspects of communication were identified but considered irrelevant to the technical communication problems. Semantic communication (SC) techniques have recently attracted renewed research interests in (6G)…

Information Theory · Computer Science 2022-11-08 Shiva Raj Pokhrel , Jinho Choi

This paper studies a variant of the rate-distortion problem motivated by task-oriented semantic communication and distributed learning problems, where $M$ correlated sources are independently encoded for a central decoder. The decoder has…

Information Theory · Computer Science 2024-05-24 Jiancheng Tang , Qianqian Yang , Deniz Gündüz

Does semantic communication require a semantic information theory parallel to Shannon's information theory, or can Shannon's work be generalized for semantic communication? This paper advocates for the latter and introduces a semantic…

Information Theory · Computer Science 2025-10-21 Chenguang Lu

Semantic communications seeks to transfer information from a source while conveying a desired meaning to its destination. We model the transmitter-receiver functionalities as an autoencoder followed by a task classifier that evaluates the…

Cryptography and Security · Computer Science 2022-12-21 Yalin E. Sagduyu , Tugba Erpek , Sennur Ulukus , Aylin Yener

Semantic communications represent a significant breakthrough with respect to the current communication paradigm, as they focus on recovering the meaning behind the transmitted sequence of symbols, rather than the symbols themselves. In…

Signal Processing · Electrical Eng. & Systems 2023-09-06 S. Barbarossa , D. Comminiello , E. Grassucci , F. Pezone , S. Sardellitti , P. Di Lorenzo