English
Related papers

Related papers: On the Rate-Distortion-Complexity Tradeoff for Sem…

200 papers

We consider the semantic rate-distortion problem motivated by task-oriented video compression. The semantic information corresponding to the task, which is not observable to the encoder, shows impacts on the observations through a joint…

Information Theory · Computer Science 2022-08-15 Tao Guo , Yizhu Wang , Jie Han , Huihui Wu , Bo Bai , Wei Han

Semantic communication, regarded as the breakthrough beyond the Shannon paradigm, aims at the successful transmission of semantic information conveyed by the source rather than the accurate reception of each single symbol or bit regardless…

Information Theory · Computer Science 2022-06-28 Zhijin Qin , Xiaoming Tao , Jianhua Lu , Wen Tong , Geoffrey Ye Li

Large-scale models (LSMs) can be an effective framework for semantic representation and understanding, thereby providing a suitable tool for designing semantic communication (SC) systems. However, their direct deployment is often hindered…

Machine Learning · Computer Science 2025-08-26 Kuiyuan Ding , Caili Guo , Yang Yang , Zhongtian Du , Walid Saad

Semantic communication, when examined through the lens of joint source-channel coding (JSCC), maps source messages directly into channel input symbols, where the measure of success is defined by end-to-end distortion rather than traditional…

Information Theory · Computer Science 2024-07-09 Tze-Yang Tung , Homa Esfahanizadeh , Jinfeng Du , Harish Viswanathan

Rate-distortion theory provides bounds for compressing data produced by an information source to a specified encoding rate that is strictly less than the source's entropy. This necessarily entails some loss, or distortion, between the…

Quantum Physics · Physics 2019-02-06 Sina Salek , Daniela Cadamuro , Philipp Kammerlander , Karoline Wiesner

Shannon's rate-distortion theory treats source symbols as unstructured labels. When the source is a knowledge base equipped with a logical proof system, a natural fidelity criterion is closure fidelity: a reconstruction is acceptable if it…

Information Theory · Computer Science 2026-04-14 Jianfeng Xu

Semantic communications have gained significant attention as a promising approach to address the transmission bottleneck, especially with the continuous development of 6G techniques. Distinct from the well investigated physical channel…

Signal Processing · Electrical Eng. & Systems 2024-03-15 Xiang Peng , Zhijin Qin , Xiaoming Tao , Jianhua Lu , Khaled B. Letaief

In this work, we expand the cooperative multi-task semantic communication framework (CMT-SemCom) introduced in [1], which divides the semantic encoder on the transmitter side into a common unit (CU) and multiple specific units (SUs), to a…

Signal Processing · Electrical Eng. & Systems 2026-01-27 Ahmad Halimi Razlighi , Carsten Bockelmann , Armin Dekorsy

We introduce a new semantic communication mechanism - SemanticRL, whose key idea is to preserve the semantic information instead of strictly securing the bit-level precision. Unlike previous methods that mainly concentrate on the network or…

Machine Learning · Computer Science 2022-04-04 Kun Lu , Rongpeng Li , Xianfu Chen , Zhifeng Zhao , Honggang Zhang

The joint source-channel coding (JSCC) framework leverages deep learning to learn from data the best codes for source and channel coding. When the output signal, rather than being binary, is directly mapped onto the IQ domain…

Machine Learning · Computer Science 2024-06-07 Junli Fang , João F. C. Mota , Baoshan Lu , Weicheng Zhang , Xuemin Hong

Many aspects of human learning have been proposed as a process of constructing mental programs: from acquiring symbolic number representations to intuitive theories about the world. In parallel, there is a long-tradition of using…

Human-Computer Interaction · Computer Science 2024-05-12 Hanqi Zhou , David G. Nagy , Charley M. Wu

In recent years, numerous data-intensive broadcasting applications have emerged at the wireless edge, calling for a flexible tradeoff between distortion, transmission rate, and processing complexity. While deep learning-based joint…

Information Theory · Computer Science 2026-03-24 Zijun Qin , Jingxuan Huang , Zesong Fei , Haichuan Ding , Yulin Shao , Xianhao Chen

While humans can effortlessly transform complex visual scenes into simple words and the other way around by leveraging their high-level understanding of the content, conventional or the more recent learned image compression codecs do not…

Image and Video Processing · Electrical Eng. & Systems 2022-08-10 Shiyu Duan , Huaijin Chen , Jinwei Gu

Recently, semantic communication has been brought to the forefront because of its great success in deep learning (DL), especially Transformer. Even if semantic communication has been successfully applied in the sentence transmission to…

Signal Processing · Electrical Eng. & Systems 2022-06-10 Peiwen Jiang , Chao-Kai Wen , Shi Jin , Geoffrey Ye Li

Consider the problem of estimating a latent signal from a lossy compressed version of the data when the compressor is agnostic to the relation between the signal and the data. This situation arises in a host of modern applications when data…

Information Theory · Computer Science 2021-01-12 Alon Kipnis , Stefano Rini , Andrea J. Goldsmith

Semantic communication (SC) is recognized as a promising approach for enabling reliable communication with minimal data transfer while maintaining seamless connectivity for a group of wireless users. Unlocking the advantages of SC for…

Information Theory · Computer Science 2024-06-24 Nitisha Singh , Christo Kurisummoottil Thomas , Walid Saad , Emilio Calvanese Strinati

Semantic communication has emerged as a promising approach for improving efficient transmission in the next generation of wireless networks. Inspired by the success of semantic communication in different areas, we aim to provide a new…

Image and Video Processing · Electrical Eng. & Systems 2023-12-11 Zhenguo Zhang , Qianqian Yang , Shibo He , Jiming Chen

As conventional communication systems based on classic information theory have closely approached the limits of Shannon channel capacity, semantic communication has been recognized as a key enabling technology for the further improvement of…

Information Theory · Computer Science 2023-06-06 Jiancheng Tang , Qianqian Yang , Zhaoyang Zhang

The state-dependent memoryless channel (SDMC) is employed to model the integrated sensing and communication (ISAC) system, where the transmitter conveys messages to the receiver while simultaneously estimating the state parameter of…

Information Theory · Computer Science 2026-01-14 Lugaoze Feng , Guocheng Lv , Xunan Li , Ye Jin

A significant bottleneck in federated learning (FL) is the network communication cost of sending model updates from client devices to the central server. We present a comprehensive empirical study of the statistics of model updates in FL,…

Machine Learning · Computer Science 2022-05-23 Nicole Mitchell , Johannes Ballé , Zachary Charles , Jakub Konečný