English
Related papers

Related papers: Semantic-Aware Multi-Terminal Coding for Gaussian …

200 papers

We study the moderate-deviations (MD) setting for lossy source coding of stationary memoryless sources. More specifically, we derive fundamental compression limits of source codes whose rates are $R(D) \pm \epsilon_n$, where $R(D)$ is the…

Information Theory · Computer Science 2012-05-11 Vincent Y. F. Tan

In Sequential Massive Random Access (SMRA), a set of correlated sources is jointly encoded and stored on a server, and clients want to access to only a subset of the sources. Since the number of simultaneous clients can be huge, the server…

Information Theory · Computer Science 2018-01-18 Elsa Dupraz , Thomas Maugey , Aline Roumy , Michel Kieffer

A rate-distortion problem motivated by the consideration of semantic information is formulated and solved. The starting point is to model an information source as a pair consisting of an intrinsic state which is not observable,…

Information Theory · Computer Science 2021-05-11 Jiakun Liu , Wenyi Zhang , H. Vincent Poor

We investigate distributed source coding of two correlated sources X and Y where messages are passed to a decoder in a cascade fashion. The encoder of X sends a message at rate R_1 to the encoder of Y. The encoder of Y then sends a message…

Information Theory · Computer Science 2009-05-13 Paul Cuff , Han-I Su , Abbas El Gamal

This paper investigates the joint source-channel coding problem of sending two correlated memoryless sources with common part over a memoryless multiple access channel (MAC). An inner bound and two outer bounds on the achievable distortion…

Information Theory · Computer Science 2016-12-13 Lei Yu , Houqiang Li , Chang Wen Chen

In this paper, we investigated semantic communication for multi-task processing using an information-theoretic approach. We introduced the concept of a "semantic source", allowing multiple semantic interpretations from a single observation.…

Signal Processing · Electrical Eng. & Systems 2024-10-10 Ahmad Halimi Razlighi , Carsten Bockelmann , Armin Dekorsy

Consider a pair of correlated Gaussian sources (X1,X2). Two separate encoders observe the two components and communicate compressed versions of their observations to a common decoder. The decoder is interested in reconstructing a linear…

Information Theory · Computer Science 2007-07-25 D. Krithivasan , S. S. Pradhan

This paper explores the concept of information importance in multi-modal task-oriented semantic communication systems, emphasizing the need for high accuracy and efficiency to fulfill task-specific objectives. At the transmitter, generative…

Signal Processing · Electrical Eng. & Systems 2025-02-25 Yi Ma , Chunmei Xu , Zhenyu Liu , Siqi Zhang , Rahim Tafazolli

The three-node multiterminal lossy source coding problem is investigated. We derive an inner bound to the general rate-distortion region of this problem which is a natural extension of the seminal work by Kaspi'85 on the interactive…

Information Theory · Computer Science 2016-01-19 Leonardo Rey Vega , Pablo Piantanida , Alfred Hero

An information-spectrum approach is applied to solve the multiterminal source coding problem for correlated general sources, where sources may be nonstationary and/or nonergodic, and the distortion measure is arbitrary and may be…

Information Theory · Computer Science 2007-07-13 Shengtian Yang , Peiliang Qiu

It has been shown lately the optimality of uncoded transmission in estimating Gaussian sources over homogeneous/symmetric Gaussian multiple access channels (MAC) using multiple sensors. It remains, however, unclear whether it still holds…

Information Theory · Computer Science 2007-09-27 Shuangqing Wei , Rajgopal Kannan , Sitharama Iyengar , Nageswara S. Rao

Multi-agent systems (MAS) are a promising solution for autonomous exploration tasks in hazardous or remote environments, such as planetary surveys. In such settings, communication among agents is essential to ensure collaborative task…

Signal Processing · Electrical Eng. & Systems 2025-10-21 Maximilian H. V. Tillmann , Ban-Sok Shin , Dmitriy Shutin , Armin Dekorsy

We consider the problem of transmission of several distributed sources over a multiple access channel (MAC) with side information at the sources and the decoder. Source-channel separation does not hold for this channel. Sufficient…

Information Theory · Computer Science 2008-03-11 R. Rajesh , Vinod Sharma

We study a new class of codes for Gaussian multi-terminal source and channel coding. These codes are designed using the statistical framework of high-dimensional linear regression and are called Sparse Superposition or Sparse Regression…

Information Theory · Computer Science 2012-12-11 Ramji Venkataramanan , Sekhar Tatikonda

Joint source-channel coding is a compelling paradigm when low-latency and low-complexity communication is required. This work proposes a theoretical framework that integrates classification and anomaly detection within the conventional…

Signal Processing · Electrical Eng. & Systems 2025-09-18 Andriy Enttsel , Weichen Wang , Mauro Mangia , Riccardo Rovatti , Deniz Gündüz

An important aspect of text mining involves information retrieval in form of discovery of semantic themes (topics) from documents using topic modelling. While generative topic models like Latent Dirichlet Allocation (LDA) or Latent Semantic…

Machine Learning · Computer Science 2025-11-04 Satyajeet Sahoo , Jhareswar Maiti

This paper describes the system proposed for the SemEval-2020 Task 1: Unsupervised Lexical Semantic Change Detection. We focused our approach on the detection problem. Given the semantics of words captured by temporal word embeddings in…

Computation and Language · Computer Science 2020-05-21 Pierluigi Cassotti , Annalina Caputo , Marco Polignano , Pierpaolo Basile

Semantic communication technology emerges as a pivotal bridge connecting AI with classical communication. The current semantic communication systems are generally modeled as an Auto-Encoder (AE). AE lacks a deep integration of AI principles…

Signal Processing · Electrical Eng. & Systems 2025-05-12 Yulong Feng , Jing Xu , Liujun Hu , Guanghui Yu , Xiangyang Duan

Semantic communication, when examined through the lens of joint source-channel coding (JSCC), maps source messages directly into channel input symbols, where the measure of success is defined by end-to-end distortion rather than traditional…

Information Theory · Computer Science 2024-07-09 Tze-Yang Tung , Homa Esfahanizadeh , Jinfeng Du , Harish Viswanathan

This paper considers a multi-user semantic and data communication (MU-SemDaCom) system, where a base station (BS) simultaneously serves users with different semantic and data tasks through a downlink multi-user multiple-input single-output…

Image and Video Processing · Electrical Eng. & Systems 2025-09-30 Kai Yuan , Dongxu Li , Jianhao Huang , Han Zhang , Chuan Huang