English
Related papers

Related papers: Semantic Channel Theory: Deductive Compression and…

200 papers

The development of emerging applications, such as autonomous transportation systems, are expected to result in an explosive growth in mobile data traffic. As the available spectrum resource becomes more and more scarce, there is a growing…

Networking and Internet Architecture · Computer Science 2022-02-15 Wanting Yang , Zi Qin Liew , Wei Yang Bryan Lim , Zehui Xiong , Dusit Niyato , Xuefen Chi , Xianbin Cao , Khaled B. Letaief

Automating scientific computing workflows requires more than generating executable code: autonomous systems must also select appropriate computational strategies, implement them faithfully, and ensure that the resulting outcomes remain…

Artificial Intelligence · Computer Science 2026-05-29 Geremy Loachamín-Suntaxi , Robert Lazar , Dimitrios G. Giovanis , Ioannis G. Kevrekidis , Eleni D. Koronaki

We propose a new framework for reasoning about information in complex systems. Our foundation is based on a variational extension of Shannon's information theory that takes into account the modeling power and computational constraints of…

Machine Learning · Computer Science 2020-02-26 Yilun Xu , Shengjia Zhao , Jiaming Song , Russell Stewart , Stefano Ermon

We develop a general theory of semantic dynamics for large language models by formalizing them as Continuous State Machines (CSMs): smooth dynamical systems whose latent manifolds evolve under probabilistic transition operators. The…

Machine Learning · Statistics 2025-12-08 C. M. Wyss

Semantic communication, enabled by deep joint source-channel coding (DeepJSCC), is widely expected to inherit the vulnerability of deep learning to adversarial perturbations. This paper challenges this prevailing belief and reveals a…

Information Theory · Computer Science 2026-03-26 Runxin Zhang , Yulin Shao , Hongyu An , Zhijin Qin , Kaibin Huang

Shannon's secrecy system is studied in a setting, where both the legitimate decoder and the wiretapper have access to side information sequences correlated to the source, but the wiretapper receives both the coded information and the side…

Information Theory · Computer Science 2007-07-13 Neri Merhav

Classically, no information can be transmitted through a depolarising, that is a completely noisy, channel. We show that by combining a depolarising channel with another channel in an indefinite causal order---that is, when there is…

Quantum Physics · Physics 2020-09-02 K. Goswami , Y. Cao , G. A. Paz-Silva , J. Romero , A. G. White

Low-Altitude Economy Networks (LAENets) have emerged as a critical communication paradigm for operation-critical and regulation-aware applications, where Unmanned Aerial Vehicles (UAVs) transmit task-related information under stringent…

Networking and Internet Architecture · Computer Science 2026-03-03 Yansheng Liu , Jinbo Wen , Kun Zhu , Yang Zhang , Jiawen Kang

Directly sending audio signals from a transmitter to a receiver across a noisy channel may absorb consistent bandwidth and be prone to errors when trying to recover the transmitted bits. On the contrary, the recent semantic communication…

Sound · Computer Science 2023-09-15 Eleonora Grassucci , Christian Marinoni , Andrea Rodriguez , Danilo Comminiello

We propose a novel tensor-based formalism for inferring causal structures from time series. An information theoretical analysis of transfer entropy, shows that transfer entropy results from transmission of information over a set of…

Information Theory · Computer Science 2020-04-22 David Sigtermans

Semantic communication (SemCom) systems aim to learn the mapping from low-dimensional semantics to high-dimensional ground-truth. While this is more akin to a "domain translation" problem, existing frameworks typically emphasize on…

Machine Learning · Computer Science 2025-09-29 Mehdi Letafati , Samad Ali , Matti Latva-aho

Semantic communication has emerged as a promising paradigm for enhancing communication efficiency in sixth-generation (6G) networks. However, the broadcast nature of wireless channels makes SemCom systems vulnerable to eavesdropping, which…

Information Theory · Computer Science 2025-04-01 Shunpu Tang , Yuhao Chen , Qianqian Yang , Ruichen Zhang , Dusit Niyato , Zhiguo Shi

We propose a new proof method for direct coding theorems for wiretap channels where the eavesdropper has access to a quantum version of the transmitted signal on an infinite-dimensional Hilbert space and the legitimate parties communicate…

Information Theory · Computer Science 2025-03-25 Matthias Frey , Igor Bjelaković , Janis Nötzel , Sławomir Stańczak

In this paper, a new wiretap channel model is proposed, where the legitimate transmitter and receiver communicate over a discrete memoryless channel. The wiretapper has perfect access to a fixed-length subset of the transmitted codeword…

Information Theory · Computer Science 2017-01-25 Mohamed Nafea , Aylin Yener

Semantic communication (SemCom) has emerged as a promising paradigm for 6G wireless systems by transmitting task-relevant information rather than raw bits, yet existing approaches remain vulnerable to dual sources of uncertainty: semantic…

Networking and Internet Architecture · Computer Science 2026-01-26 Long Tan Le , Senura Hansaja Wanasekara , Zerun Niu , Nguyen H. Tran , Phuong Vo , Walid Saad , Dusit Niyato , Zhu Han , Choong Seon Hong , H. Vincent Poor

Semantic communication systems for goal-oriented transmission must protect task-relevant information not only through source compression but also via physical layer mapping. Existing approaches decouple constellation design and semantic…

Machine Learning · Computer Science 2026-05-15 Albert Shaju , Christo Kurisummoottil Thomas , Mayukh Roy Chowdhury

Semantic communication has gained significant attention from researchers as a promising technique to replace conventional communication in the next generation of communication systems, primarily due to its ability to reduce communication…

Information Theory · Computer Science 2025-02-07 Loc X. Nguyen , Ye Lin Tun , Yan Kyaw Tun , Minh N. H. Nguyen , Chaoning Zhang , Zhu Han , Choong Seon Hong

Semantic communication enables intelligent agents to extract meaning (or semantics) of information via interaction, to carry out collaborative tasks. In this paper, we study semantic communication from a topological space perspective, in…

Signal Processing · Electrical Eng. & Systems 2022-11-01 Qiyang Zhao , Mehdi Bennis , Merouane Debbah , Daniel Benevides da Costa

Shannon's analysis of the fundamental capacity limits for memoryless communication channels has been refined over time. In this paper, the maximum volume $M_\avg^*(n,\epsilon)$ of length-$n$ codes subject to an average decoding error…

Information Theory · Computer Science 2016-12-28 Pierre Moulin

Neural networks have greatly boosted performance in computer vision by learning powerful representations of input data. The drawback of end-to-end training for maximal overall performance are black-box models whose hidden representations…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Patrick Esser , Robin Rombach , Björn Ommer