English
Related papers

Related papers: Semantic Communication of Learnable Concepts

200 papers

Semantic communication is a new paradigm that aims at providing more efficient communication for the next-generation wireless network. It focuses on transmitting extracted, meaningful information instead of the raw data. However, deep…

Social and Information Networks · Computer Science 2025-01-09 Yang Li , Xinyu Zhou , Jun Zhao

The recent emergence of 6G raises the challenge of increasing the transmission data rate even further in order to break the barrier set by the Shannon limit. Traditional communication methods fall short of the 6G goals, paving the way for…

Networking and Internet Architecture · Computer Science 2024-01-02 Sachin Kadam , Dong In Kim

Recently, semantic communications are envisioned as a key enabler of future 6G networks. Back to Shannon's information theory, the goal of communication has long been to guarantee the correct reception of transmitted messages irrespective…

Information Theory · Computer Science 2021-10-18 Mohamed Sana , Emilio Calvanese Strinati

In the present paper we show that distributional information is particularly important when considering concept availability under implicit language learning conditions. Based on results from different behavioural experiments we argue that…

Computation and Language · Computer Science 2016-06-30 Dimitrios Alikaniotis , John N. Williams

Artificial intelligence (AI) is ushering in a new era for communication. As a result, the establishment of a semantic communication framework is putting on the agenda. Based on a realistic semantic communication model, this paper develops a…

Information Theory · Computer Science 2025-09-15 Yi-Qun Zhao , Zhi-Ming Ma , Geoffrey Ye Li , Shuai Yuan , Tong Ye , Chuan Zhou

Existing deep learning-enabled semantic communication systems often rely on shared background knowledge between the transmitter and receiver that includes empirical data and their associated semantic information. In practice, the semantic…

Information Theory · Computer Science 2022-10-19 Hongwei Zhang , Shuo Shao , Meixia Tao , Xiaoyan Bi , Khaled B. Letaief

Semantic communication, regarded as the breakthrough beyond the Shannon paradigm, aims at the successful transmission of semantic information conveyed by the source rather than the accurate reception of each single symbol or bit regardless…

Information Theory · Computer Science 2022-06-28 Zhijin Qin , Xiaoming Tao , Jianhua Lu , Wen Tong , Geoffrey Ye Li

We present our vision for a departure from the established way of architecting and assessing communication networks, by incorporating the semantics of information for communications and control in networked systems. We define semantics of…

A scenario involving a source, a channel, and a destination, where the destination is interested in {\em both} reliably reconstructing the message transmitted by the source and estimating with a fidelity criterion the state of the channel,…

Information Theory · Computer Science 2011-08-30 Wenyi Zhang , Satish Vedantam , Urbashi Mitra

In this work we explore encoding strategies learned by statistical models of sensory coding in noisy spiking networks. Early stages of sensory communication in neural systems can be viewed as encoding channels in the information-theoretic…

Neurons and Cognition · Quantitative Biology 2020-06-30 M. E. Rule , M. Sorbaro , M. H. Hennig

This work studies distributed learning in the spirit of Yao's model of communication complexity: consider a two-party setting, where each of the players gets a list of labelled examples and they communicate in order to jointly perform some…

Machine Learning · Computer Science 2018-04-24 Daniel M. Kane , Roi Livni , Shay Moran , Amir Yehudayoff

We consider the problem of joint source-channel coding for semantic communication from a rateless perspective, the purpose of which is to settle the balance between reliability (distortion/perception) and effectiveness (rate) of…

Information Retrieval · Computer Science 2025-01-23 Cheng Peng , Rulong Wang , Yong Xiao

A communication setup is considered where a transmitter wishes to simultaneously sense its channel state and convey a message to a receiver. The state is estimated at the transmitter by means of generalized feedback, i.e. a strictly causal…

Information Theory · Computer Science 2018-05-16 Mari Kobayashi , Giuseppe Caire , Gerhard Kramer

Neural networks have greatly boosted performance in computer vision by learning powerful representations of input data. The drawback of end-to-end training for maximal overall performance are black-box models whose hidden representations…

Computer Vision and Pattern Recognition · Computer Science 2020-04-29 Patrick Esser , Robin Rombach , Björn Ommer

The state-dependent memoryless channel (SDMC) is employed to model the integrated sensing and communication (ISAC) system, where the transmitter conveys messages to the receiver while simultaneously estimating the state parameter of…

Information Theory · Computer Science 2026-01-14 Lugaoze Feng , Guocheng Lv , Xunan Li , Ye Jin

Semantic communication is focused on optimizing the exchange of information by transmitting only the most relevant data required to convey the intended message to the receiver and achieve the desired communication goal. For example, if we…

Information Theory · Computer Science 2024-02-05 Fatemeh Zahra Safaeipour , Morteza Hashemi

Concept-based explainability methods provide insight into deep learning systems by constructing explanations using human-understandable concepts. While the literature on human reasoning demonstrates that we exploit relationships between…

Machine Learning · Computer Science 2024-05-29 Naveen Raman , Mateo Espinosa Zarlenga , Mateja Jamnik

We consider the problem of communicating over a channel for which no mathematical model is specified. We present achievable rates as a function of the channel input and output known a-posteriori for discrete and continuous channels, as well…

Information Theory · Computer Science 2012-02-03 Yuval Lomnitz , Meir Feder

Semantic communication enables intelligent agents to extract meaning (or semantics) of information via interaction, to carry out collaborative tasks. In this paper, we study semantic communication from a topological space perspective, in…

Signal Processing · Electrical Eng. & Systems 2022-11-01 Qiyang Zhao , Mehdi Bennis , Merouane Debbah , Daniel Benevides da Costa

With the advancement of Artificial Intelligence (AI) technology, next-generation wireless communication network is facing unprecedented challenge. Semantic communication has become a novel solution to address such challenges, with enhancing…

Signal Processing · Electrical Eng. & Systems 2024-05-17 Zihe Zhao , Chunyue Wang