English
Related papers

Related papers: A Theory for Semantic Channel Coding With Many-to-…

200 papers

Semantic communication (SemCom) is accelerating its momentum to catch up with the massive increase in users' demands in both quantity and quality, with the assistance of advanced deep learning (DL) techniques. Specifically, SemCom can…

Information Theory · Computer Science 2026-05-11 Loc X. Nguyen , Phuong-Nam Tran , Trung Thanh Pham , Avi Deb Raha , Eui-Nam Huh , Zhu Han , Choong Seon Hong

Semantic communication is envisioned as a promising technique to break through the Shannon limit. However, the existing semantic communication frameworks do not involve inference and error correction, which limits the achievable…

Artificial Intelligence · Computer Science 2022-02-25 Fuhui Zhou , Yihao Li , Xinyuan Zhang , Qihui Wu , Xianfu Lei , Rose Qingyang Hu

A new channel coding approach was proposed in [1] for random multiple access communication over the discrete-time memoryless channel. The coding approach allows users to choose their communication rates independently without sharing the…

Information Theory · Computer Science 2016-11-15 Zheng Wang , Jie Luo

Semantic communication (SC) goes beyond technical communication in which a given sequence of bits or symbols, often referred to as information, is be transmitted reliably over a noisy channel, regardless of its meaning. In SC, conveying the…

Information Theory · Computer Science 2022-09-02 Jinho Choi , Jihong Park

In Shannon's seminal paper, entropy of printed English, treated as a stationary stochastic process, was estimated to be roughly 1 bit per character. However, considered as a means of communication, language differs considerably from its…

Computation and Language · Computer Science 2025-08-13 Doron Sivan , Misha Tsodyks

Motivated by the recent success of Machine Learning (ML) tools in wireless communications, the idea of semantic communication by Weaver from 1949 has gained attention. It breaks with Shannon's classic design paradigm by aiming to transmit…

Information Theory · Computer Science 2023-07-14 Edgar Beck , Carsten Bockelmann , Armin Dekorsy

Semantic communication is emerging as a key paradigm for 6G networks, where the goal is not to perfectly reconstruct bits but to preserve the meaning that matters for a given task. This shift can improve bandwidth efficiency, robustness,…

Networking and Internet Architecture · Computer Science 2026-03-16 Tuğçe Bilen , Ian F. Akyildiz

The translation of written language has been known since the 3rd century BC; however, its necessity has become increasingly common in the information age. Today, many translators exist, based on encoder-decoder deep architectures,…

Computation and Language · Computer Science 2025-11-18 Ronit D. Gross , Yanir Harel , Ido Kanter

Information theory has provided foundations for the theories of several application areas critical for modern society, including communications, computer storage, and AI. A key aspect of Shannon's 1948 theory is a sharp lower bound on the…

As the global demand for data has continued to rise exponentially, some have begun turning to the idea of semantic communication as a means of efficiently meeting this demand. Pushing beyond the boundaries of conventional communication…

Signal Processing · Electrical Eng. & Systems 2024-10-28 Dylan Wheeler , Balasubramaniam Natarajan

At the confluence of 6G, deep learning (DL), and natural language processing (NLP), DL-enabled text semantic communication (SemCom) has emerged as a 6G enabler since it minimizes bandwidth consumption, transmission delay, and power usage.…

Signal Processing · Electrical Eng. & Systems 2024-08-27 Tilahun M. Getu , Georges Kaddoum , Mehdi Bennis

The research in the sixth generation of communication networks needs to tackle new challenges in order to meet the requirements of emerging applications in terms of high data rate, low latency, high reliability, and massive connectivity. To…

Information Theory · Computer Science 2023-02-09 Marwa Chafii , Lina Bariah , Sami Muhaidat , Merouane Debbah

Semantic communication is focused on optimizing the exchange of information by transmitting only the most relevant data required to convey the intended message to the receiver and achieve the desired communication goal. For example, if we…

Information Theory · Computer Science 2024-02-05 Fatemeh Zahra Safaeipour , Morteza Hashemi

As semantic communication (SemCom) attracts growing attention as a novel communication paradigm, ensuring the security of transmitted semantic information over open wireless channels has become a critical issue. However, traditional…

Information Theory · Computer Science 2025-11-25 Weixuan Chen , Qianqian Yang , Shuo Shao , Zhiguo Shi , Jiming Chen , Xuemin , Shen

To reduce network traffic and support environments with limited resources, a method for transmitting images with minimal transmission data is required. Several machine learning-based image compression methods, which compress the data size…

Networking and Internet Architecture · Computer Science 2024-08-06 Eri Hosonuma , Taku Yamazaki , Takumi Miyoshi , Akihito Taya , Yuuki Nishiyama , Kaoru Sezaki

This paper investigates the optimization of transmitting the encoder outputs, termed semantic features (SFs), in semantic communication (SC). We begin by modeling the entire communication process from the encoder output to the decoder…

Signal Processing · Electrical Eng. & Systems 2026-04-24 Yongjeong Oh , Jihong Park , Jinho Choi , Yo-Seb Jeon

Stochastic encoders for channel coding and lossy source coding are introduced with a rate close to the fundamental limits, where the only restriction is that the channel input alphabet and the reproduction alphabet of the lossy source code…

Information Theory · Computer Science 2016-11-15 Jun Muramatsu

"Bounds on information combining" are entropic inequalities that determine how the information (entropy) of a set of random variables can change when these are combined in certain prescribed ways. Such bounds play an important role in…

Quantum Physics · Physics 2019-08-27 Christoph Hirche , David Reeb

Shannon's channel coding theorem characterizes the maximal rate of information that can be reliably transmitted over a communication channel when optimal encoding and decoding strategies are used. In many scenarios, however, practical…

Information Theory · Computer Science 2023-07-06 Jonathan Scarlett , Albert Guillén i Fàbregas , Anelia Somekh-Baruch , Alfonso Martinez

Semantic- and task-oriented communication has emerged as a promising approach to reducing the latency and bandwidth requirements of next-generation mobile networks by transmitting only the most relevant information needed to complete a…

Information Theory · Computer Science 2024-09-27 Deniz Gündüz , Michèle A. Wigger , Tze-Yang Tung , Ping Zhang , Yong Xiao