English
Related papers

Related papers: Evolving Token Communication with Parametric Memor…

200 papers

Wireless extended reality (XR) has attracted wide attentions as a promising technology to improve users' mobility and quality of experience. However, the ultra-high data rate requirement of wireless XR has hindered its development for many…

Signal Processing · Electrical Eng. & Systems 2023-03-14 Bowen Zhang , Zhijin Qin , Geoffrey Ye Li

In this paper, we propose a novel design for AI-native goal-oriented communications, exploiting transformer neural networks under dynamic inference constraints on bandwidth and computation. Transformers have become the standard architecture…

Information Theory · Computer Science 2024-05-07 Alessio Devoto , Simone Petruzzi , Jary Pomponi , Paolo Di Lorenzo , Simone Scardapane

Despite the rise of token communication (TokCom) as a new paradigm beyond traditional bit communication, existing approaches have primarily adopted artificial intelligence (AI)-centric designs that rely on semantic recovery via large…

Signal Processing · Electrical Eng. & Systems 2026-05-01 Jihoon Lee , Seungeun Oh , Jihong Park , Seong-Lyun Kim , Seung-Woo Ko

In recent years, the Transformer architecture has achieved outstanding performance across a wide range of tasks and modalities. Token is the unified input and output representation in Transformer-based models, which has become a fundamental…

Signal Processing · Electrical Eng. & Systems 2025-11-20 Jingkai Ying , Zhijin Qin , Yulong Feng , Liejun Wang , Xiaoming Tao

Semantic communication is emerging as a key paradigm for 6G networks, where the goal is not to perfectly reconstruct bits but to preserve the meaning that matters for a given task. This shift can improve bandwidth efficiency, robustness,…

Networking and Internet Architecture · Computer Science 2026-03-16 Tuğçe Bilen , Ian F. Akyildiz

Semantic communication has emerged as a promising paradigm for next-generation wireless systems, improving the communication efficiency by transmitting high-level semantic features. However, reliance on unimodal representations can degrade…

Signal Processing · Electrical Eng. & Systems 2025-09-11 Haoran Chang , Mingzhe Chen , Huaxia Wang , Qianqian Zhang

With the emergence of 6G networks and proliferation of visual applications, efficient image transmission under adverse channel conditions is critical. We present a text-guided token communication system leveraging pre-trained foundation…

Information Theory · Computer Science 2025-07-09 Bole Liu , Li Qiao , Ye Wang , Zhen Gao , Yu Ma , Keke Ying , Tong Qin

Semantic communications represent a significant breakthrough with respect to the current communication paradigm, as they focus on recovering the meaning behind the transmitted sequence of symbols, rather than the symbols themselves. In…

Signal Processing · Electrical Eng. & Systems 2023-09-06 S. Barbarossa , D. Comminiello , E. Grassucci , F. Pezone , S. Sardellitti , P. Di Lorenzo

Token communications is an emerging generative semantic communication concept that reduces transmission rates by using context and transformer-based token processing, with tokens serving as universal semantic units. In this paper, we…

Information Theory · Computer Science 2025-07-11 Li Qiao , Mahdi Boloursaz Mashhadi , Zhen Gao , Deniz Gündüz

The traditional communications transmit all the source data represented by bits, regardless of the content of source and the semantic information required by the receiver. However, in some applications, the receiver only needs part of the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-04-30 Zhenzi Weng , Zhijin Qin , Geoffrey Ye Li

Molecular communication (MC) provides a foundational framework for information transmission in the Internet of Bio-Nano Things (IoBNT), where efficiency and reliability are crucial. However, the inherent limitations of molecular channels,…

Signal Processing · Electrical Eng. & Systems 2025-04-02 Hanlin Cai , Ozgur B. Akan

This paper presents an adaptive framework for edge inference based on a dynamically configurable transformer-powered deep joint source channel coding (DJSCC) architecture. Motivated by a practical scenario where a resource constrained edge…

Machine Learning · Computer Science 2025-05-26 Alessio Devoto , Jary Pomponi , Mattia Merluzzi , Paolo Di Lorenzo , Simone Scardapane

Semantic communication (SemCom) with learned encoder-decoder architectures enables end-to-end learning of compact task-oriented representations optimized for the wireless channel, reducing channel resources needed to convey task-relevant…

Information Theory · Computer Science 2026-05-08 Yalin E. Sagduyu , Tugba Erpek

Motivated by the recent success of Machine Learning (ML) tools in wireless communications, the idea of semantic communication by Weaver from 1949 has gained attention. It breaks with Shannon's classic design paradigm by aiming to transmit…

Information Theory · Computer Science 2023-07-14 Edgar Beck , Carsten Bockelmann , Armin Dekorsy

The concept of semantic communication provides a novel approach for applications in scenarios with limited communication resources. In this paper, we propose an end-to-end (E2E) semantic molecular communication system, aiming to enhance the…

Signal Processing · Electrical Eng. & Systems 2024-04-16 Yukun Cheng , Wei Chen , Bo Ai

Satellite-terrestrial communications are severely constrained by high path loss, limited spectrum resources, and time-varying channel conditions, rendering conventional bit-level transmission schemes inefficient and fragile, particularly in…

Information Theory · Computer Science 2026-03-04 Jinghong Huang , Mengying Sun , Xiaodong Xu , Jianchi Zhu , Zechuan Fang , Jingxuan Zhang , Ruichen Zhang , Chen Dong , Ping Zhang , Dusit Niyato

While semantic communication succeeds in efficiently transmitting due to the strong capability to extract the essential semantic information, it is still far from the intelligent or human-like communications. In this paper, we introduce an…

Signal Processing · Electrical Eng. & Systems 2023-03-23 Huiqiang Xie , Zhijin Qin , Geoffrey Ye Li

Continual incorporation of new knowledge is essential for the long-term evolution of large language models (LLMs). Existing approaches typically rely on parameter-update algorithms to mitigate catastrophic forgetting, yet they suffer from…

Machine Learning · Computer Science 2026-05-07 Kaustubh Pethkar , Ziyang Xiong , Zuofeng Shang , Yingcong Li

Semantic communications are expected to become the core new paradigms of the sixth generation (6G) wireless networks. Most existing works implicitly utilize channel information for codecs training, which leads to poor communications when…

Information Theory · Computer Science 2023-12-07 Lan Lin , Wenjun Xu , Fengyu Wang , Yimeng Zhang , Wei Zhang , Ping Zhang

With the emergence of large model-based agents, widely adopted transformer-based architectures inevitably produce excessively long token embeddings for transmission, which may result in high bandwidth overhead, increased power consumption…

Networking and Internet Architecture · Computer Science 2025-11-04 Junhe Zhang , Wanli Ni , Pengwei Wang , Dongyu Wang