English
Related papers

Related papers: Evolving Token Communication with Parametric Memor…

200 papers

Semantic communication, leveraging advanced deep learning techniques, emerges as a new paradigm that meets the requirements of next-generation wireless networks. However, current semantic communication systems, which employ neural coding…

Information Theory · Computer Science 2025-08-20 Hai-Long Qin , Jincheng Dai , Sixian Wang , Xiaoqi Qin , Shuo Shao , Kai Niu , Wenjun Xu , Ping Zhang

Semantic communications, which focus on transmitting the semantic meaning of data, have been proposed as a novel paradigm for achieving efficient and relevant communication. Meanwhile, non-orthogonal multiple access (NOMA) enhances spectral…

Signal Processing · Electrical Eng. & Systems 2025-08-20 Ximing Xie , Fang Fang , Lan Zhang , Xianbin Wang

Semantic communication (SemCom) has recently emerged as a promising paradigm for next-generation wireless systems. Empowered by advanced artificial intelligence (AI) technologies, SemCom has achieved significant improvements in transmission…

Information Theory · Computer Science 2026-01-12 Shunpu Tang , Yuanyuan Jia , Qianqian Yang , Ruichen Zhang , Jihong Park , Dusit Niyato

In this paper, a novel covert semantic communication framework is investigated. Within this framework, a server extracts and transmits the semantic information, i.e., the meaning of image data, to a user over several time slots. An attacker…

Artificial Intelligence · Computer Science 2025-08-12 Wenjing Zhang , Ye Hu , Tao Luo , Zhilong Zhang , Mingzhe Chen

Modern communications are usually designed to pursue a higher bit-level precision and fewer bits while transmitting a message. This article rethinks these two major features and introduces the concept and advantage of semantics that…

Signal Processing · Electrical Eng. & Systems 2022-06-09 Kun Lu , Qingyang Zhou , Rongpeng Li , Zhifeng Zhao , Xianfu Chen , Jianjun Wu , Honggang Zhang

Traditional communication systems focus on the transmission process, and the context-dependent meaning has been ignored. The fact that 5G system has approached Shannon limit and the increasing amount of data will cause communication…

Signal Processing · Electrical Eng. & Systems 2022-02-22 Chen Dong , Haotai Liang , Xiaodong Xu , Shujun Han , Bizhu Wang , Ping Zhang

This paper develops an edge-device collaborative Generative Semantic Communications (Gen SemCom) framework leveraging pre-trained Multi-modal/Vision Language Models (M/VLMs) for ultra-low-rate semantic communication via textual prompts. The…

Information Theory · Computer Science 2025-05-05 Mengmeng Ren , Li Qiao , Long Yang , Zhen Gao , Jian Chen , Mahdi Boloursaz Mashhadi , Pei Xiao , Rahim Tafazolli , Mehdi Bennis

Video conferencing has become a popular mode of meeting even if it consumes considerable communication resources. Conventional video compression causes resolution reduction under limited bandwidth. Semantic video conferencing maintains high…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Peiwen Jiang , Chao-Kai Wen , Shi Jin , Geoffrey Ye Li

The explosion of the number of low-power devices in the next decades calls for a re-thinking of wireless network design, namely, unifying wireless transmission of information and power so as to make the best use of the RF spectrum,…

Information Theory · Computer Science 2019-09-17 Morteza Varasteh , Jakob Hoydis , Bruno Clerckx

Achieving more powerful semantic representations and semantic understanding is one of the key problems in improving the performance of semantic communication systems. This work focuses on enhancing the semantic understanding of the text…

Signal Processing · Electrical Eng. & Systems 2025-04-03 Mengli Tao , Jiancun Fan , Jie Luo , Huiqiang Xie

Semantic communications have been utilized to execute numerous intelligent tasks by transmitting task-related semantic information instead of bits. In this article, we propose a semantic-aware speech-to-text transmission system for the…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-08 Zhenzi Weng , Zhijin Qin , Huiqiang Xie , Xiaoming Tao , Khaled B. Letaief

To support long-term interaction in complex environments, LLM agents require memory systems that manage historical experiences. Existing approaches either retain full interaction histories via passive context extension, leading to…

Artificial Intelligence · Computer Science 2026-01-30 Jiaqi Liu , Yaofeng Su , Peng Xia , Siwei Han , Zeyu Zheng , Cihang Xie , Mingyu Ding , Huaxiu Yao

Semantic Communication (SC) is an emerging technology that has attracted much attention in the sixth-generation (6G) mobile communication systems. However, few literature has fully considered the perceptual quality of the reconstructed…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Kexin Zhang , Lixin Li , Wensheng Lin , Yuna Yan , Wenchi Cheng , Zhu Han

In this work, a self-attention based conditional generative adversarial network (SA-cGAN) framework for the sixth generation (6G) semantic communication system is proposed, explicitly designed to balance the trade-off between distortion…

Signal Processing · Electrical Eng. & Systems 2026-04-01 Faizan Shafi , Rahul Jashvantbhai Pandya , Christo Kurisummoottil Thomas , Sridhar Iyer

Semantic communication, recognized as a promising technology for future intelligent applications, has received widespread research attention. Despite the potential of semantic communication to enhance transmission reliability, especially in…

Information Theory · Computer Science 2023-12-05 Lingyi Wang , Wei Wu , Fuhui Zhou , Zhaohui Yang , Zhijin Qin

Large Language Models (LLMs) incur significant computational and memory costs when processing long prompts, as full self-attention scales quadratically with input length. Token compression aims to address this challenge by reducing the…

Computation and Language · Computer Science 2026-04-23 Zihao Xu , John Harvill , Ziwei Fan , Yizhou Sun , Hao Ding , Hao Wang

Wireless communication has achieved great success in the past several decades. The challenge is of improving bandwidth with limited spectrum and power consumption, which however has gradually become a bottleneck with evolution going on. The…

Networking and Internet Architecture · Computer Science 2024-10-28 Guangming Shi , Dahua Gao , Xiaodan Song , Jingxuan Chai , Minxi Yang , Xuemei Xie , Leida Li , Xuyang Li

Discrete image tokenizers have emerged as a key component of modern vision and multimodal systems, providing a sequential interface for transformer-based architectures. However, most existing approaches remain primarily optimized for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Aram Davtyan , Yusuf Sahin , Yasaman Haghighi , Sebastian Stapf , Pablo Acuaviva , Alexandre Alahi , Paolo Favaro

Current neural architectures lack a principled way to handle interchangeable tokens, i.e., symbols that are semantically equivalent yet distinguishable, such as bound variables. As a result, models trained on fixed vocabularies often…

Machine Learning · Computer Science 2026-02-02 İlker Işık , Wenchao Li

Current language models (LMs) use a fixed, static subword tokenizer. This default choice typically results in degraded efficiency and language capabilities, especially in languages other than English. To address this issue, we challenge the…

Computation and Language · Computer Science 2025-06-12 Darius Feher , Ivan Vulić , Benjamin Minixhofer