English
Related papers

Related papers: Token Communications: A Large Model-Driven Framewo…

200 papers

The Space-Air-Ground-Sea integrated network calls for more robust and secure transmission techniques against jamming. In this paper, we propose a textual semantic transmission framework for robust transmission, which utilizes the advanced…

Computation and Language · Computer Science 2023-07-25 Shicong Liu , Zhen Gao , Gaojie Chen , Yu Su , Lu Peng

Efficient parallelization of Large Language Models (LLMs) with long sequences is essential but challenging due to their significant computational and memory demands, particularly stemming from communication bottlenecks in attention…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-31 Zongwu Wang , Fangxin Liu , Mingshuai Li , Li Jiang

Ubiquitous image transmission in emerging applications brings huge overheads to limited wireless resources. Since that text has the characteristic of conveying a large amount of information with very little data, the transmission of the…

Multimedia · Computer Science 2024-09-26 Xinfeng Wei , Haonan Tong , Nuocheng Yang , Changchuan Yin

The remarkable success of Large Language Models (LLMs) in understanding and generating various data types, such as images and text, has demonstrated their ability to process and extract semantic information across diverse domains. This…

Signal Processing · Electrical Eng. & Systems 2025-01-23 Soheyb Ribouh , Osama Saleem

In the swiftly advancing realm of communication technologies, Semantic Communication (SemCom), which emphasizes knowledge understanding and processing, has emerged as a hot topic. By integrating artificial intelligence technologies, SemCom…

Computation and Language · Computer Science 2024-02-07 Fei Ni , Bingyan Wang , Rongpeng Li , Zhifeng Zhao , Honggang Zhang

Recent advancements in generative artificial intelligence have introduced groundbreaking approaches to innovating next-generation semantic communication, which prioritizes conveying the meaning of a message rather than merely transmitting…

Artificial Intelligence · Computer Science 2025-05-19 Achintha Wijesinghe , Weiwei Wang , Suchinthaka Wanninayaka , Songyang Zhang , Zhi Ding

Generative foundation AI models have recently shown great success in synthesizing natural signals with high perceptual quality using only textual prompts and conditioning signals to guide the generation process. This enables semantic…

Information Theory · Computer Science 2024-08-20 Li Qiao , Mahdi Boloursaz Mashhadi , Zhen Gao , Chuan Heng Foh , Pei Xiao , Mehdi Bennis

Tokens are becoming the basic units through which foundation models represent and process information for understanding and inference. However, traditional wireless communication, centered on bit-level fidelity, faces a mismatch between…

Machine Learning · Computer Science 2026-05-22 Sige Liu , Kezhi Wang

Time series forecasting plays a vital role in supporting decision-making across a wide range of critical applications, including energy, healthcare, and finance. Despite recent advances, forecasting accuracy remains limited due to the…

Machine Learning · Computer Science 2025-08-14 Xiaoyu Tao , Shilong Zhang , Mingyue Cheng , Daoyu Wang , Tingyue Pan , Bokai Pan , Changqing Zhang , Shijin Wang

Large language models are typically controlled via prompts, which must be repeatedly re-processed for every new query and are difficult to reuse modularly. We introduce TokMem, a procedural memory framework that compiles each reusable task…

Computation and Language · Computer Science 2026-03-10 Zijun Wu , Yongchang Hao , Lili Mou

Many applications of large language models (LLMs) require long-context understanding, but models continue to struggle with such tasks. We hypothesize that conventional next-token prediction training could contribute to this, because each…

Computation and Language · Computer Science 2025-03-13 Falko Helm , Nico Daheim , Iryna Gurevych

Semantic communication (SemCom) holds promise for reducing network resource consumption while achieving the communications goal. However, the computational overheads in jointly training semantic encoders and decoders-and the subsequent…

Image and Video Processing · Electrical Eng. & Systems 2023-09-07 Hongyang Du , Guangyuan Liu , Dusit Niyato , Jiayi Zhang , Jiawen Kang , Zehui Xiong , Bo Ai , Dong In Kim

Semantic communications represent a significant breakthrough with respect to the current communication paradigm, as they focus on recovering the meaning behind the transmitted sequence of symbols, rather than the symbols themselves. In…

Signal Processing · Electrical Eng. & Systems 2023-09-06 S. Barbarossa , D. Comminiello , E. Grassucci , F. Pezone , S. Sardellitti , P. Di Lorenzo

Semantic communication (SemCom) aims to convey the meaning behind a transmitted message by transmitting only semantically-relevant information. This semantic-centric design helps to minimize power usage, bandwidth consumption, and…

Signal Processing · Electrical Eng. & Systems 2023-04-26 Tilahun M. Getu , Georges Kaddoum , Mehdi Bennis

Semantic communication (SemCom) with learned encoder-decoder architectures enables end-to-end learning of compact task-oriented representations optimized for the wireless channel, reducing channel resources needed to convey task-relevant…

Information Theory · Computer Science 2026-05-08 Yalin E. Sagduyu , Tugba Erpek

Recent advancements in diffusion models have made a significant breakthrough in generative modeling. The combination of the generative model and semantic communication (SemCom) enables high-fidelity semantic information exchange at…

Signal Processing · Electrical Eng. & Systems 2024-10-10 Chunmei Xu , Mahdi Boloursaz Mashhadi , Yi Ma , Rahim Tafazolli

Semantic communication (SemCom) emerges as a transformative paradigm for traffic-intensive visual data transmission, shifting focus from raw data to meaningful content transmission and relieving the increasing pressure on communication…

Image and Video Processing · Electrical Eng. & Systems 2026-02-02 Runze Cheng , Yao Sun , Ahmad Taha , Xuesong Liu , David Flynn , Muhammad Ali Imran

This study addresses an image-matching problem in challenging cases, such as large scene variations or textureless scenes. To gain robustness to such situations, most previous studies have attempted to encode the global contexts of a scene…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Khang Truong Giang , Soohwan Song , Sungho Jo

Recent developments in machine learning (ML) techniques enable users to extract, transmit, and reproduce information semantics via ML-based semantic communication (SemCom). This significantly increases network spectral efficiency and…

Signal Processing · Electrical Eng. & Systems 2025-12-17 Guhan Zheng , Qiang Ni , Aryan Kaushik , Lixia Yang , Yushi Wang , Charilaos Zarakovitis

With the booming development of generative artificial intelligence (GAI), semantic communication (SemCom) has emerged as a new paradigm for reliable and efficient communication. This paper considers a multi-user downlink SemCom system,…

Networking and Internet Architecture · Computer Science 2025-07-03 Jiayi Lu , Wanting Yang , Zehui Xiong , Rahim Tafazolli , Tony Q. S. Quek , Mérouane Debbah , Dong In Kim