English
Related papers

Related papers: Semantics-Aware Hierarchical Token Communication: …

200 papers

Semantic communication (SemCom) is emerging as a key technology for future sixth-generation (6G) systems. Unlike traditional bit-level communication (BitCom), SemCom directly optimizes performance at the semantic level, leading to superior…

Information Theory · Computer Science 2025-07-22 Maojun Zhang , Guangxu Zhu , Richeng Jin , Xiaoming Chen , Qingjiang Shi , Caijun Zhong , Kaibin Huang

Efficient parallelization of Large Language Models (LLMs) with long sequences is essential but challenging due to their significant computational and memory demands, particularly stemming from communication bottlenecks in attention…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-31 Zongwu Wang , Fangxin Liu , Mingshuai Li , Li Jiang

Semantic communication (SemCom) aims to achieve high fidelity information delivery under low communication consumption by only guaranteeing semantic accuracy. Nevertheless, semantic communication still suffers from unexpected channel…

Systems and Control · Electrical Eng. & Systems 2024-03-26 Fei Ni , Rongpeng Li , Zhifeng Zhao , Honggang Zhang

Semantic communication (SemCom) aims to enhance the resource efficiency of next-generation networks by transmitting the underlying meaning of messages, focusing on information relevant to the end user. Existing literature on SemCom…

Networking and Internet Architecture · Computer Science 2025-04-30 Nasrin Gholami , Neda Moghim , Behrouz Shahgholi Ghahfarokhi , Pouyan Salavati , Christo Kurisummoottil Thomas , Sachin Shetty , Tahereh Rahmati

Traditional joint source-channel coding employs static learned semantic representations that cannot dynamically adapt to evolving source distributions. Shared semantic memories between transmitter and receiver can potentially enable…

Signal Processing · Electrical Eng. & Systems 2025-11-14 Karim Nasreddine , Christo Kurisummoottil Thomas , Walid Saad

Semantic communication has witnessed a great progress with the development of natural language processing (NLP) and deep learning (DL). Although existing semantic communication technologies can effectively reduce errors in semantic…

Systems and Control · Electrical Eng. & Systems 2022-07-06 Qingyang Zhou , Rongpeng Li , Zhifeng Zhao , Yong Xiao , Honggang Zhang

Semantic communication, recognized as a promising technology for future intelligent applications, has received widespread research attention. Despite the potential of semantic communication to enhance transmission reliability, especially in…

Information Theory · Computer Science 2023-12-05 Lingyi Wang , Wei Wu , Fuhui Zhou , Zhaohui Yang , Zhijin Qin

We present TokenCompose, a Latent Diffusion Model for text-to-image generation that achieves enhanced consistency between user-specified text prompts and model-generated images. Despite its tremendous success, the standard denoising process…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Zirui Wang , Zhizhou Sha , Zheng Ding , Yilin Wang , Zhuowen Tu

This work presents a novel semantic transmission framework in wireless networks, leveraging the joint processing technique. Our framework enables multiple cooperating base stations to efficiently transmit semantic information to multiple…

Information Theory · Computer Science 2024-01-03 Xumin Pu , Tiantian Lei , Wanli Wen , Qianbin Chen

Recent studies show that leveraging the match-wise relationships within the 4D correlation map yields significant improvements in establishing semantic correspondences - but at the cost of increased computation and latency. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Seungwook Kim , Juhong Min , Minsu Cho

Visual generative models based on latent space have achieved great success, underscoring the significance of visual tokenization. Mapping images to latents boosts efficiency and enables multimodal alignment for scaling up in downstream…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yunpeng Qu , Kaidong Zhang , Yukang Ding , Ying Chen , Jian Wang

Semantic communication systems for goal-oriented transmission must protect task-relevant information not only through source compression but also via physical layer mapping. Existing approaches decouple constellation design and semantic…

Machine Learning · Computer Science 2026-05-15 Albert Shaju , Christo Kurisummoottil Thomas , Mayukh Roy Chowdhury

Large language models show great potential in unstructured data understanding, but still face significant challenges with graphs due to their structural hallucination. Existing approaches mainly either verbalize graphs into natural…

Computation and Language · Computer Science 2026-02-03 Jingyao Wu , Bin Lu , Zijun Di , Xiaoying Gan , Meng Jin , Luoyi Fu , Xinbing Wang , Chenghu Zhou

The exponential growth of wireless users and bandwidth constraints necessitates innovative communication paradigms for next-generation networks. Semantic Communication (SemCom) emerges as a promising solution by transmitting extracted…

Signal Processing · Electrical Eng. & Systems 2026-05-06 Ishtiaque Ahmed , Yingzhuo Sun , Jingwen Fu , Alper Kose , Leila Musavian , Ming Xiao , Berna Ozbek

Token Communications (TokenCom) has recently emerged as an effective new paradigm, where tokens are the unified units of multimodal communications and computations, enabling efficient digital semantic- and goal-oriented communications in…

Machine Learning · Computer Science 2026-02-16 Farshad Zeinali , Mahdi Boloursaz Mashhadi , Dusit Niyato , Rahim Tafazolli

Multimodal Large Language Models (MLLMs) have demonstrated exceptional capabilities in processing vision-language tasks. One of the crux of MLLMs lies in vision tokenization, which involves efficiently transforming input visual signals into…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Shengqiong Wu , Hao Fei , Xiangtai Li , Jiayi Ji , Hanwang Zhang , Tat-Seng Chua , Shuicheng Yan

Artificial intelligence (AI) promises to revolutionize the design, optimization and management of next-generation communication systems. In this article, we explore the integration of large AI models (LAMs) into semantic communications…

Artificial Intelligence · Computer Science 2025-03-31 Wanli Ni , Zhijin Qin , Haofeng Sun , Xiaoming Tao , Zhu Han

Semantic communication (SemCom) with learned encoder-decoder architectures enables end-to-end learning of compact task-oriented representations optimized for the wireless channel, reducing channel resources needed to convey task-relevant…

Information Theory · Computer Science 2026-05-08 Yalin E. Sagduyu , Tugba Erpek

Long-context language modeling is commonly framed as a scalability challenge of token-level attention, yet local-to-global information structuring remains largely implicit in existing approaches. Drawing on cognitive theories of discourse…

Computation and Language · Computer Science 2026-04-10 Xiangyu Zeng , Qi Xu , Yunke Wang , Chang Xu

As three-dimensional acquisition technologies like LiDAR cameras advance, the need for efficient transmission of 3D point clouds is becoming increasingly important. In this paper, we present a novel semantic communication (SemCom) approach…

Emerging Technologies · Computer Science 2025-05-13 Shangzhuo Xie , Qianqian Yang , Yuyi Sun , Tianxiao Han , Zhaohui Yang , Zhiguo Shi