English
Related papers

Related papers: Token Communications: A Large Model-Driven Framewo…

200 papers

Semantic Communication (SC) has emerged as a novel communication paradigm in recent years, successfully transcending the Shannon physical capacity limits through innovative semantic transmission concepts. Nevertheless, extant Image Semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Feibo Jiang , Chuanguo Tang , Li Dong , Kezhi Wang , Kun Yang , Cunhua Pan

Autoregressive (AR) models, long dominant in language generation, are increasingly applied to image synthesis but are often considered less competitive than Diffusion-based models. A primary limitation is the substantial number of image…

The emerging field semantic communication is driving the research of end-to-end data transmission. By utilizing the powerful representation ability of deep learning models, learned data transmission schemes have exhibited superior…

Information Theory · Computer Science 2023-05-25 Jincheng Dai , Sixian Wang , Ke Yang , Kailin Tan , Xiaoqi Qin , Zhongwei Si , Kai Niu , Ping Zhang

While deep generative models are showing exciting abilities in computer vision and natural language processing, their adoption in communication frameworks is still far underestimated. These methods are demonstrated to evolve solutions to…

Computation and Language · Computer Science 2024-01-17 Eleonora Grassucci , Jihong Park , Sergio Barbarossa , Seong-Lyun Kim , Jinho Choi , Danilo Comminiello

This paper investigates semantic communications (SemComs) for multi-satellite cooperative massive multiple-input multiple-output (MIMO) transmission, where multiple massive-MIMO satellites jointly serve a common set of multi-antenna user…

Signal Processing · Electrical Eng. & Systems 2026-05-12 Yafei Wang , Yuchen Zhang , Yiming Zhu , Vu Nguyen Ha , Rui Ding , Wenjin Wang , Symeon Chatzinotas , Björn Ottersten

Context-aware processing mechanisms have increasingly become a critical area of exploration for improving the semantic and contextual capabilities of language generation models. The Context-Aware Semantic Recomposition Mechanism (CASRM) was…

Computation and Language · Computer Science 2025-03-27 Richard Katrix , Quentin Carroway , Rowan Hawkesbury , Matthias Heathfield

Tokenization -- the process of decomposing a given text into a sequence of subwords called tokens -- is one of the key components in the development of language models. Particularly, auto-regressive language models generate texts token by…

Computation and Language · Computer Science 2026-02-19 Daiki Chijiwa , Taku Hasegawa , Kyosuke Nishida , Shin'ya Yamaguchi , Tomoya Ohba , Tamao Sakao , Susumu Takeuchi

As Large Language Models become ubiquitous in many sectors and tasks, there is a need to reduce token usage, overcoming challenges such as short context windows, limited output sizes, and costs associated with token intake and generation,…

Computation and Language · Computer Science 2024-10-02 Ramon Maria Garcia Alarcia , Alessandro Golkar

With the significant advances in AI-generated content (AIGC) and the proliferation of mobile devices, providing high-quality AIGC services via wireless networks is becoming the future direction. However, the primary challenges of AIGC…

Networking and Internet Architecture · Computer Science 2024-11-11 Runze Cheng , Yao Sun , Dusit Niyato , Lan Zhang , Lei Zhang , Muhammad Ali Imran

Most existing semantic communication (SemCom) systems use deep joint source-channel coding (DeepJSCC) to encode task-specific semantics in a goal-oriented manner. However, their reliance on predefined tasks and datasets significantly limits…

Signal Processing · Electrical Eng. & Systems 2025-05-30 Jiangjing Hu , Haotian Wu , Wenjing Zhang , Fengyu Wang , Wenjun Xu , Hui Gao , Deniz Gündüz

In the context of emerging 6G services, the realization of everything-to-everything interactions involving a myriad of physical and digital entities presents a crucial challenge. This challenge is exacerbated by resource scarcity in…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-02 Masoud Shokrnezhad , Hamidreza Mazandarani , Tarik Taleb , Jaeseung Song , Richard Li

While modern Transformer-based language models (LMs) have achieved major success in multi-task generalization, they often struggle to capture long-range dependencies within their context window. This work introduces a novel approach using…

Computation and Language · Computer Science 2025-09-23 Alok N. Shah , Khush Gupta , Keshav Ramji , Pratik Chaudhari

Most existing semantic communication systems employ analog modulation, which is incompatible with modern digital communication systems. Although several digital transmission approaches have been proposed to address this issue, an end-to-end…

Image and Video Processing · Electrical Eng. & Systems 2025-10-31 Haoshuo Zhang , Yufei Bo , Jianhua Mo , Meixia Tao

The end-to-end image communication system has been widely studied in the academic community. The escalating demands on image communication systems in terms of data volume, environmental complexity, and task precision require enhanced…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Senran Fan , Zhicheng Bao , Chen Dong , Haotai Liang , Xiaodong Xu , Ping Zhang

Classical visual coding and Multimodal Large Language Model (MLLM) token technology share the core objective - maximizing information fidelity while minimizing computational cost. Therefore, this paper reexamines MLLM token technology,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Jinming Liu , Junyan Lin , Yuntao Wei , Kele Shao , Keda Tao , Jianguo Huang , Xudong Yang , Zhibo Chen , Huan Wang , Xin Jin

This study tackles the challenge of image matching in difficult scenarios, such as scenes with significant variations or limited texture, with a strong emphasis on computational efficiency. Previous studies have attempted to address this…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Khang Truong Giang , Soohwan Song , Sungho Jo

The convergence of robotics, advanced communication networks, and artificial intelligence (AI) holds the promise of transforming industries through fully automated and intelligent operations. In this work, we introduce a novel co-working…

Robotics · Computer Science 2025-03-11 Peizheng Li , Adnan Aijaz

The rapid advancements in large language models (LLMs) have ignited interest in the temporal knowledge graph (tKG) domain, where conventional embedding-based and rule-based methods dominate. The question remains open of whether pre-trained…

Computation and Language · Computer Science 2024-04-18 Ruotong Liao , Xu Jia , Yangzhe Li , Yunpu Ma , Volker Tresp

Semantic communication has emerged as a promising paradigm for next-generation wireless systems, improving the communication efficiency by transmitting high-level semantic features. However, reliance on unimodal representations can degrade…

Signal Processing · Electrical Eng. & Systems 2025-09-11 Haoran Chang , Mingzhe Chen , Huaxia Wang , Qianqian Zhang

Massive multiple-input multiple-output (MIMO) offers significant advantages in spectral and energy efficiencies, positioning it as a cornerstone technology of fifth-generation (5G) wireless communication systems and a promising solution for…

Information Theory · Computer Science 2026-03-10 Zhenzhou Jin , Li You , Huibin Zhou , Yuanshuo Wang , Xiaofeng Liu , Xinrui Gong , Xiqi Gao , Derrick Wing Kwan Ng , Xiang-Gen Xia