English
Related papers

Related papers: A Token/KV-Cache Communication Media Selection and…

200 papers

Multi-LLM systems harness the complementary strengths of diverse Large Language Models, achieving performance and efficiency gains that are not attainable by a single model. In existing designs, LLMs communicate through text, forcing…

Computation and Language · Computer Science 2026-03-04 Tianyu Fu , Zihan Min , Hanling Zhang , Jichao Yan , Guohao Dai , Wanli Ouyang , Yu Wang

Multi-agent large language model (LLM) systems have shown strong potential in complex reasoning and collaborative decision-making tasks. However, most existing coordination schemes rely on static or full-context routing strategies, which…

Computation and Language · Computer Science 2025-08-13 Jun Liu , Zhenglun Kong , Changdi Yang , Fan Yang , Tianqi Li , Peiyan Dong , Joannah Nanjekye , Hao Tang , Geng Yuan , Wei Niu , Wenbin Zhang , Pu Zhao , Xue Lin , Dong Huang , Yanzhi Wang

Semantic communication, recognized as a promising technology for future intelligent applications, has received widespread research attention. Despite the potential of semantic communication to enhance transmission reliability, especially in…

Information Theory · Computer Science 2023-12-05 Lingyi Wang , Wei Wu , Fuhui Zhou , Zhaohui Yang , Zhijin Qin

Communication in Large Language Model (LLM)-based multi-agent systems is moving beyond discrete tokens to preserve richer context. Recent work such as LatentMAS enables agents to exchange latent messages through full key-value (KV) caches.…

Machine Learning · Computer Science 2026-04-16 Yiping Li , Zhiyu An , Wan Du

Recent advancements in Large Language Models (LLMs) and autonomous agents have demonstrated remarkable capabilities across various domains. However, standalone agents frequently encounter limitations when handling complex tasks that demand…

Computation and Language · Computer Science 2025-05-29 Rennai Qiu , Chen Qian , Ran Li , Yufan Dang , Weize Chen , Cheng Yang , Yingli Zhang , Ye Tian , Xuantang Xiong , Lei Han , Zhiyuan Liu , Maosong Sun

Future sixth-generation (6G) mobile networks are envisioned to be equipped with a diverse set of powerful, yet highly specialized, optimization experts. Such a promising vision is concurrently expected to give rise to the need for scalable…

Machine Learning · Computer Science 2026-05-06 Robert-Jeron Reifert , Alaa Alameer Ahmad , Hayssam Dahrouj , Aydin Sezgin

LLM agents today communicate via text, which incurs considerable latency and information loss due to the need to autoregressively decode the sharer model's state and encode at the receiver model. Recent work such as Cache-to-Cache (C2C; Fu…

Machine Learning · Computer Science 2026-05-25 Maximillian Rossi , Prajwal Raghunath , Eugene Wu

Multi-agent LLM applications organize execution in synchronized rounds where a central scheduler gathers outputs from all agents and redistributes the combined context. This All-Gather communication pattern creates massive KV Cache…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-06 Zhuohang Bian , Feiyang Wu , Chengrui Zhang , Hangcheng Dong , Yun Liang , Youwei Zhuo

The efficiency of large language models (LLMs) remains a critical challenge, particularly in contexts where computational resources are limited. Traditional attention mechanisms in these models, while powerful, require significant…

Computation and Language · Computer Science 2024-07-19 Bingli Liao , Danilo Vasconcellos Vargas

Semantic communication is a new paradigm that aims at providing more efficient communication for the next-generation wireless network. It focuses on transmitting extracted, meaningful information instead of the raw data. However, deep…

Social and Information Networks · Computer Science 2025-01-09 Yang Li , Xinyu Zhou , Jun Zhao

The path to higher network autonomy in 6G lies beyond the mere optimization of key performance indicators (KPIs), requiring systems that perceive and reason over the network environment as it is. This can be achieved through agentic AI,…

Networking and Internet Architecture · Computer Science 2026-05-15 Hatim Chergui , Farhad Rezazadeh , Merouane Debbah , Christos Verikoukis

This letter investigates the problem of energy efficient collaborative strategy for mobile embodied artificial intelligence network (MEAN) over wireless communication. In the considered model, the agents execute the tasks through…

Signal Processing · Electrical Eng. & Systems 2026-05-15 Chenliang Wu , Zhouxiang Zhao , Jiaxiang Wang , Ruopeng Xu , Chen Zhu , Zhaohui Yang , Zhaoyang Zhang

In this paper, we propose a novel resource management scheme that jointly allocates the transmit power and computational resources in a centralized radio access network architecture. The network comprises a set of computing nodes to which…

Networking and Internet Architecture · Computer Science 2021-06-24 Mohsen Tajallifar , Sina Ebrahimi , Mohammad Reza Javan , Nader Mokari , Luca Chiaraviglio

The emergence of multi-agent systems powered by large language models (LLMs) has unlocked new frontiers in complex task-solving, enabling diverse agents to integrate unique expertise, collaborate flexibly, and address challenges…

Artificial Intelligence · Computer Science 2025-11-05 Jingbo Wang , Sendong Zhao , Haochun Wang , Yuzheng Fan , Lizhe Zhang , Yan Liu , Ting Liu

In multi-user semantic communication, language mismatche poses a significant challenge when independently trained agents interact. We present a novel semantic equalization algorithm that enables communication between agents with different…

Machine Learning · Computer Science 2024-12-02 Tomás Hüttebräucker , Simone Fiorellino , Mohamed Sana , Paolo Di Lorenzo , Emilio Calvanese Strinati

Semantic communication transmits the extracted features of information rather than raw data, significantly reducing redundancy, which is crucial for addressing spectrum and energy challenges in 6G networks. In this paper, we introduce…

Machine Learning · Computer Science 2025-05-27 Wenjun Zhang , Qiong Wu , Pingyi Fan , Kezhi Wang , Nan Cheng , Wen Chen , Khaled B. Letaief

Caching networks are designed to reduce traffic load at backhaul links, by serving demands from edge-nodes. In the past decades, many studies have been done to address the caching problem. However, in practice, finding an optimal caching…

Networking and Internet Architecture · Computer Science 2018-07-03 Elahe Rezaei , Hafez Eslami Manoochehri , Babak Hossein Khalaj

How to efficiently serve Large Language Models (LLMs) has become a pressing issue because of their huge computational cost in their autoregressive generation process. To mitigate computational costs, LLMs often employ the KV Cache technique…

Computation and Language · Computer Science 2024-07-23 Zheng Wang , Boxiao Jin , Zhongzhi Yu , Minjia Zhang

A flurry of recent work has demonstrated that pre-trained large language models (LLMs) can be effective task planners for a variety of single-robot tasks. The planning performance of LLMs is significantly improved via prompting techniques,…

Robotics · Computer Science 2024-03-25 Yongchao Chen , Jacob Arkin , Yang Zhang , Nicholas Roy , Chuchu Fan

Mixture of Experts (MoE) LLMs have recently gained attention for their ability to enhance performance by selectively engaging specialized subnetworks or "experts" for each input. However, deploying MoEs on memory-constrained devices remains…