English
Related papers

Related papers: Shared Disk KV Cache Management for Efficient Mult…

200 papers

Optimizing the Key-Value (KV) cache of the Large Language Model (LLM) has been considered critical to saving the cost of inference. Most of the existing KV-cache compression algorithms attempted to sparsify the sequence of tokens by taking…

Machine Learning · Computer Science 2024-10-11 Zihao Wang , Bin Cui , Shaoduo Gan

The large size of the KV cache has become a major bottleneck for serving LLMs with increasing context lengths. In response, many KV cache compression methods, such as token dropping and quantization, have been proposed. However, almost all…

Hardware Architecture · Computer Science 2026-05-19 Jiayi Yao , Samuel Shen , Kuntai Du , Shaoting Feng , Dongjoo Seo , Rui Zhang , Yuyang Huang , Yuhan Liu , Shan Lu , Junchen Jiang

While Key-Value (KV) cache succeeds in reducing redundant computations in auto-regressive models, it introduces significant memory overhead, limiting its practical deployment in long-sequence scenarios. Existing KV retrieval methods…

Machine Learning · Computer Science 2025-10-14 Wenbo Wu , Qingyi Si , Xiurui Pan , Ye Wang , Jie Zhang

Communication in Large Language Model (LLM)-based multi-agent systems is moving beyond discrete tokens to preserve richer context. Recent work such as LatentMAS enables agents to exchange latent messages through full key-value (KV) caches.…

Machine Learning · Computer Science 2026-04-16 Yiping Li , Zhiyu An , Wan Du

Large language model (LLM)-based multi-agent systems increasingly rely on intermediate communication to coordinate complex tasks. While most existing systems communicate through natural language, recent work shows that latent communication,…

Artificial Intelligence · Computer Science 2026-05-22 Sadia Asif , Mohammad Mohammadi Amiri , Momin Abbas , Prasanna Sattigeri , Karthikeyan Natesan Ramamurthy

The linear memory growth of the KV cache poses a significant bottleneck for LLM inference in long-context tasks. Existing static compression methods often fail to preserve globally important information. Although recent dynamic retrieval…

Computation and Language · Computer Science 2026-04-21 Zhiyuan Shi , Qibo Qiu , Feng Xue , Zhonglin Jiang , Li Yu , Jian Jiang , Xiaofei He , Wenxiao Wang

The transformer's context window is vital for tasks such as few-shot learning and conditional generation as it preserves previous tokens for active memory. However, as the context lengths increase, the computational costs grow…

Computation and Language · Computer Science 2025-04-01 Jeffrey Willette , Heejun Lee , Youngwan Lee , Myeongjae Jeon , Sung Ju Hwang

Large language models (LLMs) have demonstrated exceptional capabilities in generating text, images, and video content. However, as context length grows, the computational cost of attention increases quadratically with the number of tokens,…

Computation and Language · Computer Science 2025-04-23 Neusha Javidnia , Bita Darvish Rouhani , Farinaz Koushanfar

Small language models (SLMs) support efficient deployments on resource-constrained edge devices, but their limited capacity compromises inference performance. Retrieval-augmented generation (RAG) is a promising solution to enhance model…

Machine Learning · Computer Science 2025-04-17 Shangyu Liu , Zhenzhe Zheng , Xiaoyao Huang , Fan Wu , Guihai Chen , Jie Wu

Large language models (LLMs) are widely deployed with rapidly expanding context windows to support increasingly demanding applications. However, long contexts pose significant deployment challenges, primarily due to the KV cache whose size…

Machine Learning · Computer Science 2026-03-10 Guangda Liu , Chengwei Li , Zhenyu Ning , Jing Lin , Yiwu Yao , Danning Ke , Minyi Guo , Jieru Zhao

Compound AI systems, such as agentic systems, are an emerging trend in large-scale enterprise settings, with multiple LLMs specialized for different users, tasks, and/or roles working together. In these scenarios, different models often…

Long-context Multimodal Large Language Models (MLLMs) demand substantial computational resources for inference as the growth of their multimodal Key-Value (KV) cache, in response to increasing input lengths, challenges memory and time…

Computation and Language · Computer Science 2024-06-27 Zhongwei Wan , Ziang Wu , Che Liu , Jinfa Huang , Zhihong Zhu , Peng Jin , Longyue Wang , Li Yuan

KV cache is a widely used acceleration technique for large language models (LLMs) inference. However, its memory requirement grows rapidly with input length. Previous studies have reduced the size of KV cache by either removing the same…

Computation and Language · Computer Science 2025-01-28 Xingyang He , Jie Liu , Shaowei Chen

Although Large Language Models (LLMs) demonstrate significant capabilities, their reliance on parametric knowledge often leads to inaccuracies. Retrieval Augmented Generation (RAG) mitigates this by incorporating external knowledge, but…

Artificial Intelligence · Computer Science 2025-11-04 Hailong Yin , Bin Zhu , Jingjing Chen , Chong-Wah Ngo

Retrieval Augmented Generation (RAG) has gradually emerged as a promising paradigm for enhancing the accuracy and factual consistency of content generated by large language models (LLMs). However, existing RAG studies primarily focus on…

Information Retrieval · Computer Science 2025-07-24 Qikai Wei , Huansheng Ning , Chunlong Han , Jianguo Ding

KV cache quantization can improve Large Language Models (LLMs) inference throughput and latency in long contexts and large batch-size scenarios while preserving LLMs effectiveness. However, current methods have three unsolved issues:…

Machine Learning · Computer Science 2025-11-21 Xing Li , Zeyu Xing , Yiming Li , Linping Qu , Hui-Ling Zhen , Wulong Liu , Yiwu Yao , Sinno Jialin Pan , Mingxuan Yuan

This study presents a method for implementing generative AI services by utilizing the Large Language Models (LLM) application architecture. With recent advancements in generative AI technology, LLMs have gained prominence across various…

Artificial Intelligence · Computer Science 2024-01-03 Cheonsu Jeong

Generating texts with a large language model (LLM) consumes massive amounts of memory. Apart from the already-large model parameters, the key/value (KV) cache that holds information about previous tokens in a sequence can grow to be even…

Hardware Architecture · Computer Science 2023-06-12 Yunho Jin , Chun-Feng Wu , David Brooks , Gu-Yeon Wei

Key-value (KV) caching has emerged as a crucial optimization technique for accelerating inference in large language models (LLMs). By allowing the attention operation to scale linearly rather than quadratically with the total sequence…

Computation and Language · Computer Science 2026-01-06 Gopi Krishna Jha , Sameh Gobriel , Liubov Talamanova , Nilesh Jain

Single-step retrieval-augmented generation (RAG) provides an efficient way to incorporate external information for simple question answering tasks but struggles with complex questions. Agentic RAG extends this paradigm by replacing…

Computation and Language · Computer Science 2026-05-08 Yijia Zheng , Marcel Worring