English
Related papers

Related papers: On 10x Better Scalability: KV Stores Scale Up KV C…

200 papers

The Key-Value (KV) cache is central to the efficiency of transformer-based large language models (LLMs), storing previously computed vectors to accelerate inference. Yet, as sequence length and batch size grow, the cache becomes a major…

Machine Learning · Computer Science 2025-12-08 Damien Lesens , Beheshteh T. Rakhshan , Guillaume Rabusseau

We describe KVLink, an approach for efficient key-value (KV) cache reuse in large language models (LLMs). In many LLM applications, different inputs can share overlapping context, such as the same retrieved document appearing in multiple…

Computation and Language · Computer Science 2025-11-11 Jingbo Yang , Bairu Hou , Wei Wei , Yujia Bao , Shiyu Chang

Withtherapid advancement of large language models (LLMs), the context length for inference has been continuously increasing, leading to an exponential growth in the demand for Key-Value (KV) caching. This has resulted in a significant…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-11 Yanyu Liu , Jingying Fu , Sixiang Liu , Yitian Zou , You Fu , Jiehan Zhou , Shouhua Zhang

Many computational factors limit broader deployment of large language models. In this paper, we focus on a memory bottleneck imposed by the key-value (KV) cache, a computational shortcut that requires storing previous KV pairs during…

Machine Learning · Computer Science 2024-06-13 Harry Dong , Xinyu Yang , Zhenyu Zhang , Zhangyang Wang , Yuejie Chi , Beidi Chen

Large Language Models (LLMs) are increasingly deployed in complex multi-agent applications that rely on external function calls. This workload creates severe performance challenges for the KV Cache: spatial contention leads to the eviction…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-21 Zhuohang Bian , Feiyang Wu , Zhuoran Li , Teng Ma , Youwei Zhuo

The Key-Value (KV) cache in generative large language models (LLMs) introduces substantial memory overhead. Existing works mitigate this burden by offloading or compressing the KV cache. However, loading the entire cache incurs significant…

Computation and Language · Computer Science 2025-05-28 Dingyu Yao , Bowen Shen , Zheng Lin , Wei Liu , Jian Luan , Bin Wang , Weiping Wang

The log-structured merge tree (LSM-tree) gains wide popularity in building key-value (KV) stores. It employs logs to back up arriving KV pairs and maintains a few on-disk levels with exponentially increasing capacity limits, resembling a…

Data Structures and Algorithms · Computer Science 2021-09-29 Yanpeng Hu , Chundong Wang

Large language model (LLM) based agentic workflows have become a popular paradigm for coordinating multiple specialized agents to solve complex tasks. To improve serving efficiency, existing LLM systems employ prefix caching to reuse…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-11 Zaifeng Pan , Ajjkumar Patel , Zhengding Hu , Yipeng Shen , Yue Guan , Wan-Lu Li , Lianhui Qin , Yida Wang , Yufei Ding

Efficient key-value (KV) cache management is crucial for the practical deployment of large language models (LLMs), yet existing compression techniques often incur a trade-off between performance degradation and computational overhead. We…

Machine Learning · Computer Science 2026-02-10 Jang-Hyun Kim , Dongyoon Han , Sangdoo Yun

Large Language Model (LLM) inference is increasingly constrained by memory bandwidth, with frequent access to the key-value (KV) cache dominating data movement. While attention sparsity reduces some memory traffic, the relevance of past…

Hardware Architecture · Computer Science 2025-09-16 Yunhua Fang , Rui Xie , Asad Ul Haq , Linsen Ma , Kaoutar El Maghraoui , Naigang Wang , Meng Wang , Liu Liu , Tong Zhang

Large Language Models (LLMs) have been widely adopted to process long-context tasks. However, the large memory overhead of the key-value (KV) cache poses significant challenges in long-context scenarios. Existing training-free KV cache…

Machine Learning · Computer Science 2024-10-22 Luning Wang , Shiyao Li , Xuefei Ning , Zhihang Yuan , Shengen Yan , Guohao Dai , Yu Wang

Large Language Models (LLMs) are increasingly deployed in large-scale online services, enabling sophisticated applications. However, the computational overhead of generating key-value (KV) caches in the prefill stage presents a major…

Machine Learning · Computer Science 2025-02-24 Shuowei Jin , Xueshen Liu , Qingzhao Zhang , Z. Morley Mao

Large Language Models (LLMs), epitomized by ChatGPT's release in late 2022, have revolutionized various industries with their advanced language comprehension. However, their efficiency is challenged by the Transformer architecture's…

Computation and Language · Computer Science 2024-11-21 Luohe Shi , Hongyi Zhang , Yao Yao , Zuchao Li , Hai Zhao

Large Language Models are increasingly being deployed in datacenters. Serving these models requires careful memory management, as their memory usage includes static weights, dynamic activations, and key-value caches. While static weights…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-08 Jiale Xu , Rui Zhang , Yi Xiong , Cong Guo , Zihan Liu , Yangjie Zhou , Weiming Hu , Hao Wu , Changxu Shao , Ziqing Wang , Yongjie Yuan , Junping Zhao , Minyi Guo , Jingwen Leng

In Text-to-SQL tasks, existing LLM-based methods often include extensive database schemas in prompts, leading to long context lengths and increased prefilling latency. While user queries typically focus on recurrent table sets-offering an…

Computation and Language · Computer Science 2026-01-14 Jinbo Su , Yuxuan Hu , Cuiping Li , Hong Chen , Jia Li , Lintao Ma , Jing Zhang

Large Language Model (LLM) serving is increasingly constrained by the growing size of the key-value (KV) cache, which scales with both context length and generation length. Prior work shows that attention is dominated by a small subset of…

Machine Learning · Computer Science 2026-04-21 Nazmul Takbir , Hamidreza Alikhani , Nikil Dutt , Sangeetha Abdu Jyothi

Key-value (KV) cache memory management is the primary bottleneck limiting throughput and cost-efficiency in large-scale GPU inference serving. Current systems suffer from three compounding inefficiencies: (1) the absence of unified KV cache…

Hardware Architecture · Computer Science 2026-05-01 Sanjeev Rao Ganjihal

Large Language Models (LLMs) suffer inference-time memory bottlenecks dominated by the attention Key-Value (KV) cache, which scales with model size and context length. While KV-cache quantization alleviates this cost, bit allocation between…

Machine Learning · Computer Science 2026-05-12 Mohsen Hariri , Alan Luo , Weicong Chen , Shaochen Zhong , Tianyi Zhang , Qifan Wang , Xia Hu , Xiaotian Han , Vipin Chaudhary

Vision-Language Models (VLMs) have emerged as a critical and fast-growing extension of Large Language Models (LLMs) that enable multimodal reasoning through both text and image inputs. Although VLMs enrich the capabilities of language…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Yingbing Huang , Tharun Adithya Srikrishnan , Steven K. Reinhardt , Deming Chen

Large Language Models (LLMs) have been widely deployed in a variety of applications, and the context length is rapidly increasing to handle tasks such as long-document QA and complex logical reasoning. However, long context poses…

Machine Learning · Computer Science 2025-06-17 Guangda Liu , Chengwei Li , Jieru Zhao , Chenqi Zhang , Minyi Guo