English
Related papers

Related papers: Which Heads Matter for Reasoning? RL-Guided KV Cac…

200 papers

Large Language models (LLMs) have become a research hotspot. To accelerate the inference of LLMs, storing computed caches in memory has become the standard technique. However, as the inference length increases, growing KV caches might lead…

Computation and Language · Computer Science 2024-12-13 Meizhi Zhong , Xikai Liu , Chen Zhang , Yikun Lei , Yan Gao , Yao Hu , Kehai Chen , Min Zhang

Large Language Models (LLMs) often rely on long chain-of-thought (CoT) reasoning to solve complex tasks. While effective, these trajectories are frequently inefficient, leading to high latency from excessive token generation, or unstable…

The Key-Value (KV) cache is integral to efficient autoregressive inference in large language models (LLMs), yet its unbounded growth in stateful multi-turn scenarios presents major challenges. This paper examines the interplay between KV…

Machine Learning · Computer Science 2025-11-10 Pratik Poudel

Large Language Models (LLMs) have been widely deployed in a variety of applications, and the context length is rapidly increasing to handle tasks such as long-document QA and complex logical reasoning. However, long context poses…

Machine Learning · Computer Science 2025-06-17 Guangda Liu , Chengwei Li , Jieru Zhao , Chenqi Zhang , Minyi Guo

The Key-Value (KV) cache is a crucial component in serving transformer-based autoregressive large language models (LLMs), enabling faster inference by storing previously computed KV vectors. However, its memory consumption scales linearly…

Machine Learning · Computer Science 2024-10-07 Rongzhi Zhang , Kuang Wang , Liyuan Liu , Shuohang Wang , Hao Cheng , Chao Zhang , Yelong Shen

Large language models (LLMs) with chain-of-thought reasoning achieve state-of-the-art performance across complex problem-solving tasks, but their verbose reasoning traces and large context requirements make them impractical for edge…

With reasoning becoming the generative paradigm for large language models (LLMs), the memory bottleneck caused by KV cache during the decoding phase has become a critical factor limiting high-concurrency service. Although existing KV cache…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-11 Mengqi Liao , Lu Wang , Chaoyun Zhang , Bo Qiao , Si Qin , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang , Huaiyu Wan

Large Language Models (LLMs) require substantial computational resources during generation. While the Key-Value (KV) cache significantly accelerates this process by storing attention intermediates, its memory footprint grows linearly with…

Computation and Language · Computer Science 2025-08-05 Yi Su , Quantong Qiu , Yuechi Zhou , Juntao Li , Qingrong Xia , Ping Li , Xinyu Duan , Zhefeng Wang , Min Zhang

The linear memory growth of the KV cache poses a significant bottleneck for LLM inference in long-context tasks. Existing static compression methods often fail to preserve globally important information. Although recent dynamic retrieval…

Computation and Language · Computer Science 2026-04-21 Zhiyuan Shi , Qibo Qiu , Feng Xue , Zhonglin Jiang , Li Yu , Jian Jiang , Xiaofei He , Wenxiao Wang

Large Language Models (LLMs) have made remarkable progress in processing extensive contexts, with the Key-Value (KV) cache playing a vital role in enhancing their performance. However, the growth of the KV cache in response to increasing…

Computation and Language · Computer Science 2024-06-18 Yuhong Li , Yingbing Huang , Bowen Yang , Bharat Venkitesh , Acyr Locatelli , Hanchen Ye , Tianle Cai , Patrick Lewis , Deming Chen

The Key-Value (KV) cache is central to the efficiency of transformer-based large language models (LLMs), storing previously computed vectors to accelerate inference. Yet, as sequence length and batch size grow, the cache becomes a major…

Machine Learning · Computer Science 2025-12-08 Damien Lesens , Beheshteh T. Rakhshan , Guillaume Rabusseau

Huge memory consumption has been a major bottleneck for deploying high-throughput large language models in real-world applications. In addition to the large number of parameters, the key-value (KV) cache for the attention mechanism in the…

Computation and Language · Computer Science 2024-06-05 Haoyi Wu , Kewei Tu

Efficient inference of large language models (LLMs) is hindered by an ever-growing key-value (KV) cache, making KV cache compression a critical research direction. Traditional methods selectively evict less important KV cache entries, which…

Machine Learning · Computer Science 2025-12-01 Yuxuan Tian , Zihan Wang , Yebo Peng , Aomufei Yuan , Zhiming Wang , Bairen Yi , Xin Liu , Yong Cui , Tong Yang

Large Language Models (LLMs) are increasingly deployed in long-context tasks such as reasoning, code generation, and multi-turn dialogue. However, inference over extended contexts is bottlenecked by the Key-Value (KV) cache, whose memory…

Computation and Language · Computer Science 2026-05-21 Seonghwan Choi , Beomseok Kang , Dongwon Jo , Jae-Joon Kim

While Key-Value (KV) cache succeeds in reducing redundant computations in auto-regressive models, it introduces significant memory overhead, limiting its practical deployment in long-sequence scenarios. Existing KV retrieval methods…

Machine Learning · Computer Science 2025-10-14 Wenbo Wu , Qingyi Si , Xiurui Pan , Ye Wang , Jie Zhang

Key-Value (KV) cache facilitates efficient large language models (LLMs) inference by avoiding recomputation of past KVs. As the batch size and context length increase, the oversized KV caches become a significant memory bottleneck,…

Machine Learning · Computer Science 2025-02-04 Zunhai Su , Zhe Chen , Wang Shen , Hanyu Wei , Linge Li , Huangqi Yu , Kehong Yuan

Modern reasoning models, such as OpenAI's o1 and DeepSeek-R1, exhibit impressive problem-solving capabilities but suffer from critical inefficiencies: high inference latency, excessive computational resource consumption, and a tendency…

Computation and Language · Computer Science 2025-08-05 Hang Yuan , Bin Yu , Haotian Li , Shijun Yang , Christina Dan Wang , Zhou Yu , Xueyin Xu , Weizhen Qi , Kai Chen

Recently, large language models (LLMs) have shown remarkable reasoning abilities by producing long reasoning traces. However, as the sequence length grows, the key-value (KV) cache expands linearly, incurring significant memory and…

Computation and Language · Computer Science 2026-02-04 Zican Dong , Peiyu Liu , Junyi Li , Zhipeng Chen , Han Peng , Shuo Wang , Wayne Xin Zhao

Large language models (LLMs) have demonstrated exceptional capabilities in generating text, images, and video content. However, as context length grows, the computational cost of attention increases quadratically with the number of tokens,…

Computation and Language · Computer Science 2025-04-23 Neusha Javidnia , Bita Darvish Rouhani , Farinaz Koushanfar

Large language models (LLMs) have achieved remarkable success on various aspects of human life. However, one of the major challenges in deploying these models is the substantial memory consumption required to store key-value pairs (KV),…

Machine Learning · Computer Science 2025-02-26 Qiheng Sun , Hongwei Zhang , Haocheng Xia , Jiayao Zhang , Jinfei Liu , Kui Ren