English
Related papers

Related papers: Mask Tokens as Prophet: Fine-Grained Cache Evictio…

200 papers

Multimodal large language models (MLLMs) have recently demonstrated strong capabilities in understanding and generating responses from diverse visual inputs, including high-resolution images and long video sequences. As these models scale…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Junwan Kim , Hyunkyung Bae

Multimodal large language models (MLLMs) are plagued by exorbitant inference costs attributable to the profusion of visual tokens within the vision encoder. The redundant visual tokens engenders a substantial computational load and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Jiedong Zhuang , Lu Lu , Ming Dai , Rui Hu , Jian Chen , Qiang Liu , Haoji Hu

Deploying Large Language Models (LLMs) in streaming applications such as multi-round dialogue, where long interactions are expected, is urgently needed but poses two major challenges. Firstly, during the decoding stage, caching previous…

Computation and Language · Computer Science 2024-04-09 Guangxuan Xiao , Yuandong Tian , Beidi Chen , Song Han , Mike Lewis

Key-Value (KV) Caching has become an essential technique for accelerating the inference speed and throughput of generative Large Language Models~(LLMs). However, the memory footprint of the KV cache poses a critical bottleneck in LLM…

Machine Learning · Computer Science 2024-02-29 June Yong Yang , Byeongwook Kim , Jeongin Bae , Beomseok Kwon , Gunho Park , Eunho Yang , Se Jung Kwon , Dongsoo Lee

Large Language Models (LLMs), epitomized by ChatGPT's release in late 2022, have revolutionized various industries with their advanced language comprehension. However, their efficiency is challenged by the Transformer architecture's…

Computation and Language · Computer Science 2024-11-21 Luohe Shi , Hongyi Zhang , Yao Yao , Zuchao Li , Hai Zhao

Large Language Models (LLMs) use key-value (KV) cache to reduce redundant computation in autoregressive generation. However, the KV cache size increases linearly during generation, leading to excessive memory usage, especially for long…

Computation and Language · Computer Science 2025-03-04 Jian Yuan , Ziwei He , Haoli Bai , Jingwen Leng , Bo Jiang

Large language models (LLMs) have demonstrated remarkable performance on long-context tasks, but are often bottlenecked by memory constraints. Namely, the KV cache, which is used to significantly speed up attention computations, grows…

With the advancements in long-context inference capabilities of large language models (LLMs), the KV cache has become one of the foundational components. However, its substantial GPU memory consumption makes KV cache compression a key…

Computation and Language · Computer Science 2025-03-28 Youhui Zuo , Sibo Wei , Chen Zhang , Zhuorui Liu , Wenpeng Lu , Dawei Song

The key-value (KV) cache is a foundational optimization in Transformer-based large language models (LLMs), eliminating redundant recomputation of past token representations during autoregressive generation. However, its memory footprint…

Machine Learning · Computer Science 2026-03-24 Yichun Xu , Navjot K. Khaira , Tejinder Singh

Large Language Models (LLMs) have been widely adopted to process long-context tasks. However, the large memory overhead of the key-value (KV) cache poses significant challenges in long-context scenarios. Existing training-free KV cache…

Machine Learning · Computer Science 2024-10-22 Luning Wang , Shiyao Li , Xuefei Ning , Zhihang Yuan , Shengen Yan , Guohao Dai , Yu Wang

While large language models (LLMs) excel at handling long-context sequences, they require substantial prefill computation and key-value (KV) cache, which can heavily burden computational efficiency and memory usage in both prefill and…

Machine Learning · Computer Science 2026-04-21 Dongwon Jo , Jiwon Song , Yulhwa Kim , Jae-Joon Kim

Huge memory consumption has been a major bottleneck for deploying high-throughput large language models in real-world applications. In addition to the large number of parameters, the key-value (KV) cache for the attention mechanism in the…

Computation and Language · Computer Science 2024-06-05 Haoyi Wu , Kewei Tu

Efficient inference with Large Language Models (LLMs) increasingly relies on Key-Value (KV) caches to store previously computed key and value vectors at each layer. These caches are essential to minimize redundant computation during…

Hardware Architecture · Computer Science 2026-04-08 Oteo Mamo , Olga Kogiou , Hyunjin Yi , Weikuan Yu

Large Language Models (LLMs) have revolutionized natural language processing tasks, but their deployment in datacenter environments faces significant challenges due to the massive memory requirements of key-value (KV) caches. During the…

Artificial Intelligence · Computer Science 2025-12-16 Dong Liu , Yanxuan Yu

High throughput serving of large language models (LLMs) requires batching sufficiently many requests at a time. However, existing systems struggle because the key-value cache (KV cache) memory for each request is huge and grows and shrinks…

Machine Learning · Computer Science 2023-09-13 Woosuk Kwon , Zhuohan Li , Siyuan Zhuang , Ying Sheng , Lianmin Zheng , Cody Hao Yu , Joseph E. Gonzalez , Hao Zhang , Ion Stoica

Large Language Models (LLMs) are increasingly deployed in large-scale online services, enabling sophisticated applications. However, the computational overhead of generating key-value (KV) caches in the prefill stage presents a major…

Machine Learning · Computer Science 2025-02-24 Shuowei Jin , Xueshen Liu , Qingzhao Zhang , Z. Morley Mao

Large Language Models (LLMs) have made remarkable progress in processing extensive contexts, with the Key-Value (KV) cache playing a vital role in enhancing their performance. However, the growth of the KV cache in response to increasing…

Computation and Language · Computer Science 2024-06-18 Yuhong Li , Yingbing Huang , Bowen Yang , Bharat Venkitesh , Acyr Locatelli , Hanchen Ye , Tianle Cai , Patrick Lewis , Deming Chen

Recently, large vision-language models (LVLMs) have rapidly gained popularity for their strong generation and reasoning capabilities given diverse multimodal inputs. However, these models incur significant computational and memory overhead…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Ao Wang , Hui Chen , Jiaxin Li , Jianchao Tan , Kefeng Zhang , Xunliang Cai , Zijia Lin , Jungong Han , Guiguang Ding

Withtherapid advancement of large language models (LLMs), the context length for inference has been continuously increasing, leading to an exponential growth in the demand for Key-Value (KV) caching. This has resulted in a significant…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-11 Yanyu Liu , Jingying Fu , Sixiang Liu , Yitian Zou , You Fu , Jiehan Zhou , Shouhua Zhang

Large language models have revolutionized natural language processing but face significant challenges of high storage and runtime costs, due to the transformer architecture's reliance on self-attention, particularly the large KV cache for…

Computation and Language · Computer Science 2026-05-29 Yuan Feng , Junlin Lv , Haoyu Guo , Yukun Cao , S Kevin Zhou , Xike Xie