English
Related papers

Related papers: AirCache: Activating Inter-modal Relevancy KV Cach…

200 papers

Despite the significant success of large language models (LLMs), their extensive memory requirements pose challenges for deploying them in long-context token generation. The substantial memory footprint of LLM decoders arises from the…

Machine Learning · Computer Science 2024-02-12 Amir Zandieh , Insu Han , Vahab Mirrokni , Amin Karbasi

Visual token reduction lowers inference costs caused by extensive image features in large vision-language models (LVLMs). Unlike relevant studies that prune tokens in self-attention-only LVLMs, our work uniquely addresses…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Jewon Lee , Ki-Ung Song , Seungmin Yang , Donguk Lim , Jaeyeon Kim , Wooksu Shin , Bo-Kyeong Kim , Yong Jae Lee , Tae-Ho Kim

Large language models (LLMs) with extended context windows have become increasingly prevalent for tackling complex tasks. However, the substantial Key-Value (KV) cache required for long-context LLMs poses significant deployment challenges.…

Computation and Language · Computer Science 2025-06-16 Jie Hu , Shengnan Wang , Yutong He , Ping Gong , Jiawei Yi , Juncheng Zhang , Youhui Bai , Renhai Chen , Gong Zhang , Cheng Li , Kun Yuan

As vision-language models (VLMs) tackle increasingly complex and multimodal tasks, the rapid growth of Key-Value (KV) cache imposes significant memory and computational bottlenecks during inference. While Multi-Head Latent Attention (MLA)…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Xiaoran Fan , Zhichao Sun , Tao Ji , Lixing Shen , Tao Gui

Large Language Models (LLMs) exhibit enhanced capabilities by Chain-of-Thought reasoning. However, the extended reasoning sequences introduce significant GPU memory overhead due to increased key-value (KV) cache. Existing KV cache…

Machine Learning · Computer Science 2025-10-16 Haoyue Zhang , Hualei Zhang , Xiaosong Ma , Jie Zhang , Song Guo

Large Language Models (LLMs) have made remarkable progress in processing extensive contexts, with the Key-Value (KV) cache playing a vital role in enhancing their performance. However, the growth of the KV cache in response to increasing…

Computation and Language · Computer Science 2024-06-18 Yuhong Li , Yingbing Huang , Bowen Yang , Bharat Venkitesh , Acyr Locatelli , Hanchen Ye , Tianle Cai , Patrick Lewis , Deming Chen

Transformer-based Large Language Models rely critically on the KV cache to efficiently handle extended contexts during the decode phase. Yet, the size of the KV cache grows proportionally with the input length, burdening both memory…

Computation and Language · Computer Science 2025-08-14 Payman Behnam , Yaosheng Fu , Ritchie Zhao , Po-An Tsai , Zhiding Yu , Alexey Tumanov

The integration of visual information into Large Language Models (LLMs) has enabled Multimodal LLMs (MLLMs), but the quadratic memory and computational costs of Transformer architectures remain a bottleneck. Existing KV cache eviction…

Machine Learning · Computer Science 2026-02-03 Xindian Ma , Yidi Lu , Peng Zhang , Jing Zhang

The development of large language models (LLMs) has revolutionized automated code generation. However, their high demand of computation resources has hindered a broader deployment and raised environmental concerns. A common strategy for…

Software Engineering · Computer Science 2024-11-12 Xiangyu Zhang , Yu Zhou , Guang Yang , Harald C. Gall , Taolue Chen

Long-context reasoning is a critical capability of large language models (LLMs), enabling applications such as long-document understanding, summarization, and code generation. However, efficient autoregressive inference relies on the…

Computation and Language · Computer Science 2026-04-28 Zahra Dehghanighobadi , Asja Fischer

The high memory demands of the Key-Value (KV) Cache during the inference of Large Language Models (LLMs) severely restrict their deployment in resource-constrained platforms. Quantization can effectively alleviate the memory pressure caused…

Machine Learning · Computer Science 2026-02-03 Fei Li , Song Liu , Weiguo Wu , Shiqiang Nie , Jinyu Wang

Large language models (LLMs) support long-context inference but suffer from substantial memory and runtime overhead due to Key-Value (KV) Cache growth. Existing KV Cache eviction methods primarily rely on local attention weights, neglecting…

Computation and Language · Computer Science 2026-05-11 Tho Mai , Joo-Young Kim

Large Language Models (LLMs) rely heavily on Key-Value (KV) caching to minimize inference latency. However, standard KV caches are context-dependent: reusing a cached document in a new context requires recomputing KV states to account for…

Machine Learning · Computer Science 2026-04-20 Chuangtao Chen , Grace Li Zhang , Xunzhao Yin , Cheng Zhuo , Bing Li , Ulf Schlichtmann

Transformers have emerged as the underpinning architecture for Large Language Models (LLMs). In generative language models, the inference process involves two primary phases: prompt processing and token generation. Token generation, which…

Machine Learning · Computer Science 2024-04-09 Muhammad Adnan , Akhil Arunkumar , Gaurav Jain , Prashant J. Nair , Ilya Soloveychik , Purushotham Kamath

Large Vision-Language Models (LVLMs) enable sophisticated reasoning over images and videos, yet their inference is hindered by a systemic efficiency barrier known as visual token dominance. This overhead is driven by a multi-regime…

Computation and Language · Computer Science 2026-04-15 Jun Zhang , Yicheng Ji , Feiyang Ren , Yihang Li , Bowen Zeng , Zonghao Chen , Ke Chen , Lidan Shou , Gang Chen , Huan Li

Although Large Vision Language Models (LVLMs) have demonstrated impressive multimodal reasoning capabilities, their scalability and deployment are constrained by massive computational requirements. In particular, the massive amount of…

Machine Learning · Computer Science 2026-04-14 Surendra Pathak , Bo Han

Large Audio-Language Models (LALMs) have set new benchmarks in speech processing, yet their deployment is hindered by the memory footprint of the Key-Value (KV) cache during long-context inference. While general KV cache compression…

Sound · Computer Science 2026-04-09 Yuxuan Wang , Peize He , Xiyan Gui , Xiaoqian Liu , Junhao He , Xuyang Liu , Zichen Wen , Xuming Hu , Linfeng Zhang

Multimodal Large Language Models (MLLMs) have demonstrated remarkable performance across diverse applications. However, their computational overhead during deployment remains a critical bottleneck. While Key-Value (KV) caching effectively…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Insu Han , Zeliang Zhang , Zhiyuan Wang , Yifan Zhu , Susan Liang , Jiani Liu , Haiting Lin , Mingjie Zhao , Chenliang Xu , Kun Wan , Wentian Zhao

Large language models (LLMs) demonstrate remarkable capabilities but face substantial serving costs due to their high memory demands, with the key-value (KV) cache being a primary bottleneck. State-of-the-art KV cache compression…

Machine Learning · Computer Science 2025-09-03 Yanqi Zhang , Yuwei Hu , Runyuan Zhao , John C. S. Lui , Haibo Chen

As context windows in LLMs scale to 100K+ tokens, the key-value (KV) cache becomes the dominant memory bottleneck, with recent methods claiming 80-90% savings and minimal benchmark degradation. We argue these evaluations miss a structural…

Computation and Language · Computer Science 2026-03-03 Samhruth Ananthanarayanan , Ayan Sengupta , Tanmoy Chakraborty