English
Related papers

Related papers: LOOK-M: Look-Once Optimization in KV Cache for Eff…

200 papers

The key-value (KV) cache is a foundational optimization in Transformer-based large language models (LLMs), eliminating redundant recomputation of past token representations during autoregressive generation. However, its memory footprint…

Machine Learning · Computer Science 2026-03-24 Yichun Xu , Navjot K. Khaira , Tejinder Singh

Large language models (LLMs) have shown great performance on complex reasoning tasks but often require generating long intermediate thoughts before reaching a final answer. During generation, LLMs rely on a key-value (KV) cache for…

Large Language Models (LLMs) are increasingly deployed in long-context tasks such as reasoning, code generation, and multi-turn dialogue. However, inference over extended contexts is bottlenecked by the Key-Value (KV) cache, whose memory…

Computation and Language · Computer Science 2026-05-21 Seonghwan Choi , Beomseok Kang , Dongwon Jo , Jae-Joon Kim

The advent of pre-trained large language models (LLMs) has revolutionized various natural language processing tasks. These models predominantly employ an auto-regressive decoding mechanism that utilizes Key-Value (KV) caches to eliminate…

Computation and Language · Computer Science 2024-06-12 Hao Yu , Zelan Yang , Shen Li , Yong Li , Jianxin Wu

As vision-language models (VLMs) tackle increasingly complex and multimodal tasks, the rapid growth of Key-Value (KV) cache imposes significant memory and computational bottlenecks during inference. While Multi-Head Latent Attention (MLA)…

Computer Vision and Pattern Recognition · Computer Science 2026-01-19 Xiaoran Fan , Zhichao Sun , Tao Ji , Lixing Shen , Tao Gui

How to efficiently serve Large Language Models (LLMs) has become a pressing issue because of their huge computational cost in their autoregressive generation process. To mitigate computational costs, LLMs often employ the KV Cache technique…

Computation and Language · Computer Science 2024-07-23 Zheng Wang , Boxiao Jin , Zhongzhi Yu , Minjia Zhang

Autoregressive decoding in large language models (LLMs) requires caching a growing list of past key-value (KV) pairs, making long-context inference a memory-bound problem. While recent methods have explored quantizing the cache, evicting…

Computation and Language · Computer Science 2025-10-08 Harshil Vejendla

Although Large Vision Language Models (LVLMs) have demonstrated impressive multimodal reasoning capabilities, their scalability and deployment are constrained by massive computational requirements. In particular, the massive amount of…

Machine Learning · Computer Science 2026-04-14 Surendra Pathak , Bo Han

A critical approach for efficiently deploying computationally demanding large language models (LLMs) is Key-Value (KV) caching. The KV cache stores key-value states of previously generated tokens, significantly reducing the need for…

Computation and Language · Computer Science 2024-09-10 Akide Liu , Jing Liu , Zizheng Pan , Yefei He , Gholamreza Haffari , Bohan Zhuang

Language models (LMs) and their extension, vision-language models (VLMs), have achieved remarkable performance across various tasks. However, they still struggle with complex reasoning tasks that require multimodal or multilingual…

Machine Learning · Computer Science 2025-07-09 Wenyi Wu , Zixuan Song , Kun Zhou , Yifei Shao , Zhiting Hu , Biwei Huang

Recent advancements in Large Language Models (LLMs) have spurred interest in numerous applications requiring robust long-range capabilities, essential for processing extensive input contexts and continuously generating extended outputs. As…

Machine Learning · Computer Science 2025-07-22 Dachuan Shi , Yonggan Fu , Xiangchi Yuan , Zhongzhi Yu , Haoran You , Sixu Li , Xin Dong , Jan Kautz , Pavlo Molchanov , Yingyan , Lin

Multi-modal Large Language Models (MLLMs) serving systems commonly employ KV-cache compression to reduce memory footprint. However, existing compression methods introduce significant processing overhead and queuing delays, particularly in…

Multimedia · Computer Science 2025-03-12 Jianian Zhu , Hang Wu , Haojie Wang , Yinghui Li , Biao Hou , Ruixuan Li , Jidong Zhai

Multimodal large language models (MLLMs) have made significant progress in visual-language reasoning, but their ability to efficiently handle long videos remains limited. Despite recent advances in long-context MLLMs, storing and attending…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Yanlai Yang , Zhuokai Zhao , Satya Narayan Shukla , Aashu Singh , Shlok Kumar Mishra , Lizhu Zhang , Mengye Ren

Multimodal Large Language Models (MLLMs) have demonstrated remarkable performance across diverse applications. However, their computational overhead during deployment remains a critical bottleneck. While Key-Value (KV) caching effectively…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Insu Han , Zeliang Zhang , Zhiyuan Wang , Yifan Zhu , Susan Liang , Jiani Liu , Haiting Lin , Mingjie Zhao , Chenliang Xu , Kun Wan , Wentian Zhao

Large Language Models (LLMs) excel across a variety of language tasks yet are constrained by limited input lengths and high computational costs. Existing approaches\textemdash such as relative positional encodings (e.g., RoPE, ALiBi) and…

Computation and Language · Computer Science 2025-02-18 Kun-Hui Lee , Eunhwan Park , Donghoon Han , Seung-Hoon Na

Multimodal Large Language Models (MLLMs) are commonly derived by extending pre-trained Large Language Models (LLMs) with visual capabilities. In this work, we investigate how MLLMs process visual inputs by analyzing their attention…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Jiahui Wang , Zuyan Liu , Yongming Rao , Jiwen Lu

Recent large vision-language models (LVLMs) demonstrate remarkable capabilities in processing extended multi-modal sequences, yet the resulting key-value (KV) cache expansion creates a critical memory bottleneck that fundamentally limits…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Xuyang Liu , Xiyan Gui , Yuchao Zhang , Linfeng Zhang

Large Language Models (LLMs) have ignited an innovative surge of AI applications, marking a new era of exciting possibilities equipped with extended context windows. However, hosting these models is cost-prohibitive mainly due to the…

Computation and Language · Computer Science 2024-08-09 Yilong Chen , Guoxia Wang , Junyuan Shang , Shiyao Cui , Zhenyu Zhang , Tingwen Liu , Shuohuan Wang , Yu Sun , Dianhai Yu , Hua Wu

Recently, significant progress has been made in developing reasoning-capable Large Language Models (LLMs) through long Chain-of-Thought (CoT) techniques. However, this long-CoT reasoning process imposes substantial memory overhead due to…

Computation and Language · Computer Science 2025-05-27 Tengxuan Liu , Shiyao Li , Jiayi Yang , Tianchen Zhao , Feng Zhou , Xiaohui Song , Guohao Dai , Shengen Yan , Huazhong Yang , Yu Wang

The context caching technique is employed to accelerate the Multimodal Large Language Model (MLLM) inference by prevailing serving platforms currently. However, this approach merely reuses the Key-Value (KV) cache of the initial sequence of…

Machine Learning · Computer Science 2025-09-23 Shiju Zhao , Junhao Hu , Rongxiao Huang , Jiaqi Zheng , Guihai Chen