English
Related papers

Related papers: VLCache: Computing 2% Vision Tokens and Reusing 98…

200 papers

Key-Value (KV) cache has become a de facto component of modern Large Vision-Language Models (LVLMs) for inference. While it enhances decoding efficiency in Large Language Models (LLMs), its direct adoption in LVLMs introduces substantial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Xihao Chen , Yangyang Guo , Roger Zimmermann

Vision-Language-Navigation (VLN) models exhibit excellent navigation accuracy but incur high computational overhead. Token caching has emerged as a promising training-free strategy to reduce this cost by reusing token computation results;…

KV cache restoration has emerged as a dominant bottleneck in serving long-context LLM workloads, including multi-turn conversations, retrieval-augmented generation, and agentic pipelines. Existing approaches treat restoration as a…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-29 Sean Nian , Jiahao Fang , Qilong Feng , Zhiyu Wu , Fan Lai

We address LLM serving workloads where repeated requests share a common solution structure but differ in localized constraints, such as output schema, variable names, or numeric constants. Prior caching approaches typically reuse either…

Operating Systems · Computer Science 2026-04-01 Azam Nouri

The large size of the KV cache has become a major bottleneck for serving LLMs with increasing context lengths. In response, many KV cache compression methods, such as token dropping and quantization, have been proposed. However, almost all…

Hardware Architecture · Computer Science 2026-05-19 Jiayi Yao , Samuel Shen , Kuntai Du , Shaoting Feng , Dongjoo Seo , Rui Zhang , Yuyang Huang , Yuhan Liu , Shan Lu , Junchen Jiang

In the field of instruction-following large vision-language models (LVLMs), the efficient deployment of these models faces challenges, notably due to the high memory demands of their key-value (KV) caches. Conventional cache management…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Zuyan Liu , Benlin Liu , Jiahui Wang , Yuhao Dong , Guangyi Chen , Yongming Rao , Ranjay Krishna , Jiwen Lu

Large Language Models(LLMs) have had a profound impact on AI applications, particularly in the domains of long-text comprehension and generation. KV Cache technology is one of the most widely used techniques in the industry. It ensures…

Computation and Language · Computer Science 2024-04-30 Qiaozhi He , Zhihua Wu

Prefix KV caching has become a key mechanism in LLM serving: it reduces time to first token (TTFT) by avoiding redundant computation across requests that share a prefix (i.e., the system prompt). However, the accumulated KV cache is often…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-25 Yu Zhu , Aditya Dhakal , Yunming Xiao , Dejan Milojicic , Gustavo Alonso

Recently, video language models (VLMs) have been applied in various fields. However, the visual token sequence of the VLM is too long, which may cause intolerant inference latency and GPU memory usage. Existing methods propose…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Wei Tao , Xiaoyang Qu , Peiqiang Wang , Guokuan Li , Jiguang Wan , Kai Lu , Jianzong Wang

Large Language Models (LLMs) rely heavily on Key-Value (KV) caching to minimize inference latency. However, standard KV caches are context-dependent: reusing a cached document in a new context requires recomputing KV states to account for…

Machine Learning · Computer Science 2026-04-20 Chuangtao Chen , Grace Li Zhang , Xunzhao Yin , Cheng Zhuo , Bing Li , Ulf Schlichtmann

Cache fusion accelerates generation process of LLMs equipped with RAG through KV caching and selective token recomputation, thereby reducing computational costs and improving efficiency. However, existing methods primarily rely on local…

Databases · Computer Science 2026-04-13 Jianxin Yan , Zeheng Qian , Wangze Ni , Zhitao Shen , Zhiping Wang , Haoyang Li , Jia Zhu , Lei Chen , Kui Ren

KV caches, typically used only to speed up autoregressive decoding, encode contextual information that can be reused for downstream tasks at no extra cost. We propose treating the KV cache as a lightweight representation, eliminating the…

Computation and Language · Computer Science 2026-01-29 Zeyu Xing , Xing Li , Hui-Ling Zhen , Mingxuan Yuan , Sinno Jialin Pan

Vision-Language-Action (VLA) models offer a unified framework for robotic perception and control, but their ability to scale to real-world, long-horizon tasks is limited by the high computational cost of attention and the large memory…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Wanshun Xu , Long Zhuang , Lianlei Shan

KV cache pruning has emerged as a promising technique for reducing memory and computation costs in long-context auto-regressive generation. Existing methods for vision-language models (VLMs) typically rely on self-attention scores from…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Xiaohuan Pei , Tao Huang , Chang Xu

Key-Value (KV) cache plays a crucial role in accelerating inference in large language models (LLMs) by storing intermediate attention states and avoiding redundant computation during autoregressive generation. However, its memory footprint…

Machine Learning · Computer Science 2026-04-14 Yuzhen Mao , Qitong Wang , Martin Ester , Ke Li

Multimodal large language models (MLLMs) are plagued by exorbitant inference costs attributable to the profusion of visual tokens within the vision encoder. The redundant visual tokens engenders a substantial computational load and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Jiedong Zhuang , Lu Lu , Ming Dai , Rui Hu , Jian Chen , Qiang Liu , Haoji Hu

Long-context Multimodal Large Language Models (MLLMs) demand substantial computational resources for inference as the growth of their multimodal Key-Value (KV) cache, in response to increasing input lengths, challenges memory and time…

Computation and Language · Computer Science 2024-06-27 Zhongwei Wan , Ziang Wu , Che Liu , Jinfa Huang , Zhihong Zhu , Peng Jin , Longyue Wang , Li Yuan

Multi-modal Large Language Models (MLLMs) serving systems commonly employ KV-cache compression to reduce memory footprint. However, existing compression methods introduce significant processing overhead and queuing delays, particularly in…

Multimedia · Computer Science 2025-03-12 Jianian Zhu , Hang Wu , Haojie Wang , Yinghui Li , Biao Hou , Ruixuan Li , Jidong Zhai

The key-value (KV) cache is a foundational optimization in Transformer-based large language models (LLMs), eliminating redundant recomputation of past token representations during autoregressive generation. However, its memory footprint…

Machine Learning · Computer Science 2026-03-24 Yichun Xu , Navjot K. Khaira , Tejinder Singh

Vision-language models (VLMs) show remarkable performance in multimodal tasks. However, excessively long multimodal inputs lead to oversized Key-Value (KV) caches, resulting in significant memory consumption and I/O bottlenecks. Previous KV…

Computation and Language · Computer Science 2025-01-28 Zunhai Su , Wang Shen , Linge Li , Zhe Chen , Hanyu Wei , Huangqi Yu , Kehong Yuan