English
Related papers

Related papers: Dual-Signal Adaptive KV-Cache Optimization for Lon…

200 papers

This paper introduces VideoScan, an efficient vision-language model (VLM) inference framework designed for real-time video interaction that effectively comprehends and retains streamed video inputs while delivering rapid and accurate…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Ruanjun Li , Yuedong Tan , Yuanming Shi , Jiawei Shao

Multimodal large language models (MLLMs) have made significant progress in visual-language reasoning, but their ability to efficiently handle long videos remains limited. Despite recent advances in long-context MLLMs, storing and attending…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Yanlai Yang , Zhuokai Zhao , Satya Narayan Shukla , Aashu Singh , Shlok Kumar Mishra , Lizhu Zhang , Mengye Ren

Recent advancements in Large Language Models (LLMs) have spurred interest in numerous applications requiring robust long-range capabilities, essential for processing extensive input contexts and continuously generating extended outputs. As…

Machine Learning · Computer Science 2025-07-22 Dachuan Shi , Yonggan Fu , Xiangchi Yuan , Zhongzhi Yu , Haoran You , Sixu Li , Xin Dong , Jan Kautz , Pavlo Molchanov , Yingyan , Lin

Large Language Models (LLMs) are increasingly deployed in long-context tasks such as reasoning, code generation, and multi-turn dialogue. However, inference over extended contexts is bottlenecked by the Key-Value (KV) cache, whose memory…

Computation and Language · Computer Science 2026-05-21 Seonghwan Choi , Beomseok Kang , Dongwon Jo , Jae-Joon Kim

Long-rollout causal video diffusion has converged on a fixed-size sliding-window KV cache, with recent progress innovating within this layout by changing which tokens occupy the window or how their positions are encoded. The per-head KV…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Hidir Yesiltepe , Jiazhen Hu , Tuna Han Salih Meral , Adil Kaan Akan , Kaan Oktay , Hoda Eldardiry , Pinar Yanardag

KV cache pruning has emerged as a promising technique for reducing memory and computation costs in long-context auto-regressive generation. Existing methods for vision-language models (VLMs) typically rely on self-attention scores from…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Xiaohuan Pei , Tao Huang , Chang Xu

Large Vision-Language Models (VLMs) have emerged as powerful engines for autonomous GUI agents, yet their deployment is severely constrained by the substantial memory footprint and latency of the Key-Value (KV) cache during long-horizon…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Bowen Zhou , Zhou Xu , Wanli Li , Jingyu Xiao , Haoqian Wang

Huge memory consumption has been a major bottleneck for deploying high-throughput large language models in real-world applications. In addition to the large number of parameters, the key-value (KV) cache for the attention mechanism in the…

Computation and Language · Computer Science 2024-06-05 Haoyi Wu , Kewei Tu

Large Vision-Language Models (VLMs) have achieved remarkable success in multi-modal reasoning, but their inference time efficiency remains a significant challenge due to the memory overhead during decoding, especially when the query and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Fatih Ilhan , Gaowen Liu , Ramana Rao Kompella , Selim Furkan Tekin , Tiansheng Huang , Zachary Yahn , Yichang Xu , Ling Liu

How to efficiently serve LLMs in practice has become exceptionally challenging due to their prohibitive memory and computation requirements. In this study, we investigate optimizing the KV cache, whose memory footprint poses a critical…

Computation and Language · Computer Science 2025-06-10 Akshat Sharma , Hangliang Ding , Jianping Li , Neel Dani , Minjia Zhang

The integration of visual information into Large Language Models (LLMs) has enabled Multimodal LLMs (MLLMs), but the quadratic memory and computational costs of Transformer architectures remain a bottleneck. Existing KV cache eviction…

Machine Learning · Computer Science 2026-02-03 Xindian Ma , Yidi Lu , Peng Zhang , Jing Zhang

Large Language Models capable of handling extended contexts are in high demand, yet their inference remains challenging due to substantial Key-Value cache size and high memory bandwidth requirements. Previous research has demonstrated that…

Machine Learning · Computer Science 2025-10-29 Junlin Mu , Hantao Huang , Jihang Zhang , Minghui Yu , Tao Wang , Yidong Li

For the efficient inference of Large Language Models (LLMs), the effective compression of key-value (KV) cache is essential. Three main types of KV cache compression techniques, namely sparsity, channel compression, and quantization, have…

Machine Learning · Computer Science 2025-02-24 Hong Yankun , Li Xing , Zhen Hui-Ling , Yu Xianzhi , Liu Wulong , Yuan Mingxuan

Multi-modal large language models (MLLMs) models have made significant progress in video understanding over the past few years. However, processing long video inputs remains a major challenge due to high memory and computational costs. This…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Minghao Qin , Xiangrui Liu , Zhengyang Liang , Yan Shu , Huaying Yuan , Juenjie Zhou , Shitao Xiao , Bo Zhao , Zheng Liu

Efficiently serving large language models (LLMs) requires batching of many requests to reduce the cost per request. Yet, with larger batch sizes and longer context lengths, the key-value (KV) cache, which stores attention keys and values to…

Computation and Language · Computer Science 2024-07-26 Zirui Liu , Jiayi Yuan , Hongye Jin , Shaochen Zhong , Zhaozhuo Xu , Vladimir Braverman , Beidi Chen , Xia Hu

Withtherapid advancement of large language models (LLMs), the context length for inference has been continuously increasing, leading to an exponential growth in the demand for Key-Value (KV) caching. This has resulted in a significant…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-11 Yanyu Liu , Jingying Fu , Sixiang Liu , Yitian Zou , You Fu , Jiehan Zhou , Shouhua Zhang

With recent advancements in video backbone architectures, combined with the remarkable achievements of large language models (LLMs), the analysis of long-form videos spanning tens of minutes has become both feasible and increasingly…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Yuxiao Chen , Jue Wang , Zhikang Zhang , Jingru Yi , Xu Zhang , Yang Zou , Zhaowei Cai , Jianbo Yuan , Xinyu Li , Hao Yang , Davide Modolo

Multimodal large language models (MLLMs) have recently demonstrated strong capabilities in understanding and generating responses from diverse visual inputs, including high-resolution images and long video sequences. As these models scale…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Junwan Kim , Hyunkyung Bae

Large Language Models (LLMs) have achieved remarkable progress across reasoning, generation, and decision-making tasks, yet deploying them on mobile, embedded, and edge devices remains particularly challenging. On-device LLM inference is…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Sayed Pedram Haeri Boroujeni , Niloufar Mehrabi , Patrick Woods , Gabriel Hillesheim , Abolfazl Razi

Large Language Models (LLMs) are increasingly deployed in scenarios demanding ultra-long context reasoning, such as agentic workflows and deep research understanding. However, long-context inference is constrained by the KV cache, a…

Hardware Architecture · Computer Science 2026-03-11 Jianlong Lei , Shashikant Ilager