English
Related papers

Related papers: StreamKV: Streaming Video Question-Answering with …

200 papers

Large reasoning models (LRMs) often incur significant key-value (KV) cache overhead, due to their linear growth with the verbose chain-of-thought (CoT) reasoning. This incurs both memory overhead and throughput bottlenecks, limiting…

KV cache is a widely used acceleration technique for large language models (LLMs) inference. However, its memory requirement grows rapidly with input length. Previous studies have reduced the size of KV cache by either removing the same…

Computation and Language · Computer Science 2025-01-28 Xingyang He , Jie Liu , Shaowei Chen

Empowered by Large Language Models (LLMs), recent advancements in Video-based LLMs (VideoLLMs) have driven progress in various video understanding tasks. These models encode video representations through pooling or query aggregation over a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yuetian Weng , Mingfei Han , Haoyu He , Xiaojun Chang , Bohan Zhuang

The Key-Value (KV) cache is central to the efficiency of transformer-based large language models (LLMs), storing previously computed vectors to accelerate inference. Yet, as sequence length and batch size grow, the cache becomes a major…

Machine Learning · Computer Science 2025-12-08 Damien Lesens , Beheshteh T. Rakhshan , Guillaume Rabusseau

The explosive growth of videos on streaming media platforms has underscored the urgent need for effective video quality assessment (VQA) algorithms to monitor and perceptually optimize the quality of streaming videos. However, VQA remains…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Qihang Ge , Wei Sun , Yu Zhang , Yunhao Li , Zhongpeng Ji , Fengyu Sun , Shangling Jui , Xiongkuo Min , Guangtao Zhai

Key-Value (KV) Caching has become an essential technique for accelerating the inference speed and throughput of generative Large Language Models~(LLMs). However, the memory footprint of the KV cache poses a critical bottleneck in LLM…

Machine Learning · Computer Science 2024-02-29 June Yong Yang , Byeongwook Kim , Jeongin Bae , Beomseok Kwon , Gunho Park , Eunho Yang , Se Jung Kwon , Dongsoo Lee

Despite the remarkable progress of Large Language Models (LLMs), the escalating memory footprint of the Key-Value (KV) cache remains a critical bottleneck for efficient inference. While dimensionality reduction offers a promising…

Computation and Language · Computer Science 2026-03-06 Liming Lu , Kaixi Qiu , Jiayu Zhou , Jushi Kai , Haoyan Zhang , Huanyu Wang , Jingwen Leng , Ziwei He , Zhouhan Lin

Existing key-value (KV) cache compression methods for large language models (LLMs) often rely on token eviction, which risks losing critical local information in both long prefilling and decoding scenarios. When extrapolating beyond the…

Computation and Language · Computer Science 2026-01-30 Jushi Kai , Yixuan Wang , Boyi Zeng , Haoli Bai , Bo Jiang , Ziwei He , Zhouhan Lin

Current Video Large Language Models (VideoLLMs) suffer from quadratic computational complexity and key-value cache scaling, due to their reliance on processing excessive redundant visual tokens. To address this problem, we propose SharpV, a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Jialong Qin , Xin Zou , Di Lu , Yibo Yan , Xuming Hu

Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse natural language processing tasks. However, their extensive memory requirements, particularly due to KV cache growth during long-text understanding and…

Computation and Language · Computer Science 2025-10-14 Haoqi Yang , Yao Yao , Zuchao Li , Baoyuan Qi , Guoming Liu , Hai Zhao

The large size of the KV cache has become a major bottleneck for serving LLMs with increasing context lengths. In response, many KV cache compression methods, such as token dropping and quantization, have been proposed. However, almost all…

Hardware Architecture · Computer Science 2026-05-19 Jiayi Yao , Samuel Shen , Kuntai Du , Shaoting Feng , Dongjoo Seo , Rui Zhang , Yuyang Huang , Yuhan Liu , Shan Lu , Junchen Jiang

To address the challenges of high computational costs and long-distance dependencies in exist ing video understanding methods, such as CNNs and Transformers, this work introduces RWKV to the video domain in a novel way. We propose a LSTM…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Zhuowen Yin , Chengru Li , Xingbo Dong

Existing key-value (KV) cache compression methods typically rely on heuristics, such as uniform cache allocation across layers or static eviction policies, however, they ignore the critical interplays among layer-specific feature patterns…

Machine Learning · Computer Science 2025-09-11 Bohan Yu , Yekun Chai

Although Key-Value (KV) Cache is essential for efficient large language models (LLMs) inference, its growing memory footprint in long-context scenarios poses a significant bottleneck, making KVCache compression crucial. Current compression…

Machine Learning · Computer Science 2026-02-04 Jiancai Ye , Jun Liu , Qingchen Li , Tianlang Zhao , Hanbin Zhang , Jiayi Pan , Ningyi Xu , Guohao Dai

With context windows of millions of tokens, Long-Context Language Models (LCLMs) can encode entire document collections, offering a strong alternative to conventional retrieval-augmented generation (RAG). However, it remains unclear whether…

Computation and Language · Computer Science 2026-01-27 Francesco Maria Molfese , Momchil Hardalov , Rexhina Blloshmi , Bill Byrne , Adrià de Gispert

Long context capability is a crucial competency for large language models (LLMs) as it mitigates the human struggle to digest long-form texts. This capability enables complex task-solving scenarios such as book summarization, code…

Computation and Language · Computer Science 2024-10-10 Jiayi Yuan , Hongyi Liu , Shaochen Zhong , Yu-Neng Chuang , Songchen Li , Guanchu Wang , Duy Le , Hongye Jin , Vipin Chaudhary , Zhaozhuo Xu , Zirui Liu , Xia Hu

Large Language Models (LLMs) use key-value (KV) cache to reduce redundant computation in autoregressive generation. However, the KV cache size increases linearly during generation, leading to excessive memory usage, especially for long…

Computation and Language · Computer Science 2025-03-04 Jian Yuan , Ziwei He , Haoli Bai , Jingwen Leng , Bo Jiang

Transformer-based large language models (LLMs) rely on key-value (KV) caching to avoid redundant computation during autoregressive inference. While this mechanism greatly improves efficiency, the cache size grows linearly with the input…

Machine Learning · Computer Science 2026-03-12 Jinwoo Ahn , Ingyu Seong , Akhil Kedia , Junhan Kim , Hyemi Jang , Kangwook Lee , Yongkweon Jeon

Long-context inference in large language models (LLMs) is increasingly constrained by the KV cache bottleneck: memory usage grows linearly with sequence length, while attention computation scales quadratically. Existing approaches address…

Computation and Language · Computer Science 2025-11-13 Huanxuan Liao , Yixing Xu , Shizhu He , Guanchen Li , Xuanwu Yin , Dong Li , Emad Barsoum , Jun Zhao , Kang Liu

Online streaming video understanding requires models to process continuous visual inputs and respond to user queries in real time, where the unbounded stream and unpredictable query timing turn memory management into a central challenge.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Hang Wu , Sherin Mary Mathews , Yujun Cai , Ming-Hsuan Yang , Yiwei Wang