English
Related papers

Related papers: Accurate KV Cache Quantization with Outlier Tokens…

200 papers

Large language models (LLMs) can now handle longer sequences of tokens, enabling complex tasks like book understanding and generating lengthy novels. However, the key-value (KV) cache required for LLMs consumes substantial memory as context…

Machine Learning · Computer Science 2024-11-13 Haojie Duanmu , Zhihang Yuan , Xiuhong Li , Jiangfei Duan , Xingcheng Zhang , Dahua Lin

Large Language Models (LLMs) require substantial computational resources during generation. While the Key-Value (KV) cache significantly accelerates this process by storing attention intermediates, its memory footprint grows linearly with…

Computation and Language · Computer Science 2025-08-05 Yi Su , Quantong Qiu , Yuechi Zhou , Juntao Li , Qingrong Xia , Ping Li , Xinyu Duan , Zhefeng Wang , Min Zhang

How to efficiently serve LLMs in practice has become exceptionally challenging due to their prohibitive memory and computation requirements. In this study, we investigate optimizing the KV cache, whose memory footprint poses a critical…

Computation and Language · Computer Science 2025-06-10 Akshat Sharma , Hangliang Ding , Jianping Li , Neel Dani , Minjia Zhang

A critical approach for efficiently deploying computationally demanding large language models (LLMs) is Key-Value (KV) caching. The KV cache stores key-value states of previously generated tokens, significantly reducing the need for…

Computation and Language · Computer Science 2024-09-10 Akide Liu , Jing Liu , Zizheng Pan , Yefei He , Gholamreza Haffari , Bohan Zhuang

Despite the significant success of large language models (LLMs), their extensive memory requirements pose challenges for deploying them in long-context token generation. The substantial memory footprint of LLM decoders arises from the…

Machine Learning · Computer Science 2024-02-12 Amir Zandieh , Insu Han , Vahab Mirrokni , Amin Karbasi

Model quantization has become a crucial technique to address the issues of large memory consumption and long inference times associated with LLMs. Mixed-precision quantization, which distinguishes between important and unimportant…

Machine Learning · Computer Science 2024-10-22 Yifan Tan , Haoze Wang , Chao Yan , Yangdong Deng

Large language models (LLMs) are increasingly utilized for complex tasks requiring longer context lengths, with some models supporting up to 128K or 1M tokens. This trend, however, presents significant challenges in inference speed and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-09 Zongwu Wang , Peng Xu , Fangxin Liu , Yiwei Hu , Qingxiao Sun , Gezi Li , Cheng Li , Xuan Wang , Li Jiang , Haibing Guan

Many computational factors limit broader deployment of large language models. In this paper, we focus on a memory bottleneck imposed by the key-value (KV) cache, a computational shortcut that requires storing previous KV pairs during…

Machine Learning · Computer Science 2024-06-13 Harry Dong , Xinyu Yang , Zhenyu Zhang , Zhangyang Wang , Yuejie Chi , Beidi Chen

Large Language Models (LLMs), despite their remarkable performance across a wide range of tasks, necessitate substantial GPU memory and consume significant computational resources. Beyond the memory taken up by model weights, the memory…

Computation and Language · Computer Science 2024-06-24 Jincheng Dai , Zhuowei Huang , Haiyun Jiang , Chen Chen , Deng Cai , Wei Bi , Shuming Shi

Long-context Large Language Models (LLMs) face significant memory bottlenecks during inference due to the linear growth of key-value (KV) cache with sequence length. While individual optimization techniques like KV cache quantization,…

Machine Learning · Computer Science 2025-12-02 Sai Gokhale , Devleena Das , Rajeev Patwari , Ashish Sirasao , Elliott Delaye

In Large Language Model (LLM) inference, Key-Value (KV) caches (KV-caches) are essential for reducing time complexity. However, they result in a linear increase in GPU memory as the context length grows. While recent work explores KV-cache…

Machine Learning · Computer Science 2025-02-25 Ahmed Burak Gulhan , Krishna Teja Chitty-Venkata , Murali Emani , Mahmut Kandemir , Venkatram Vishwanath

Multimodal Large Language Models (MLLMs) have demonstrated remarkable performance across diverse applications. However, their computational overhead during deployment remains a critical bottleneck. While Key-Value (KV) caching effectively…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Insu Han , Zeliang Zhang , Zhiyuan Wang , Yifan Zhu , Susan Liang , Jiani Liu , Haiting Lin , Mingjie Zhao , Chenliang Xu , Kun Wan , Wentian Zhao

KV caching is a fundamental technique for accelerating Large Language Model (LLM) inference by reusing key-value (KV) pairs from previous queries, but its effectiveness under limited memory is highly sensitive to the eviction policy. The…

Machine Learning · Computer Science 2026-01-28 Fangzhou Wu , Sandeep Silwal , Qiuyi , Zhang

KV cache eviction has emerged as an effective solution to alleviate resource constraints faced by LLMs in long-context scenarios. However, existing token-level eviction methods often overlook two critical aspects: (1) their irreversible…

Machine Learning · Computer Science 2026-01-21 Yi Zhao , Yajuan Peng , Cam-Tu Nguyen , Zuchao Li , Xiaoliang Wang , Hai Zhao , Xiaoming Fu

Efficient real-world deployments of large language models (LLMs) rely on Key-Value (KV) caching for processing and generating long outputs, reducing the need for repetitive computation. For large contexts, Key-Value caches can take up tens…

Large language models (LLMs) demonstrate remarkable capabilities but face substantial serving costs due to their high memory demands, with the key-value (KV) cache being a primary bottleneck. State-of-the-art KV cache compression…

Machine Learning · Computer Science 2025-09-03 Yanqi Zhang , Yuwei Hu , Runyuan Zhao , John C. S. Lui , Haibo Chen

Large language models (LLMs) have shown strong performance across diverse tasks, but their inference with long input contexts is bottlenecked by memory size and bandwidth. The Key-Value (KV) cache size grows linearly with sequence length…

Machine Learning · Computer Science 2026-05-12 Junkai Zhang , Hang Guo , Luca Benini , Yawei Li

The growing context length of Large Language Models (LLMs) enlarges the Key-Value (KV) cache, limiting deployment in resource-limited environments. Prior training-free approaches for KV cache compression typically rely on low-rank…

Computation and Language · Computer Science 2026-03-18 Yixuan Wang , Qingyu Shi , Jiayu Zhou , Dianbo Liu , Ziwei He , Zhouhan Lin

Vision-language models (VLMs) show remarkable performance in multimodal tasks. However, excessively long multimodal inputs lead to oversized Key-Value (KV) caches, resulting in significant memory consumption and I/O bottlenecks. Previous KV…

Computation and Language · Computer Science 2025-01-28 Zunhai Su , Wang Shen , Linge Li , Zhe Chen , Hanyu Wei , Huangqi Yu , Kehong Yuan

The emergence of LLMs has ignited a fresh surge of breakthroughs in NLP applications, particularly in domains such as question-answering systems and text generation. As the need for longer context grows, a significant bottleneck in model…

Computation and Language · Computer Science 2024-04-15 Shichen Dong , Wen Cheng , Jiayu Qin , Wei Wang