English
Related papers

Related papers: How Much Cache Does Reasoning Need? Depth-Cache Tr…

200 papers

Auto-regressive inference of transformers benefit greatly from Key-Value (KV) caching, but can lead to major memory bottlenecks as model size, batch size, and sequence length grow at scale. We introduce Multi-Layer Key-Value (MLKV) sharing,…

Machine Learning · Computer Science 2024-10-16 Zayd Muhammad Kawakibi Zuhri , Muhammad Farid Adilazuarda , Ayu Purwarianti , Alham Fikri Aji

Key-value (KV) caching has emerged as a crucial optimization technique for accelerating inference in large language models (LLMs). By allowing the attention operation to scale linearly rather than quadratically with the total sequence…

Computation and Language · Computer Science 2026-01-06 Gopi Krishna Jha , Sameh Gobriel , Liubov Talamanova , Nilesh Jain

Generative reasoning with large language models (LLMs) often involves long decoding sequences, leading to substantial memory and latency overheads from accumulating key-value (KV) caches. While existing KV compression methods primarily…

Machine Learning · Computer Science 2025-12-16 Hui Zeng , Daming Zhao , Pengfei Yang , WenXuan Hou , Tianyang Zheng , Hui Li , Weiye Ji , Jidong Zhai

The KV cache in self-attention has emerged as a major bottleneck in long-context and large-batch inference for LLMs. Existing approaches often treat sparsity prediction and compression as separate modules, relying on auxiliary index…

Machine Learning · Computer Science 2026-03-17 Xu Yang , Jiapeng Zhang , Dongyang Zhao , Guo Chen , Zhuo Tang

Visual Autoregressive (VAR) modeling has garnered significant attention for its innovative next-scale prediction approach, which yields substantial improvements in efficiency, scalability, and zero-shot generalization. Nevertheless, the…

Machine Learning · Computer Science 2025-05-27 Kunjun Li , Zigeng Chen , Cheng-Yen Yang , Jenq-Neng Hwang

Large Language Models (LLMs) are increasingly deployed in large-scale online services, enabling sophisticated applications. However, the computational overhead of generating key-value (KV) caches in the prefill stage presents a major…

Machine Learning · Computer Science 2025-02-24 Shuowei Jin , Xueshen Liu , Qingzhao Zhang , Z. Morley Mao

Large language models have shown remarkable reasoning abilities and scaling laws suggest that large parameter count, especially along the depth axis, is the primary driver. In this work, we make a stronger claim -- many reasoning problems…

Computation and Language · Computer Science 2025-02-25 Nikunj Saunshi , Nishanth Dikkala , Zhiyuan Li , Sanjiv Kumar , Sashank J. Reddi

Modern Large Language Models (LLMs) are increasingly trained to support very large context windows. We present Compactor, a training-free, query-agnostic KV compression strategy that uses approximate leverage scores to determine token…

Computation and Language · Computer Science 2025-12-10 Vivek Chari , Benjamin Van Durme

Long-context inference in Large Language Models (LLMs) is bottlenecked by the linear growth of Key-Value (KV) cache memory. Existing KV cache compression paradigms are fundamentally limited by heuristics: heuristic budgeting relies on…

Machine Learning · Computer Science 2026-05-11 Enshuai Zhou , Yifan Hao , Chao Wang , Rui Zhang , Di Huang , Jiaming Guo , Xing Hu , Zidong Du , Qi Guo , Yunji Chen

Long-horizon LLM inference turns the key--value (KV) cache into the dominant GPU memory consumer and makes per-token attention increasingly expensive. Many common eviction policies use static recency windows or historical attention, leaving…

Machine Learning · Computer Science 2026-05-26 Yubo Li , Yidi Miao

KV cache compression methods have mainly relied on scalar quantization techniques to reduce the memory requirements during decoding. In this work, we apply residual vector quantization, which has been widely used for high fidelity audio…

Machine Learning · Computer Science 2024-10-22 Ankur Kumar

Long-context language models are limited by the memory footprint of the key-value (KV) cache. Existing training-free KV compression methods usually rank tokens by one importance signal -- attention, recency, layer-wise allocation, or key…

Computation and Language · Computer Science 2026-05-27 Hong Chen , Xiang Liu , Yubo Gao , Yuxuan Fan , Bo Wang , Yuanlin Chu , Yuanguo Lin , Xuming Hu

Transformers process tokens in parallel but are temporally shallow: at position $t$, each layer attends to key-value pairs computed based on the previous layer, yielding a depth capped by the number of layers. Recurrent models offer…

Machine Learning · Computer Science 2026-04-24 Costin-Andrei Oncescu , Depen Morwani , Samy Jelassi , Alexandru Meterez , Mujin Kwun , Sham Kakade

As the field of Large Language Models (LLMs) continues to evolve, the context length in inference is steadily growing. Key-Value Cache (KVCache), the intermediate representations of tokens within LLM inference, has now become the primary…

Computation and Language · Computer Science 2025-04-01 Hailin Zhang , Xiaodong Ji , Yilin Chen , Fangcheng Fu , Xupeng Miao , Xiaonan Nie , Weipeng Chen , Bin Cui

Large language models (LLMs) demonstrate remarkable capabilities but face substantial serving costs due to their high memory demands, with the key-value (KV) cache being a primary bottleneck. State-of-the-art KV cache compression…

Machine Learning · Computer Science 2025-09-03 Yanqi Zhang , Yuwei Hu , Runyuan Zhao , John C. S. Lui , Haibo Chen

Transformer-based large language models (LLMs) have already achieved remarkable results on long-text tasks, but the limited GPU memory (VRAM) resources struggle to accommodate the linearly growing demand for key-value (KV) cache as the…

Computation and Language · Computer Science 2025-03-21 Shibo Jie , Yehui Tang , Kai Han , Zhi-Hong Deng , Jing Han

Recent large vision-language models (LVLMs) demonstrate remarkable capabilities in processing extended multi-modal sequences, yet the resulting key-value (KV) cache expansion creates a critical memory bottleneck that fundamentally limits…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Xuyang Liu , Xiyan Gui , Yuchao Zhang , Linfeng Zhang

Large language models (LLMs) have shown great performance on complex reasoning tasks but often require generating long intermediate thoughts before reaching a final answer. During generation, LLMs rely on a key-value (KV) cache for…

Large language models (LLMs) are typically served from clusters of GPUs/NPUs that consist of large number of devices. Unfortunately, communication between these devices incurs significant overhead, increasing the inference latency and cost…

Artificial Intelligence · Computer Science 2025-05-27 Ahmet Caner Yüzügüler , Jiawei Zhuang , Lukas Cavigelli

Autoregressive (AR) visual generation has achieved remarkable performance but suffers from high memory usage and low throughput, as it requires caching previously generated visual tokens. Recent research has shown that retaining only a few…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Guotao Liang , Baoquan Zhang , Zhiyuan Wen , Yunming Ye