English
Related papers

Related papers: KV Cache Offloading for Context-Intensive Tasks

200 papers

Transformer-based large language models (LLMs) have demonstrated remarkable potential across a wide range of practical applications. However, long-context inference remains a significant challenge due to the substantial memory requirements…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-09 Bo Jiang , Taolue Yang , Youyuan Liu , Xubin He , Sheng Di , Sian Jin

The Key-Value (KV) cache is a crucial component in serving transformer-based autoregressive large language models (LLMs), enabling faster inference by storing previously computed KV vectors. However, its memory consumption scales linearly…

Machine Learning · Computer Science 2024-10-07 Rongzhi Zhang , Kuang Wang , Liyuan Liu , Shuohang Wang , Hao Cheng , Chao Zhang , Yelong Shen

With context windows of millions of tokens, Long-Context Language Models (LCLMs) can encode entire document collections, offering a strong alternative to conventional retrieval-augmented generation (RAG). However, it remains unclear whether…

Computation and Language · Computer Science 2026-01-27 Francesco Maria Molfese , Momchil Hardalov , Rexhina Blloshmi , Bill Byrne , Adrià de Gispert

Autoregressive Transformers rely on Key-Value (KV) caching to accelerate inference. However, the linear growth of the KV cache with context length leads to excessive memory consumption and bandwidth constraints. This bottleneck is…

Computation and Language · Computer Science 2025-06-10 Ravi Ghadia , Avinash Kumar , Gaurav Jain , Prashant Nair , Poulami Das

Transformer-based large language models (LLMs) cache context as key-value (KV) pairs during inference. As context length grows, KV cache sizes expand, leading to substantial memory overhead and increased attention latency. This paper…

Databases · Computer Science 2025-10-01 Jang-Hyun Kim , Jinuk Kim , Sangwoo Kwon , Jae W. Lee , Sangdoo Yun , Hyun Oh Song

With the advancements in long-context inference capabilities of large language models (LLMs), the KV cache has become one of the foundational components. However, its substantial GPU memory consumption makes KV cache compression a key…

Computation and Language · Computer Science 2025-03-28 Youhui Zuo , Sibo Wei , Chen Zhang , Zhuorui Liu , Wenpeng Lu , Dawei Song

The KV cache used in large language models has linearly growing time complexity, so LLMs face memory blow-up and reduced decoding efficiency when they process long contexts. Current KV Cache eviction has become an important research…

Artificial Intelligence · Computer Science 2026-05-26 Wei Luo , Yi Huang , Songchen Ma , Huanyu Qu , Jiang Cai , Mingkun Xu

Long-context Large Language Models (LLMs) face significant memory bottlenecks during inference due to the linear growth of key-value (KV) cache with sequence length. While individual optimization techniques like KV cache quantization,…

Machine Learning · Computer Science 2025-12-02 Sai Gokhale , Devleena Das , Rajeev Patwari , Ashish Sirasao , Elliott Delaye

Key-Value cache (\texttt{KV} \texttt{cache}) compression has emerged as a promising technique to optimize Large Language Model (LLM) serving. It primarily decreases the memory consumption of \texttt{KV} \texttt{cache} to reduce the…

Machine Learning · Computer Science 2025-04-01 Wei Gao , Xinyu Zhou , Peng Sun , Tianwei Zhang , Yonggang Wen

Large Language Models (LLMs) are increasingly deployed in scenarios demanding ultra-long context reasoning, such as agentic workflows and deep research understanding. However, long-context inference is constrained by the KV cache, a…

Hardware Architecture · Computer Science 2026-03-11 Jianlong Lei , Shashikant Ilager

Key-Value (KV) cache plays a crucial role in accelerating inference in large language models (LLMs) by storing intermediate attention states and avoiding redundant computation during autoregressive generation. However, its memory footprint…

Machine Learning · Computer Science 2026-04-14 Yuzhen Mao , Qitong Wang , Martin Ester , Ke Li

Efficient inference with Large Language Models (LLMs) increasingly relies on Key-Value (KV) caches to store previously computed key and value vectors at each layer. These caches are essential to minimize redundant computation during…

Hardware Architecture · Computer Science 2026-04-08 Oteo Mamo , Olga Kogiou , Hyunjin Yi , Weikuan Yu

Large Language Models (LLMs) have revolutionized a wide range of domains such as natural language processing, computer vision, and multi-modal tasks due to their ability to comprehend context and perform logical reasoning. However, the…

Artificial Intelligence · Computer Science 2025-07-31 Haoyang Li , Yiming Li , Anxin Tian , Tianhao Tang , Zhanchao Xu , Xuejia Chen , Nicole Hu , Wei Dong , Qing Li , Lei Chen

We describe KVLink, an approach for efficient key-value (KV) cache reuse in large language models (LLMs). In many LLM applications, different inputs can share overlapping context, such as the same retrieved document appearing in multiple…

Computation and Language · Computer Science 2025-11-11 Jingbo Yang , Bairu Hou , Wei Wei , Yujia Bao , Shiyu Chang

With the widespread deployment of long-context large language models (LLMs), there has been a growing demand for efficient support of high-throughput inference. However, as the key-value (KV) cache expands with the sequence length, the…

Machine Learning · Computer Science 2025-04-29 Hanshi Sun , Li-Wen Chang , Wenlei Bao , Size Zheng , Ningxin Zheng , Xin Liu , Harry Dong , Yuejie Chi , Beidi Chen

Long-context LLMs have enabled numerous downstream applications but also introduced significant challenges related to computational and memory efficiency. To address these challenges, optimizations for long-context inference have been…

Computation and Language · Computer Science 2025-03-12 Yucheng Li , Huiqiang Jiang , Qianhui Wu , Xufang Luo , Surin Ahn , Chengruidong Zhang , Amir H. Abdi , Dongsheng Li , Jianfeng Gao , Yuqing Yang , Lili Qiu

Language models (LMs) underpin emerging mobile and embedded AI applications like meeting and video summarization and document analysis, which often require processing multiple long-context inputs. Running an LM locally on-device improves…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-15 Huawei Zhang , Chunwei Xia , Zheng Wang

Long-context reasoning is a critical capability of large language models (LLMs), enabling applications such as long-document understanding, summarization, and code generation. However, efficient autoregressive inference relies on the…

Computation and Language · Computer Science 2026-04-28 Zahra Dehghanighobadi , Asja Fischer

As the demand for long-context large language models (LLMs) increases, models with context windows of up to 128K or 1M tokens are becoming increasingly prevalent. However, long-context LLM inference is challenging since the inference speed…

Computation and Language · Computer Science 2024-08-28 Jiaming Tang , Yilong Zhao , Kan Zhu , Guangxuan Xiao , Baris Kasikci , Song Han

Efficient long-context inference is critical as large language models (LLMs) adopt context windows of ranging from 128K to 1M tokens. However, the growing key-value (KV) cache and the high computational complexity of attention create…

Computation and Language · Computer Science 2025-03-13 Guangtao Wang , Shubhangi Upasani , Chen Wu , Darshan Gandhi , Jonathan Li , Changran Hu , Bo Li , Urmish Thakker