English
Related papers

Related papers: Residual-Mass Accounting for Partial-KV Decoding

200 papers

Key-Value (KV) cache facilitates efficient large language models (LLMs) inference by avoiding recomputation of past KVs. As the batch size and context length increase, the oversized KV caches become a significant memory bottleneck,…

Machine Learning · Computer Science 2025-02-04 Zunhai Su , Zhe Chen , Wang Shen , Hanyu Wei , Linge Li , Huangqi Yu , Kehong Yuan

Efficient long-sequence generation is a critical challenge for Large Language Models. While recent sparse decoding methods improve efficiency, they suffer from KV cache misalignment, where approximation errors accumulate and degrade…

Computation and Language · Computer Science 2025-06-06 Yutao Sun , Tianzhu Ye , Li Dong , Yuqing Xia , Jian Chen , Yizhao Gao , Shijie Cao , Jianyong Wang , Furu Wei

We study the rate-distortion limits of online KV cache compression in autoregressive language models, formulating it as sequential Wyner-Ziv source coding on the filtration induced by the model, with the next-step query as decoder side…

Information Theory · Computer Science 2026-05-26 Munsik Kim

Transformer-based Large Language Models rely critically on the KV cache to efficiently handle extended contexts during the decode phase. Yet, the size of the KV cache grows proportionally with the input length, burdening both memory…

Computation and Language · Computer Science 2025-08-14 Payman Behnam , Yaosheng Fu , Ritchie Zhao , Po-An Tsai , Zhiding Yu , Alexey Tumanov

Transformer-based large language models (LLMs) demonstrate impressive potential in various practical applications. However, long context inference poses a significant challenge due to the enormous memory requirements of the key-value (KV)…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-03 Bo Jiang , Taolue Yang , Youyuan Liu , Chengming Zhang , Xubin He , Sian Jin

Efficient key-value (KV) cache compression is critical for scaling transformer-based Large Language Models (LLMs) in long sequences and resource-limited settings. Existing methods evict tokens based on their positions or importance scores,…

Computation and Language · Computer Science 2025-05-19 Ziwei He , Jian Yuan , Haoli Bai , Jingwen Leng , Bo Jiang

Reasoning large language models exhibit complex reasoning behaviors via extended chain-of-thought generation that are highly fragile to information loss during decoding, creating critical challenges for KV cache compression. Existing…

Computation and Language · Computer Science 2026-05-28 Wenjie Du , Li Jiang , Keda Tao , Xue Liu , Huan Wang

The sum-rank metric generalizes the Hamming and rank metric by partitioning vectors into blocks and defining the total weight as the sum of the rank weights of these blocks, based on their matrix representation. In this work, we explore…

Information Theory · Computer Science 2024-10-22 Thomas Jerkovits , Hannes Bartz , Antonia Wachter-Zeh

DeepSeek-OCR leverages visual-text compression to reduce long-text processing costs and accelerate inference, yet visual tokens remain prone to redundant textual and structural information. Moreover, current token pruning methods for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Ben Wan , Yan Feng , Zihan Tang , Weizhe Huang , Yuting Zeng , Jia Wang , Tongxuan Liu

Large Language Models (LLMs) have achieved remarkable progress across reasoning, generation, and decision-making tasks, yet deploying them on mobile, embedded, and edge devices remains particularly challenging. On-device LLM inference is…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Sayed Pedram Haeri Boroujeni , Niloufar Mehrabi , Patrick Woods , Gabriel Hillesheim , Abolfazl Razi

Large Language Models (LLMs) are increasingly deployed in scenarios demanding ultra-long context reasoning, such as agentic workflows and deep research understanding. However, long-context inference is constrained by the KV cache, a…

Hardware Architecture · Computer Science 2026-03-11 Jianlong Lei , Shashikant Ilager

The prefill stage of long-context Retrieval-Augmented Generation (RAG) is severely bottlenecked by computational overhead. To mitigate this, recent methods assemble pre-calculated KV caches of retrieved RAG documents (by a user query) and…

Operating Systems · Computer Science 2026-02-06 Shihao Wang , Jiahao Chen , Yanqi Pan , Hao Huang , Yichen Hao , Xiangyu Zou , Wen Xia , Wentao Zhang , Chongyang Qiu , Pengfei Wang

Large Language Models (LLMs) have revolutionized the field of natural language processing, achieving unprecedented performance across a variety of applications. However, their increased computational and memory demands present significant…

Computation and Language · Computer Science 2025-02-28 Yuhui Xu , Zhanming Jie , Hanze Dong , Lei Wang , Xudong Lu , Aojun Zhou , Amrita Saha , Caiming Xiong , Doyen Sahoo

Conventional reward modeling relies on gradient descent over neural weights, creating opaque, data-hungry "black boxes." We propose a paradigm shift from implicit to explicit reward parameterization, recasting optimization from continuous…

Machine Learning · Computer Science 2026-02-06 Lipeng Xie , Sen Huang , Zhuo Zhang , Anni Zou , Yunpeng Zhai , Dingchao Ren , Kezun Zhang , Haoyuan Hu , Boyin Liu , Haoran Chen , Zhaoyang Liu , Bolin Ding

Modern large language models (LLMs) drive interactive AI systems but are bottlenecked by the memory-heavy growth of key-value (KV) caches, which limits real-time throughput under concurrent loads. Existing KV-cache compression methods rely…

Machine Learning · Computer Science 2026-01-07 Joseph Kampeas , Emir Haleva

We address the problem of learning an unknown smooth function and its derivatives from noisy pointwise evaluations under the supremum norm. While classical nonparametric regression provides a strong theoretical foundation, traditional…

Machine Learning · Computer Science 2026-03-10 Davide Maran , Marcello Restelli

In the realm of recommender systems (RS), Top-$K$ ranking metrics such as NDCG@$K$ are the gold standard for evaluating recommendation performance. However, during the training of recommendation models, optimizing NDCG@$K$ poses significant…

Information Retrieval · Computer Science 2025-08-11 Weiqin Yang , Jiawei Chen , Shengjia Zhang , Peng Wu , Yuegang Sun , Yan Feng , Chun Chen , Can Wang

Large Language Models (LLMs) excel across a variety of language tasks yet are constrained by limited input lengths and high computational costs. Existing approaches\textemdash such as relative positional encodings (e.g., RoPE, ALiBi) and…

Computation and Language · Computer Science 2025-02-18 Kun-Hui Lee , Eunhwan Park , Donghoon Han , Seung-Hoon Na

Key-value (KV) caching has emerged as a crucial optimization technique for accelerating inference in large language models (LLMs). By allowing the attention operation to scale linearly rather than quadratically with the total sequence…

Computation and Language · Computer Science 2026-01-06 Gopi Krishna Jha , Sameh Gobriel , Liubov Talamanova , Nilesh Jain

The Key-Value (KV) cache is integral to efficient autoregressive inference in large language models (LLMs), yet its unbounded growth in stateful multi-turn scenarios presents major challenges. This paper examines the interplay between KV…

Machine Learning · Computer Science 2025-11-10 Pratik Poudel