English
Related papers

Related papers: SplitZip: Ultra Fast Lossless KV Compression for D…

200 papers

Large Language Models (LLMs) are increasingly used in applications requiring long context lengths, but the key-value (KV) cache often becomes a memory bottleneck on GPUs as context grows. To address this, we propose Commutative Vector…

KV cache has traditionally been stored in GPU memory to accelerate the decoding phase of large language model (LLM) inference. However, it is increasingly necessary to move KV caches outside GPU devices, to enable cache reuse across…

Machine Learning · Computer Science 2025-12-08 Yuhan Liu , Yihua Cheng , Jiayi Yao , Yuwei An , Xiaokun Chen , Shaoting Feng , Yuyang Huang , Samuel Shen , Rui Zhang , Kuntai Du , Junchen Jiang

Large Language Models (LLMs) are increasingly being deployed on edge devices for long-context settings, creating a growing need for fast and efficient long-context inference. In these scenarios, the Key-Value (KV) cache is the primary…

The development of large language models (LLMs) has significantly expanded model sizes, resulting in substantial GPU memory requirements during inference. The key and value storage of the attention map in the KV (key-value) cache accounts…

Machine Learning · Computer Science 2024-10-25 Yifei Yang , Zouying Cao , Qiguang Chen , Libo Qin , Dongjie Yang , Hai Zhao , Zhi Chen

Modern LLM serving systems must sustain high throughput while meeting strict latency SLOs across two distinct inference phases: compute-intensive prefill and memory-bound decode phases. Existing approaches either (1) aggregate both phases…

Machine Learning · Computer Science 2025-11-10 Lei Gao , Chaoyi Jiang , Hossein Entezari Zarch , Daniel Wong , Murali Annavaram

Serving Large Language Models (LLMs) in production faces significant challenges from highly variable request patterns and severe resource fragmentation in serverless clusters. Current systems rely on static pipeline configurations that…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-12 Yanying Lin , Shijie Peng , Chengzhi Lu , Chengzhong Xu , Kejiang Ye

The massive volume of data generated by LiDAR sensors in autonomous vehicles creates a bottleneck for real-time processing and vehicle-to-everything (V2X) transmission. Existing lossless compression methods often force a trade-off: industry…

Robotics · Computer Science 2026-03-25 Aditya Shibu , Kayvan Karim , Claudio Zito

Federated fine-tuning of on-device large language models (LLMs) mitigates privacy concerns by preventing raw data sharing. However, the intensive computational and memory demands pose significant challenges for resource-constrained edge…

Networking and Internet Architecture · Computer Science 2026-02-13 Tao Li , Yulin Tang , Yiyang Song , Cong Wu , Xihui Liu , Pan Li , Xianhao Chen

Transformer-based large language models (LLMs) have achieved remarkable success as model sizes continue to grow, yet their deployment remains challenging due to significant computational and memory demands. Quantization has emerged as a…

Machine Learning · Computer Science 2024-11-26 Yu Zhang , Mingzi Wang , Lancheng Zou , Wulong Liu , Hui-Ling Zhen , Mingxuan Yuan , Bei Yu

Key-Value (KV) cache has become a de facto component of modern Large Vision-Language Models (LVLMs) for inference. While it enhances decoding efficiency in Large Language Models (LLMs), its direct adoption in LVLMs introduces substantial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Xihao Chen , Yangyang Guo , Roger Zimmermann

Large language models (LLMs) can now handle longer sequences of tokens, enabling complex tasks like book understanding and generating lengthy novels. However, the key-value (KV) cache required for LLMs consumes substantial memory as context…

Machine Learning · Computer Science 2024-11-13 Haojie Duanmu , Zhihang Yuan , Xiuhong Li , Jiangfei Duan , Xingcheng Zhang , Dahua Lin

With the widespread deployment of long-context large language models (LLMs), there has been a growing demand for efficient support of high-throughput inference. However, as the key-value (KV) cache expands with the sequence length, the…

Machine Learning · Computer Science 2025-04-29 Hanshi Sun , Li-Wen Chang , Wenlei Bao , Size Zheng , Ningxin Zheng , Xin Liu , Harry Dong , Yuejie Chi , Beidi Chen

Monolithic serving with chunked prefill improves GPU utilization by batching prefill and decode together, but suffers from fine-grained phase interference. Engine-level prefill-decode (PD) disaggregation avoids interference but incurs…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-08 Xiaoxiang Shi , Colin Cai , Junjia Du , Zhihao Jia

Large language models (LLMs) rely on Key-Value (KV) cache to reduce time-to-first-token (TTFT) latency, but existing disk-based KV cache systems using file-per-object layouts suffer from severe scalability bottlenecks due to file system…

Databases · Computer Science 2025-11-26 Weiping Yu , Ye Jiarui , He Mengke , Junfeng Liu , Siqiang Luo

Collective communication is a major bottleneck for multi-node GPU workloads in scientific computing and distributed deep learning, especially when inter-node bandwidth is limited. Although NCCL provides optimized GPU-centric collectives,…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-13 Jiamin Wang , Zhijing Ye , Xiaodong Yu

Large language model (LLM) applications often reuse previously processed context, such as chat history and documents, which introduces significant redundant computation. Existing LLM serving systems address such redundant computation by…

Inference for Large Language Models (LLMs) is computationally demanding. To reduce the cost of auto-regressive decoding, Key-Value (KV) cache is used to store intermediate activations, which significantly lowers the computational overhead…

Machine Learning · Computer Science 2025-06-05 Chaoyi Jiang , Lei Gao , Hossein Entezari Zarch , Murali Annavaram

Key-Value (KV) cache remains a major bottleneck for deploying Large Language Models (LLMs) in long-generation tasks. Prior work often applies uniform compression across both prefill and decoding caches, but compressing the prefill cache…

Artificial Intelligence · Computer Science 2026-05-29 Soumyadeep Jana , Sagar Nishad , Sanasam Ranbir Singh

Vision-Language Large Models (VLLMs) face significant efficiency challenges when processing high-resolution inputs. The quadratic complexity in attention and autoregressive generation, as well as the constantly growing key value (KV) cache…

Multimedia · Computer Science 2025-10-31 Zhonghua Jiang , Kunxi Li , Yiyun Zhou , Sihao Liu , Zhaode Wang , Chengfei lv , Shengyu Zhang

Diffusion-based large language models (Diffusion LLMs) have shown promise for non-autoregressive text generation with parallel decoding capabilities. However, the practical inference speed of open-sourced Diffusion LLMs often lags behind…

Computation and Language · Computer Science 2025-07-04 Chengyue Wu , Hao Zhang , Shuchen Xue , Zhijian Liu , Shizhe Diao , Ligeng Zhu , Ping Luo , Song Han , Enze Xie