English
Related papers

Related papers: vTensor: Flexible Virtual Tensor Management for Ef…

200 papers

Large Language Models (LLMs) are wildly popular today and it is important to serve them efficiently. Existing LLM serving systems are stateless across requests. Consequently, when LLMs are used in the common setting of multi-turn…

Machine Learning · Computer Science 2024-10-08 Lingfan Yu , Jinkun Lin , Jinyang Li

Large language models (LLMs) are typically served from clusters of GPUs/NPUs that consist of large number of devices. Unfortunately, communication between these devices incurs significant overhead, increasing the inference latency and cost…

Artificial Intelligence · Computer Science 2025-05-27 Ahmet Caner Yüzügüler , Jiawei Zhuang , Lukas Cavigelli

Streaming video large language models (LLMs) are increasingly used for real-time multimodal tasks such as video captioning, question answering, conversational agents, and augmented reality. However, these models face fundamental memory and…

Image and Video Processing · Electrical Eng. & Systems 2025-12-25 Donghyuk Kim , Sejeong Yang , Wonjin Shin , Joo-Young Kim

Transformer-based Large Language Models (LLMs) have made a significant impact on various domains. However, LLMs' efficiency suffers from both heavy computation and memory overheads. Compression techniques like sparsification and…

Context lengths of Large Language Models (LLMs) have exploded in recent years, with 128k-token context becoming a standard and million-token context becoming a reality. Efficiently supporting long-context inference remains challenging as…

Computation and Language · Computer Science 2024-10-08 Isaac Rehg

Training large language models (LLMs) in the cloud faces growing memory bottlenecks due to the limited capacity and high cost of GPUs. While GPU memory offloading to CPU and NVMe has made large-scale training more feasible, existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-19 Sabiha Afroz , Redwan Ibne Seraj Khan , Hadeel Albahar , Jingoo Han , Ali R. Butt

Large language models (LLMs) have been widely applied but face challenges in efficient inference. While quantization methods reduce computational demands, ultra-low bit quantization with arbitrary precision is hindered by limited GPU Tensor…

Machine Learning · Computer Science 2025-03-14 Shaobo Ma , Chao Fang , Haikuo Shao , Zhongfeng Wang

Large Language Models (LLMs), despite their remarkable performance across a wide range of tasks, necessitate substantial GPU memory and consume significant computational resources. Beyond the memory taken up by model weights, the memory…

Computation and Language · Computer Science 2024-06-24 Jincheng Dai , Zhuowei Huang , Haiyun Jiang , Chen Chen , Deng Cai , Wei Bi , Shuming Shi

Large Language Model (LLM) inference is increasingly constrained by memory bandwidth, with frequent access to the key-value (KV) cache dominating data movement. While attention sparsity reduces some memory traffic, the relevance of past…

Hardware Architecture · Computer Science 2025-09-16 Yunhua Fang , Rui Xie , Asad Ul Haq , Linsen Ma , Kaoutar El Maghraoui , Naigang Wang , Meng Wang , Liu Liu , Tong Zhang

How to efficiently serve Large Language Models (LLMs) has become a pressing issue because of their huge computational cost in their autoregressive generation process. To mitigate computational costs, LLMs often employ the KV Cache technique…

Computation and Language · Computer Science 2024-07-23 Zheng Wang , Boxiao Jin , Zhongzhi Yu , Minjia Zhang

Large language models (LLMs) have shown remarkable potential in processing long sequences and complex reasoning tasks, yet efficiently serving these models remains challenging due to the quadratic computational complexity of attention in…

Computation and Language · Computer Science 2025-04-22 Shang Yang , Junxian Guo , Haotian Tang , Qinghao Hu , Guangxuan Xiao , Jiaming Tang , Yujun Lin , Zhijian Liu , Yao Lu , Song Han

Serving large language models (LLMs) efficiently remains challenging due to the high memory and latency overhead of key-value (KV) cache access during autoregressive decoding. We present \textbf{TinyServe}, a lightweight and extensible…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-17 Dong Liu , Yanxuan Yu

Multi-modal Large Language Models (MLLMs) serving systems commonly employ KV-cache compression to reduce memory footprint. However, existing compression methods introduce significant processing overhead and queuing delays, particularly in…

Multimedia · Computer Science 2025-03-12 Jianian Zhu , Hang Wu , Haojie Wang , Yinghui Li , Biao Hou , Ruixuan Li , Jidong Zhai

Transformer based Large Language Models (LLMs) have been widely used in many fields, and the efficiency of LLM inference becomes hot topic in real applications. However, LLMs are usually complicatedly designed in model structure with…

Hardware Architecture · Computer Science 2024-06-25 Hui Wu , Yi Gan , Feng Yuan , Jing Ma , Wei Zhu , Yutao Xu , Hong Zhu , Yuhua Zhu , Xiaoli Liu , Jinghui Gu , Peng Zhao

Modern large language models (LLMs) drive interactive AI systems but are bottlenecked by the memory-heavy growth of key-value (KV) caches, which limits real-time throughput under concurrent loads. Existing KV-cache compression methods rely…

Machine Learning · Computer Science 2026-01-07 Joseph Kampeas , Emir Haleva

Modern foundation models such as large language models (LLMs) and large multi-modal models (LMMs) require a massive amount of computational and memory resources. We propose a new framework to convert such LLMs/LMMs into a reduced-dimension…

Machine Learning · Computer Science 2025-05-27 Toshiaki Koike-Akino , Xiangyu Chen , Jing Liu , Ye Wang , Pu , Wang , Matthew Brand

The Key-Value (KV) cache introduces substantial memory overhead during large language model (LLM) inference. Although existing vector quantization (VQ) methods reduce KV cache usage and provide flexible representational capacity across…

Computation and Language · Computer Science 2025-10-08 Dingyu Yao , Chenxu Yang , Zhengyang Tong , Zheng Lin , Wei Liu , Jian Luan , Weiping Wang

Transformer-based large language models (LLMs) demonstrate impressive performance in long context generation. Extending the context length has disproportionately shifted the memory footprint of LLMs during inference to the key-value cache…

Machine Learning · Computer Science 2025-02-19 Cheng Luo , Zefan Cai , Hanshi Sun , Jinqi Xiao , Bo Yuan , Wen Xiao , Junjie Hu , Jiawei Zhao , Beidi Chen , Anima Anandkumar

Large Language Models (LLMs) are increasingly expected to operate over long contexts, yet standard softmax attention incurs a KV cache that grows linearly with sequence length, quickly becoming the bottleneck for long context inference. A…

Computation and Language · Computer Science 2026-05-26 Xintong Yang , Hao Gu , Binxing Xu , Lujun Li , Bei Liu , Jiacheng Liu , Qiyuan Zhu , Sirui Han , Yike Guo

Transformer-based large language models (LLMs) have demonstrated remarkable potential across a wide range of practical applications. However, long-context inference remains a significant challenge due to the substantial memory requirements…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-09 Bo Jiang , Taolue Yang , Youyuan Liu , Xubin He , Sheng Di , Sian Jin