English
Related papers

Related papers: Hardware-Efficient Attention for Fast Decoding

200 papers

Vision Transformers (ViTs) have been shown to enhance visual recognition through modeling long-range dependencies with multi-head self-attention (MHSA), which is typically formulated as Query-Key-Value computation. However, the attention…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Chongjian Ge , Xiaohan Ding , Zhan Tong , Li Yuan , Jiangliu Wang , Yibing Song , Ping Luo

Mixture of Block Attention (MoBA) (Lu et al., 2025) is a promising building block for efficiently processing long contexts in LLMs by enabling queries to sparsely attend to a small subset of key-value blocks, drastically reducing…

Machine Learning · Computer Science 2025-12-22 Guangxuan Xiao , Junxian Guo , Kasra Mazaheri , Song Han

Recently the generative Large Language Model (LLM) has achieved remarkable success in numerous applications. Notably its inference generates output tokens one-by-one, leading to many redundant computations. The widely-used KV-Cache…

Machine Learning · Computer Science 2024-12-10 Weizhuo Li , Zhigang Wang , Yu Gu , Ge Yu

Transformer-based large language models (LLMs) have achieved remarkable success, yet their standard attention mechanism incurs quadratic computation and memory costs with respect to sequence length, posing a major bottleneck for…

Machine Learning · Computer Science 2025-10-22 Tao Bu , Qiangang Wang , Bowen Zeng , Hanwen Sun , Yunpeng Huang , Chun Cao , Jingwei Xu

Balancing accuracy and latency on high-resolution images is a critical challenge for lightweight models, particularly for Transformer-based architectures that often suffer from excessive latency. To address this issue, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Junzhou Li , Manqi Zhao , Yilin Gao , Zhiheng Yu , Yin Li , Dongsheng Jiang , Li Xiao

Attention mechanisms have significantly advanced visual models by capturing global context effectively. However, their reliance on large-scale datasets and substantial computational resources poses challenges in data-scarce and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Chenghao Li , Chaoning Zhang , Boheng Zeng , Yi Lu , Pengbo Shi , Qingzi Chen , Jirui Liu , Lingyun Zhu , Yang Yang , Heng Tao Shen

The quadratic cost of attention limits the scalability of long-context LLMs, especially under limited hardware memory budgets. While attention is often sparse, existing static sparse methods cannot adapt to task- or input-dependent…

Computation and Language · Computer Science 2026-05-29 Siheng Xiong , Joe Zou , Faramarz Fekri , Yae Jee Cho

Large Language Models (LLMs) face limitations due to the high demand on GPU memory and computational resources when handling long contexts. While sparsify the Key-Value (KV) cache of transformer model is a typical strategy to alleviate…

Machine Learning · Computer Science 2024-02-06 Yumeng Wang , Zhenyang Xiao

Large Language Model (LLM) inference presents a unique scheduling challenge due to the Key-Value (KV) cache, where a job's memory footprint grows linearly with the number of decoded tokens. This growth couples scheduling decisions with…

Data Structures and Algorithms · Computer Science 2026-02-02 Yiding Feng , Zonghan Yang , Yuhao Zhang

In long-context large language model (LLM) inference, the prefill stage dominates computation due to self-attention over the complete input context. Sparse attention significantly reduces self-attention computation by limiting each token's…

Hardware Architecture · Computer Science 2026-02-25 Rakshith Jayanth , Viktor Prasanna

Large language models (LLMs) have shown remarkable potential in processing long sequences and complex reasoning tasks, yet efficiently serving these models remains challenging due to the quadratic computational complexity of attention in…

Computation and Language · Computer Science 2025-04-22 Shang Yang , Junxian Guo , Haotian Tang , Qinghao Hu , Guangxuan Xiao , Jiaming Tang , Yujun Lin , Zhijian Liu , Yao Lu , Song Han

Autoregressive decoding of large language models (LLMs) is memory bandwidth bounded, resulting in high latency and significant wastes of the parallel processing power of modern accelerators. Existing methods for accelerating LLM decoding…

Machine Learning · Computer Science 2024-02-06 Yichao Fu , Peter Bailis , Ion Stoica , Hao Zhang

The quadratic computational complexity of MultiHead SelfAttention (MHSA) remains a fundamental bottleneck in scaling Large Language Models (LLMs) for longcontext tasks. While sparse and linearized attention mechanisms attempt to mitigate…

Computation and Language · Computer Science 2025-12-19 Caner Erden

Linear Attention (LA) offers a promising paradigm for scaling large language models (LLMs) to long sequences by avoiding the quadratic complexity of self-attention. Recent LA models such as Mamba2 and GDN interpret linear recurrences as…

Machine Learning · Computer Science 2026-05-08 Yulong Huang , Xiang Liu , Hongxiang Huang , Xiaopeng Lin , Zunchang Liu , Xiaowen Chu , Zeke Xie , Bojun Cheng

FlashAttention (Dao, 2023) effectively reduces the quadratic peak memory usage to linear in training transformer-based large language models (LLMs) on a single GPU. In this paper, we introduce DISTFLASHATTN, a distributed memory-efficient…

Machine Learning · Computer Science 2024-04-02 Dacheng Li , Rulin Shao , Anze Xie , Eric P. Xing , Xuezhe Ma , Ion Stoica , Joseph E. Gonzalez , Hao Zhang

Large language models (LLMs) rely on key-value (KV) caches for efficient autoregressive decoding; however, cache size grows linearly with context length and model depth, becoming a major bottleneck in long-context inference. Prior KV cache…

Machine Learning · Computer Science 2025-09-22 Dmitry Akulov , Mohamed Sana , Antonio De Domenico , Tareq Si Salem , Nicola Piovesan , Fadhel Ayed

Key-value (KV) cache memory management is the primary bottleneck limiting throughput and cost-efficiency in large-scale GPU inference serving. Current systems suffer from three compounding inefficiencies: (1) the absence of unified KV cache…

Hardware Architecture · Computer Science 2026-05-01 Sanjeev Rao Ganjihal

Attention-based models have been widely used in many areas, such as computer vision and natural language processing. However, relevant applications in time series classification (TSC) have not been explored deeply yet, causing a significant…

Machine Learning · Computer Science 2022-07-18 Bowen Zhao , Huanlai Xing , Xinhan Wang , Fuhong Song , Zhiwen Xiao

With the rise of Transformer models in NLP and CV domain, Multi-Head Attention has been proven to be a game-changer. However, its expensive computation poses challenges to the model throughput and efficiency, especially for the long…

Image and Video Processing · Electrical Eng. & Systems 2024-04-12 Jiing-Ping Wang , Ming-Guang Lin , An-Yeu , Wu

Efficient inference of Multi-Head Latent Attention (MLA) is challenged by deploying the DeepSeek-R1 671B model on a single Multi-GPU server. This paper introduces FlashMLA-ETAP, a novel framework that enhances MLA inference for the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-05 Pengcuo Dege , Qiuming Luo , Rui Mao , Chang Kong