English
Related papers

Related papers: MoE-nD: Per-Layer Mixture-of-Experts Routing for M…

200 papers

Multimodal Large Language Models (MLLMs) have advanced unified reasoning over text, images, and videos, but their inference is hindered by the rapid growth of key-value (KV) caches. Each visual input expands into thousands of tokens,…

Artificial Intelligence · Computer Science 2026-04-08 Bowen Zeng , Feiyang Ren , Jun Zhang , Xiaoling Gu , Ke Chen , Lidan Shou , Huan Li

Recently, significant progress has been made in developing reasoning-capable Large Language Models (LLMs) through long Chain-of-Thought (CoT) techniques. However, this long-CoT reasoning process imposes substantial memory overhead due to…

Computation and Language · Computer Science 2025-05-27 Tengxuan Liu , Shiyao Li , Jiayi Yang , Tianchen Zhao , Feng Zhou , Xiaohui Song , Guohao Dai , Shengen Yan , Huazhong Yang , Yu Wang

Large Language Models (LLMs) have achieved impressive accomplishments in recent years. However, the increasing memory consumption of KV cache has possessed a significant challenge to the inference system. Eviction methods have revealed the…

Computation and Language · Computer Science 2025-07-10 Zicong Tang , Shi Luohe , Zuchao Li , Baoyuan Qi , Guoming Liu , Lefei Zhang , Ping Wang

Mixture-of-Experts (MoE) models scale capacity via sparse activation but stress memory and bandwidth. Offloading alleviates GPU memory by fetching experts on demand, yet token-level routing causes irregular transfers that make inference…

Machine Learning · Computer Science 2025-12-22 Zhenyu Liu , Yunzhen Liu , Zehao Fan , Garrett Gagnon , Yayue Hou , Nan Wu , Yangwook Kang , Liu Liu

This paper introduces MoxE, a novel architecture that synergistically combines the Extended Long Short-Term Memory (xLSTM) with the Mixture of Experts (MoE) framework to address critical scalability and efficiency challenges in large…

Computation and Language · Computer Science 2025-05-06 Abdoul Majid O. Thiombiano , Brahim Hnich , Ali Ben Mrad , Mohamed Wiem Mkaouer

Mixture-of-Experts large language models (MoE-LLMs) marks a significant step forward of language models, however, they encounter two critical challenges in practice: 1) expert parameters lead to considerable memory consumption and loading…

Machine Learning · Computer Science 2025-02-25 Wei Huang , Yue Liao , Jianhui Liu , Ruifei He , Haoru Tan , Shiming Zhang , Hongsheng Li , Si Liu , Xiaojuan Qi

How to efficiently serve Large Language Models (LLMs) has become a pressing issue because of their huge computational cost in their autoregressive generation process. To mitigate computational costs, LLMs often employ the KV Cache technique…

Computation and Language · Computer Science 2024-07-23 Zheng Wang , Boxiao Jin , Zhongzhi Yu , Minjia Zhang

The emergence of Mixture of Experts (MoE) LLMs has significantly advanced the development of language models. Compared to traditional LLMs, MoE LLMs outperform traditional LLMs by achieving higher performance with considerably fewer…

Machine Learning · Computer Science 2024-11-05 Cheng Yang , Yang Sui , Jinqi Xiao , Lingyi Huang , Yu Gong , Yuanlin Duan , Wenqi Jia , Miao Yin , Yu Cheng , Bo Yuan

Key-Value (KV) caching is a common technique to enhance the computational efficiency of Large Language Models (LLMs), but its memory overhead grows rapidly with input length. Prior work has shown that not all tokens are equally important…

Computation and Language · Computer Science 2025-10-24 Yu Fu , Zefan Cai , Abedelkadir Asi , Wayne Xiong , Yue Dong , Wen Xiao

Mixture-of-Experts models enable large language models to scale efficiently, as they only activate a subset of experts for each input. Their core mechanisms, Top-k routing and auxiliary load balancing, remain heuristic, however, lacking a…

Machine Learning · Computer Science 2026-01-08 Ye Su , Yong Liu

Large Language Models (LLMs) excel in natural language processing tasks but pose significant computational and memory challenges for edge deployment due to their intensive resource demands. This work addresses the efficiency of LLM…

Hardware Architecture · Computer Science 2025-07-02 Zhican Wang , Hongxiang Fan , Haroon Waris , Gang Wang , Zhenyu Li , Jianfei Jiang , Yanan Sun , Guanghui He

Efficient long-context inference is critical as large language models (LLMs) adopt context windows of ranging from 128K to 1M tokens. However, the growing key-value (KV) cache and the high computational complexity of attention create…

Computation and Language · Computer Science 2025-03-13 Guangtao Wang , Shubhangi Upasani , Chen Wu , Darshan Gandhi , Jonathan Li , Changran Hu , Bo Li , Urmish Thakker

Long-context language models are limited by the memory footprint of the key-value (KV) cache. Existing training-free KV compression methods usually rank tokens by one importance signal -- attention, recency, layer-wise allocation, or key…

Computation and Language · Computer Science 2026-05-27 Hong Chen , Xiang Liu , Yubo Gao , Yuxuan Fan , Bo Wang , Yuanlin Chu , Yuanguo Lin , Xuming Hu

The key-value (KV) cache is a foundational optimization in Transformer-based large language models (LLMs), eliminating redundant recomputation of past token representations during autoregressive generation. However, its memory footprint…

Machine Learning · Computer Science 2026-03-24 Yichun Xu , Navjot K. Khaira , Tejinder Singh

Large Language Models (LLMs) have achieved remarkable success across a wide range of tasks, but serving them efficiently at scale remains a critical challenge due to their substantial computational and latency demands. While most existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-04 Yifan Sun , Gholamreza Haffari , Minxian Xu , Rajkumar Buyya , Adel N. Toosi

Large language models (LLMs) have demonstrated remarkable performance on long-context tasks, but are often bottlenecked by memory constraints. Namely, the KV cache, which is used to significantly speed up attention computations, grows…

For the efficient inference of Large Language Models (LLMs), the effective compression of key-value (KV) cache is essential. Three main types of KV cache compression techniques, namely sparsity, channel compression, and quantization, have…

Machine Learning · Computer Science 2025-02-24 Hong Yankun , Li Xing , Zhen Hui-Ling , Yu Xianzhi , Liu Wulong , Yuan Mingxuan

Long-horizon LLM inference turns the key--value (KV) cache into the dominant GPU memory consumer and makes per-token attention increasingly expensive. Many common eviction policies use static recency windows or historical attention, leaving…

Machine Learning · Computer Science 2026-05-26 Yubo Li , Yidi Miao

Large Mixture of Experts (MoE) models could achieve state-of-the-art quality on various language tasks, including machine translation task, thanks to the efficient model scaling capability with expert parallelism. However, it has brought a…

Machine Learning · Computer Science 2023-10-05 Young Jin Kim , Raffy Fahim , Hany Hassan Awadalla

As Large Language Models (LLMs) scale to support context windows exceeding one million tokens, the linear growth of Key-Value (KV) cache imposes severe memory capacity and bandwidth bottlenecks, constraining the efficiency of long-context…

Computation and Language · Computer Science 2026-04-09 Zhirui Chen , Peiyang Liu , Ling Shao