English
Related papers

Related papers: HybriMoE: Hybrid CPU-GPU Scheduling and Cache Mana…

200 papers

Mixture-of-Experts (MoE) has emerged as a promising approach to scale up deep learning models due to its significant reduction in computational resources. However, the dynamic nature of MoE leads to load imbalance among experts, severely…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-16 Chenqi Zhao , Wenfei Wu , Linhai Song , Yuchen Xu , Yitao Yuan

Mixture-of-Experts (MoE) layers activate a subset of model weights, dubbed experts, to improve model performance. MoE is particularly promising for deployment on process-in-memory (PIM) architectures, because PIM can naturally fit experts…

Hardware Architecture · Computer Science 2026-02-12 Hanyuan Gao , Xiaoxuan Yang

Large Language Models (LLMs) based on Mixture-of-Experts (MoE) are pivotal in industrial applications for their ability to scale performance efficiently. However, standard MoEs enforce uniform expert sizes,creating a rigidity that fails to…

Computation and Language · Computer Science 2026-04-29 Zhicheng Ma , Xiang Liu , Zhaoxiang Liu , Ning Wang , Yi Shen , Kai Wang , Shuming Shi , Shiguo Lian

The immense memory requirements of state-of-the-art Mixture-of-Experts (MoE) models present a significant challenge for inference, often exceeding the capacity of a single accelerator. While offloading experts to host memory is a common…

Machine Learning · Computer Science 2025-11-19 Wenfeng Wang , Jiacheng Liu , Xiaofeng Hou , Xinfeng Xia , Peng Tang , Mingxuan Zhang , Chao Li , Minyi Guo

Mixture-of-Experts (MoE) activates only a subset of experts during inference, allowing the model to maintain low inference FLOPs and latency even as the parameter count scales up. However, since MoE dynamically selects the experts, all the…

Machine Learning · Computer Science 2025-05-27 Shibo Jie , Yehui Tang , Kai Han , Yitong Li , Duyu Tang , Zhi-Hong Deng , Yunhe Wang

Mixture-of-Experts (MoE), while offering significant advantages as a Large Language Model (LLM) architecture, faces substantial challenges when deployed on low-cost edge devices with tight memory constraints. Expert offloading mitigates…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-04 Liujianfu Wang , Yuyang Du , Yuchen Pan , Soung Chang Liew , Jiacheng Liu , Kexin Chen

Mixture-of-Experts (MoE) models have shown strong potential in scaling language models efficiently by activating only a small subset of experts per input. However, their widespread deployment remains limited due to the high memory overhead…

Machine Learning · Computer Science 2025-11-10 Yushu Zhao , Zheng Wang , Minjia Zhang

The QMoE model provides a practical approach for compression of massive Mixture-of-Experts (MoE) models. QMoE offers a solution geared towards memory limitations that often reach terabyte scales, and it has the advantage of working with…

Performance · Computer Science 2025-09-30 Jack Cashman , Jiaqi Nie

The Mixture of Experts (MoE) is a widely known neural architecture where an ensemble of specialized sub-models optimizes overall performance with a constant computational cost. However, conventional MoEs pose challenges at scale due to the…

Computation and Language · Computer Science 2023-09-12 Ted Zadouri , Ahmet Üstün , Arash Ahmadian , Beyza Ermiş , Acyr Locatelli , Sara Hooker

Despite the computational efficiency of MoE models, the excessive memory footprint and I/O overhead inherent in multi-expert architectures pose formidable challenges for real-time inference on resource-constrained edge platforms. While…

Machine Learning · Computer Science 2026-03-20 Yuegui Huang , Zhiyuan Fang , Weiqi Luo , Ruoyu Wu , Wuhui Chen , Zibin Zheng

Mixture-of-Experts (MoE) architectures are evolving towards finer granularity to improve parameter efficiency. However, existing MoE designs face an inherent trade-off between the granularity of expert specialization and hardware execution…

Computation and Language · Computer Science 2026-02-06 Jingze Shi , Zhangyang Peng , Yizhang Zhu , Yifan Wu , Guang Liu , Yuyu Luo

The Mixture of Experts (MoE) architecture has emerged as a powerful paradigm for scaling large language models (LLMs) while maintaining inference efficiency. However, their enormous memory requirements make them prohibitively expensive to…

Machine Learning · Computer Science 2025-06-24 Zichong Li , Chen Liang , Zixuan Zhang , Ilgee Hong , Young Jin Kim , Weizhu Chen , Tuo Zhao

The Mixture-of-Experts (MoE) technique has proven to be a promising solution to efficiently scale the model size, which has been widely applied in recent LLM advancements. However, the substantial memory overhead of MoE models has made…

Machine Learning · Computer Science 2025-10-17 Ruijie Miao , Yilun Yao , Zihan Wang , Zhiming Wang , Bairen Yi , LingJun Liu , Yikai Zhao , Tong Yang

Frontier models increasingly adopt Mixture-of-Experts (MoE) architectures to achieve large-model performance at reduced cost. However, training MoE models on HPC platforms is hindered by large memory footprints, frequent large-scale…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-07 Sajal Dash , Feiyi Wang

Modern Mixture-of-Experts (MoE) models increasingly rely on large-scale AI accelerator clusters for efficient training. Ascend NPUs expose heterogeneous on-chip compute resources, including matrix-oriented AIC units and vector-oriented AIV…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-25 Zewen Jin , Congkun Ai , Guangpeng Zhang , Hanbo Zhang , Haoran Wang , Shihan Xiao , Da Lei , Xuefeng Jin , Teng Su , Cheng Li

The Mixture-of-Experts (MoE) architecture has demonstrated significant advantages in the era of Large Language Models (LLMs), offering enhanced capabilities with reduced inference costs. However, deploying MoE-based LLMs on…

Machine Learning · Computer Science 2024-11-07 Peng Tang , Jiacheng Liu , Xiaofeng Hou , Yifei Pu , Jing Wang , Pheng-Ann Heng , Chao Li , Minyi Guo

Current inference systems for Mixture-of-Experts (MoE) models primarily employ static parallelization strategies. However, these static approaches cannot consistently achieve optimal performance across different inference scenarios, as they…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-28 Haoran Lin , Xianzhi Yu , Kang Zhao , Han Bao , Zongyuan Zhan , Ting Hu , Wulong Liu , Zekun Yin , Xin Li , Weiguo Liu

Large Language Models (LLMs) with the Mixture-of-Experts (MoE) architectures have shown promising performance on various tasks. However, due to the huge model sizes, running them in resource-constrained environments where the GPU memory is…

Machine Learning · Computer Science 2025-05-02 Keisuke Kamahori , Tian Tang , Yile Gu , Kan Zhu , Baris Kasikci

With the widespread adoption of Mixture-of-Experts (MoE) models, there is a growing demand for efficient inference on memory-constrained devices. While offloading expert parameters to CPU memory and loading activated experts on demand has…

Machine Learning · Computer Science 2025-05-13 Yuxin Zhou , Zheng Li , Jun Zhang , Jue Wang , Yiping Wang , Zhongle Xie , Ke Chen , Lidan Shou

Mixture of Experts (MoE) LLMs have recently gained attention for their ability to enhance performance by selectively engaging specialized subnetworks or "experts" for each input. However, deploying MoEs on memory-constrained devices remains…