English
Related papers

Related papers: MPipeMoE: Memory Efficient MoE for Pre-trained Mod…

200 papers

The Mixture-of-Experts (MoE) architecture has become increasingly popular as a method to scale up large language models (LLMs). To save costs, heterogeneity-aware training solutions have been proposed to utilize GPU clusters made up of both…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-08 Yongji Wu , Xueshen Liu , Shuowei Jin , Ceyu Xu , Feng Qian , Z. Morley Mao , Matthew Lentz , Danyang Zhuo , Ion Stoica

Mixture-of-experts (MoE) architectures enable trillion-parameter LLMs with sparsely activated experts. Expert parallelism (EP) is a widely adopted MoE training strategy, but it suffers from severe all-to-all communication bottlenecks, which…

Mixture-of-Experts (MoE) has emerged as a promising approach to scale up deep learning models due to its significant reduction in computational resources. However, the dynamic nature of MoE leads to load imbalance among experts, severely…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-16 Chenqi Zhao , Wenfei Wu , Linhai Song , Yuchen Xu , Yitao Yuan

Mixture-of-Experts (MoE) layers activate a subset of model weights, dubbed experts, to improve model performance. MoE is particularly promising for deployment on process-in-memory (PIM) architectures, because PIM can naturally fit experts…

Hardware Architecture · Computer Science 2026-02-12 Hanyuan Gao , Xiaoxuan Yang

Expert parallelism is vital for effectively training Mixture-of-Experts (MoE) models, enabling different devices to host distinct experts, with each device processing different input data. However, during expert parallel training, dynamic…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-13 Xinyi Liu , Yujie Wang , Fangcheng Fu , Xuefeng Xiao , Huixia Li , Jiashi Li , Bin Cui

Mixture of experts (MoE) architectures have become a cornerstone for scaling up and are a key component in most large language models such as GPT-OSS, DeepSeek-V3, Llama-4, and Gemini-2.5. However, systematic research on MoE remains…

Computation and Language · Computer Science 2026-02-11 Nam V. Nguyen , Thong T. Doan , Luong Tran , Van Nguyen , Quang Pham

The Mixture of Experts (MoE) is an advanced model architecture in the industry that combines multiple specialized expert models from various domains into a single supermodel. This approach enables the model to scale without significantly…

Machine Learning · Computer Science 2024-11-04 Jingming Guo , Yan Liu , Yu Meng , Zhiwei Tao , Banglan Liu , Gang Chen , Xiang Li

The pervasive "memory wall" bottleneck is significantly amplified in modern large-scale Mixture-of-Experts (MoE) architectures. MoE's inherent architectural sparsity leads to sparse arithmetic compute and also introduces substantial…

Machine Learning · Computer Science 2026-01-12 Jiyuan Zhang , Yining Liu , Siqi Yan , Lisen Deng , Jennifer Cao , Shuqi Yang , Min Ni , Bi Xue , Shen Li

Scaling up deep neural network capacity has been known as an effective approach to improving model quality for several different machine learning tasks. In many cases, increasing model capacity beyond the memory limit of a single…

Computer Vision and Pattern Recognition · Computer Science 2019-07-29 Yanping Huang , Youlong Cheng , Ankur Bapna , Orhan Firat , Mia Xu Chen , Dehao Chen , HyoukJoong Lee , Jiquan Ngiam , Quoc V. Le , Yonghui Wu , Zhifeng Chen

Mixture-of-Experts (MoE) architectures scale language models by activating only a subset of specialized expert networks for each input token, thereby reducing the number of floating-point operations. However, the growing size of modern MoE…

Machine Learning · Computer Science 2025-11-14 Yun Wang , Lingyun Yang , Senhao Yu , Yixiao Wang , Ruixing Li , Zhixiang Wei , James Yen , Zhengwei Qi

Mixture-of-Experts (MoE) is an emerging technique for scaling large models with sparse activation. MoE models are typically trained in a distributed manner with an expert parallelism scheme, where experts in each MoE layer are distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-26 Fahao Chen , Peng Li , Zicong Hong , Zhou Su , Song Guo

The Mixture of Experts architecture allows for outrageously large neural networks by scaling model parameter size independently from computational demand (FLOPs). However, current DNN frameworks cannot effectively support the dynamic data…

Machine Learning · Computer Science 2022-08-03 Ferdinand Kossmann , Zhihao Jia , Alex Aiken

Mixture of Experts (MoE) models have emerged as the de facto architecture for scaling up language models without significantly increasing the computational cost. Recent MoE models demonstrate a clear trend towards high expert granularity…

Machine Learning · Computer Science 2026-03-30 Wentao Guo , Mayank Mishra , Xinle Cheng , Ion Stoica , Tri Dao

Large Language Models (LLMs) with Mixture-of-Expert (MoE) architectures achieve superior model performance with reduced computation costs, but at the cost of high memory capacity and bandwidth requirements. Near-Memory Processing (NMP)…

Performance · Computer Science 2025-09-12 Haochen Huang , Shuzhang Zhong , Zhe Zhang , Shuangchen Li , Dimin Niu , Hongzhong Zheng , Runsheng Wang , Meng Li

The Mixture-of-Experts (MoE) technique has proven to be a promising solution to efficiently scale the model size, which has been widely applied in recent LLM advancements. However, the substantial memory overhead of MoE models has made…

Machine Learning · Computer Science 2025-10-17 Ruijie Miao , Yilun Yao , Zihan Wang , Zhiming Wang , Bairen Yi , LingJun Liu , Yikai Zhao , Tong Yang

Mixture-of-Experts (MoE) has emerged as a practical approach to scale up parameters for the Transformer model to achieve better generalization while maintaining a sub-linear increase in computation overhead. Current MoE models are mainly…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-03 Shuqing Luo , Jie Peng , Pingzhi Li , Hanrui Wang , Tianlong Chen

While modern internet services, such as chatbots, search engines, and online advertising, demand the use of large-scale deep neural networks (DNNs), distributed training and inference over heterogeneous computing systems are desired to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-13 Dianhai Yu , Liang Shen , Hongxiang Hao , Weibao Gong , Huachao Wu , Jiang Bian , Lirong Dai , Haoyi Xiong

Sparse Mixture-of-Experts (MoE) models offer a powerful way to scale model size without increasing compute, as per-token FLOPs depend only on k active experts rather than the total pool of E experts. Yet, this asymmetry creates an MoE…

Machine Learning · Computer Science 2026-05-15 Linghao Jin , Chufan Shi , Huijuan Wang , Nuan Wen , Zhengzhong Liu , Eric Xing , Xuezhe Ma

In large language models like the Generative Pre-trained Transformer, the Mixture of Experts paradigm has emerged as a powerful technique for enhancing model expressiveness and accuracy. However, deploying GPT MoE models for parallel…

Machine Learning · Computer Science 2024-01-18 Jinghan Yao , Quentin Anthony , Aamir Shafi , Hari Subramoni , Dhabaleswar K. , Panda

Mixture-of-Experts (MoE) is a neural network architecture that adds sparsely activated expert blocks to a base model, increasing the number of parameters without impacting computational costs. However, current distributed deep learning…

Machine Learning · Computer Science 2023-05-16 Siddharth Singh , Olatunji Ruwase , Ammar Ahmad Awan , Samyam Rajbhandari , Yuxiong He , Abhinav Bhatele