English
Related papers

Related papers: HetuMoE: An Efficient Trillion-scale Mixture-of-Ex…

200 papers

Mixture-of-Expert (MoE) models have obtained state-of-the-art performance in Neural Machine Translation (NMT) tasks. Existing works in MoE mostly consider a homogeneous design where the same number of experts of the same size are placed…

The Mixture of Experts (MoE) for language models has been proven effective in augmenting the capacity of models by dynamically routing each input token to a specific subset of experts for processing. Despite the success, most existing…

Machine Learning · Computer Science 2024-07-26 Hao Zhao , Zihan Qiu , Huijia Wu , Zili Wang , Zhaofeng He , Jie Fu

In recent years, Mixture-of-Experts (MoE) has emerged as an effective approach for enhancing the capacity of deep neural network (DNN) with sub-linear computational costs. However, storing all experts on GPUs incurs significant memory…

Machine Learning · Computer Science 2025-03-11 Suraiya Tairin , Shohaib Mahmud , Haiying Shen , Anand Iyer

The Mixture-of-Experts (MoE) architecture is crucial for scaling large language models, but its scalability is severely limited by inter-GPU communication bottlenecks in multi-GPU systems. Although overlapping communication with computation…

Hardware Architecture · Computer Science 2026-05-08 Zhuoshan Zhou , Chen Zhang , Shuyi Zhang , Qijun Zhang , Haibo Wang , Zhe Zhou , Zhipeng Tu , Guangyu Sun , Yijia Diao , Zhigang Ji , Jingwen Leng , Guanghui He , Minyi Guo

Mixture-of-Experts (MoE) models scale large language models efficiently by sparsely activating experts, but once an expert is selected, it is executed fully. Hence, the trade-off between accuracy and computation in an MoE model typically…

Machine Learning · Computer Science 2026-02-09 Nurbek Tastan , Stefanos Laskaridis , Karthik Nandakumar , Samuel Horvath

Sparse Mixture-of-Experts (MoE) models offer a powerful way to scale model size without increasing compute, as per-token FLOPs depend only on k active experts rather than the total pool of E experts. Yet, this asymmetry creates an MoE…

Machine Learning · Computer Science 2026-05-15 Linghao Jin , Chufan Shi , Huijuan Wang , Nuan Wen , Zhengzhong Liu , Eric Xing , Xuezhe Ma

Efficient deployment of large language models, particularly Mixture of Experts (MoE), on resource-constrained platforms presents significant challenges, especially in terms of computational efficiency and memory utilization. The MoE…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-20 Shiyi Cao , Shu Liu , Tyler Griggs , Peter Schafhalter , Xiaoxuan Liu , Ying Sheng , Joseph E. Gonzalez , Matei Zaharia , Ion Stoica

Mixture-of-Experts (MoE) is a promising way to scale up the learning capacity of large language models. It increases the number of parameters while keeping FLOPs nearly constant during inference through sparse activation. Yet, it still…

Machine Learning · Computer Science 2025-02-26 Pingzhi Li , Xiaolong Jin , Zhen Tan , Yu Cheng , Tianlong Chen

In this paper, we present the practical problems and the lessons learned at short-video services from Kuaishou. In industry, a widely-used multi-task framework is the Mixture-of-Experts (MoE) paradigm, which always introduces some shared…

Information Retrieval · Computer Science 2024-08-13 Xu Wang , Jiangxia Cao , Zhiyi Fu , Kun Gai , Guorui Zhou

The Mixture of Experts (MoE) selects a few feed-forward networks (FFNs) per token, achieving an effective trade-off between computational cost and performance. In conventional MoE, each expert is treated as entirely independent, and experts…

Machine Learning · Computer Science 2026-01-27 Shota Takashiro , Takeshi Kojima , Shohei Taniguchi , Yusuke Iwasawa , Yutaka Matsuo

The Sparsely-Activated Mixture-of-Experts (MoE) has gained increasing popularity for scaling up large language models (LLMs) without exploding computational costs. Despite its success, the current design faces a challenge where all experts…

Machine Learning · Computer Science 2024-09-20 Manxi Sun , Wei Liu , Jian Luan , Pengzhi Gao , Bin Wang

Mixture of experts (MoE) architectures have become a cornerstone for scaling up and are a key component in most large language models such as GPT-OSS, DeepSeek-V3, Llama-4, and Gemini-2.5. However, systematic research on MoE remains…

Computation and Language · Computer Science 2026-02-11 Nam V. Nguyen , Thong T. Doan , Luong Tran , Van Nguyen , Quang Pham

Mixture-of-Experts (MoE) models facilitate edge deployment by decoupling model capacity from active computation, yet their large memory footprint drives the need for GPU systems with near-data processing (NDP) capabilities that offload…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-08 Qi Wu , Chao Fang , Jiayuan Chen , Ye Lin , Yueqi Zhang , Yichuan Bai , Yuan Du , Li Du

As the training of giant dense models hits the boundary on the availability and capability of the hardware resources today, Mixture-of-Experts (MoE) models become one of the most promising model architectures due to their significant…

The Mixture of Experts (MoE) model becomes an important choice of large language models nowadays because of its scalability with sublinear computational complexity for training and inference. However, existing MoE models suffer from two…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-25 Xin Chen , Hengheng Zhang , Xiaotao Gu , Kaifeng Bi , Lingxi Xie , Qi Tian

The surgence of Mixture of Experts (MoE) in Large Language Models promises a small price of execution cost for a much larger model parameter count and learning capacity, because only a small fraction of parameters are activated for each…

Large Language Models (LLMs) based on Mixture-of-Experts (MoE) are pivotal in industrial applications for their ability to scale performance efficiently. However, standard MoEs enforce uniform expert sizes,creating a rigidity that fails to…

Computation and Language · Computer Science 2026-04-29 Zhicheng Ma , Xiang Liu , Zhaoxiang Liu , Ning Wang , Yi Shen , Kai Wang , Shuming Shi , Shiguo Lian

Sparse mixture of experts (SMoE) offers an appealing solution to scale up the model complexity beyond the mean of increasing the network's depth or width. However, we argue that effective SMoE training remains challenging because of the…

Artificial Intelligence · Computer Science 2025-05-20 Nam V. Nguyen , Huy Nguyen , Quang Pham , Van Nguyen , Savitha Ramasamy , Nhat Ho

Mixture-of-Experts (MoE) models promise efficient scaling of large language models (LLMs) by activating only a small subset of experts per token, but their parallelized inference pipelines make elastic serving challenging. Existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-06 Gursimran Singh , Timothy Yu , Haley Li , Cheng Chen , Hanieh Sadri , Qintao Zhang , Yu Zhang , Ying Xiong , Yong Zhang , Zhenan Fan

Mixture of experts (MoE), introduced over 20 years ago, is the simplest gated modular neural network architecture. There is renewed interest in MoE because the conditional computation allows only parts of the network to be used during each…

Machine Learning · Computer Science 2023-03-01 Yamuna Krishnamurthy , Chris Watkins , Thomas Gaertner