English
Related papers

Related papers: Sparse Checkpointing for Fast and Reliable MoE Tra…

200 papers

In deep learning, models typically reuse the same parameters for all inputs. Mixture of Experts (MoE) defies this and instead selects different parameters for each incoming example. The result is a sparsely-activated model -- with…

Machine Learning · Computer Science 2022-06-20 William Fedus , Barret Zoph , Noam Shazeer

Recently, Mixture-of-Experts (MoE) models have gained attention for efficiently scaling large language models. Although these models are extremely large, their sparse activation enables inference to be performed by accessing only a fraction…

Machine Learning · Computer Science 2026-01-27 Byeongju Kim , Jungwan Lee , Donghyeon Han , Hoi-Jun Yoo , Sangyeob Kim

Sparse Mixture-of-Experts (MoE) has been a successful approach for scaling multilingual translation models to billions of parameters without a proportional increase in training computation. However, MoE models are prohibitively large and…

Computation and Language · Computer Science 2021-10-11 Sneha Kudugunta , Yanping Huang , Ankur Bapna , Maxim Krikun , Dmitry Lepikhin , Minh-Thang Luong , Orhan Firat

Mixture-of-Experts (MoE) has gained increasing popularity as a promising framework for scaling up large language models (LLMs). However, the reliability assessment of MoE lags behind its surging applications. Moreover, when transferred to…

Machine Learning · Computer Science 2024-06-18 Guanjie Chen , Xinyu Zhao , Tianlong Chen , Yu Cheng

The sparse Mixture of Experts(MoE) architecture has evolved as a powerful approach for scaling deep learning models to more parameters with comparable computation cost. As an important branch of large language model(LLM), MoE model only…

Machine Learning · Computer Science 2026-02-10 Dong Pan , Bingtao Li , Yongsheng Zheng , Jiren Ma , Victor Fei

Scaling large language models has driven remarkable advancements across various domains, yet the continual increase in model size presents significant challenges for real-world deployment. The Mixture of Experts (MoE) architecture offers a…

Machine Learning · Computer Science 2025-03-18 Shwai He , Daize Dong , Liang Ding , Ang Li

Sparse Mixture-of-Experts models (MoEs) have recently gained popularity due to their ability to decouple model size from inference efficiency by only activating a small subset of the model parameters for any given input token. As such,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Erik Daxberger , Floris Weers , Bowen Zhang , Tom Gunter , Ruoming Pang , Marcin Eichner , Michael Emmersberger , Yinfei Yang , Alexander Toshev , Xianzhi Du

Mixture-of-Experts (MoE) models can achieve promising results with outrageous large amount of parameters but constant computation cost, and thus it has become a trend in model scaling. Still it is a mystery how MoE layers bring quality…

Machine Learning · Computer Science 2021-08-10 An Yang , Junyang Lin , Rui Men , Chang Zhou , Le Jiang , Xianyan Jia , Ang Wang , Jie Zhang , Jiamang Wang , Yong Li , Di Zhang , Wei Lin , Lin Qu , Jingren Zhou , Hongxia Yang

Mixture-of-Experts (MoE) models are designed to enhance the efficiency of large language models (LLMs) without proportionally increasing the computational demands. However, their deployment on edge devices still faces significant challenges…

Machine Learning · Computer Science 2024-08-21 Shuzhang Zhong , Ling Liang , Yuan Wang , Runsheng Wang , Ru Huang , Meng Li

Sparse Mixture of Experts (SMoE) has become the key to unlocking unparalleled scalability in deep learning. SMoE has the potential to exponentially increase parameter count while maintaining the efficiency of the model by only activating a…

Machine Learning · Computer Science 2024-10-21 Rachel S. Y. Teo , Tan M. Nguyen

Prompt-based methods have recently gained prominence in Continual Learning (CL) due to their strong performance and memory efficiency. A prevalent strategy in this paradigm assigns a dedicated subset of prompts to each task, which, while…

Machine Learning · Computer Science 2026-03-12 Minh Le , Bao-Ngoc Dao , Huy Nguyen , Quyen Tran , Anh Nguyen , Nhat Ho

Despite their remarkable achievement, gigantic transformers encounter significant drawbacks, including exorbitant computational and memory footprints during training, as well as severe collapse evidenced by a high degree of parameter…

Machine Learning · Computer Science 2023-03-06 Tianlong Chen , Zhenyu Zhang , Ajay Jaiswal , Shiwei Liu , Zhangyang Wang

Mixture-of-Experts (MoE) has emerged as a promising approach to scale up deep learning models due to its significant reduction in computational resources. However, the dynamic nature of MoE leads to load imbalance among experts, severely…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-16 Chenqi Zhao , Wenfei Wu , Linhai Song , Yuchen Xu , Yitao Yuan

Mixture-of-Experts (MoE) layers have emerged as an important tool in scaling up modern neural networks by decoupling total trainable parameters from activated parameters in the forward pass for each token. However, sparse MoEs add…

Machine Learning · Computer Science 2026-05-22 Tianze Jiang , Blake Bordelon , Cengiz Pehlevan , Boris Hanin

The Mixture of Experts (MoE) architecture has emerged as a key technique for scaling Large Language Models by activating only a subset of experts per query. Deploying MoE on consumer-grade edge hardware, however, is constrained by limited…

Artificial Intelligence · Computer Science 2026-05-05 Guoying Zhu , Meng Li , Haipeng Dai , Xuechen Liu , Weijun Wang , Keran Li , Jun xiao , Ligeng Chen , Wei Wang

Mixture-of-Experts (MoE) is now the dominant architecture for frontier language models, yet it requires all expert parameters to be loaded in memory, making it less preferable for memory-constrained deployment. Existing compression methods…

Computation and Language · Computer Science 2026-05-28 Junhyuck Kim , Jihun Yun , Haechan Kim , Gyeongman Kim , Joonghyun Bae , Jaewoong Cho

Mixture-of-Experts (MoE) has emerged as a promising sparse paradigm for scaling up pre-trained models (PTMs) with remarkable cost-effectiveness. However, the dynamic nature of MoE leads to rapid fluctuations and imbalances in expert loads…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-05 Yuhao Qing , Guichao Zhu , Fanxin Li , Lintian Lei , Zekai Sun , Xiuxian Guan , Shixiong Zhao , Xusheng Chen , Dong Huang , Sen Wang , Heming Cui

As the training of giant dense models hits the boundary on the availability and capability of the hardware resources today, Mixture-of-Experts (MoE) models become one of the most promising model architectures due to their significant…

The Mixture of Experts (MoE) model becomes an important choice of large language models nowadays because of its scalability with sublinear computational complexity for training and inference. However, existing MoE models suffer from two…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-25 Xin Chen , Hengheng Zhang , Xiaotao Gu , Kaifeng Bi , Lingxi Xie , Qi Tian

The classification of stellar light curves has become a key task in modern time-domain astronomy, fueled by the rapid growth of data from large-scale surveys such as Kepler and TESS. Although deep learning models have achieved high accuracy…

Instrumentation and Methods for Astrophysics · Physics 2025-07-21 Cunshi Wang , Yu Bai , Xinrui Song , Jiacheng Xu , Henggeng Han , Yuyang Li , Xinjie Hu , Huiqin Yang , Jifeng Liu