English
Related papers

Related papers: Scalable and Efficient MoE Training for Multitask …

200 papers

Mixture of experts (MoE) architectures have become a cornerstone for scaling up and are a key component in most large language models such as GPT-OSS, DeepSeek-V3, Llama-4, and Gemini-2.5. However, systematic research on MoE remains…

Computation and Language · Computer Science 2026-02-11 Nam V. Nguyen , Thong T. Doan , Luong Tran , Van Nguyen , Quang Pham

The Sparsely-Activated Mixture-of-Experts (MoE) has gained increasing popularity for scaling up large language models (LLMs) without exploding computational costs. Despite its success, the current design faces a challenge where all experts…

Machine Learning · Computer Science 2024-09-20 Manxi Sun , Wei Liu , Jian Luan , Pengzhi Gao , Bin Wang

End-to-end models with large capacity have significantly improved multilingual automatic speech recognition, but their computation cost poses challenges for on-device applications. We propose a streaming truly multilingual Conformer…

Computation and Language · Computer Science 2023-05-26 Ke Hu , Bo Li , Tara N. Sainath , Yu Zhang , Francoise Beaufays

Mixture-of-Experts large language models (MoE-LLMs) marks a significant step forward of language models, however, they encounter two critical challenges in practice: 1) expert parameters lead to considerable memory consumption and loading…

Machine Learning · Computer Science 2025-02-25 Wei Huang , Yue Liao , Jianhui Liu , Ruifei He , Haoru Tan , Shiming Zhang , Hongsheng Li , Si Liu , Xiaojuan Qi

Sparse Mixture of Expert (SMoE) models have emerged as a scalable alternative to dense models in language modeling. These models use conditionally activated feedforward subnetworks in transformer blocks, allowing for a separation between…

Machine Learning · Computer Science 2024-09-04 Soumajyoti Sarkar , Leonard Lausen , Volkan Cevher , Sheng Zha , Thomas Brox , George Karypis

The generation quality of large language models (LLMs) is often improved by utilizing inference-time sequence-level scaling methods (e.g., Chain-of-Thought). We introduce hyper-parallel scaling, a complementary framework that improves…

Artificial Intelligence · Computer Science 2025-10-15 Soheil Zibakhsh , Mohammad Samragh , Kumari Nishu , Lauren Hannah , Arnav Kundu , Minsik Cho

Mixture-of-experts networks (MoEs) have demonstrated remarkable efficiency in modern deep learning. Despite their empirical success, the theoretical foundations underlying their ability to model complex tasks remain poorly understood. In…

Machine Learning · Computer Science 2026-02-19 Mingze Wang , Weinan E

In recent years, Mixture-of-Experts (MoE) has emerged as an effective approach for enhancing the capacity of deep neural network (DNN) with sub-linear computational costs. However, storing all experts on GPUs incurs significant memory…

Machine Learning · Computer Science 2025-03-11 Suraiya Tairin , Shohaib Mahmud , Haiying Shen , Anand Iyer

Mixture-of-Experts (MoE) architectures have shown strong multilingual capabilities, yet the internal mechanisms underlying performance gains and cross-language differences remain insufficiently understood. In this work, we conduct a…

Computation and Language · Computer Science 2026-01-21 Yuxin Chen , Zhengzhou Cai , Xiangtian Ji , Weixiang Zhao , An Zhang , Xiang Wang , Tat-Seng Chua

Pretraining large language models (LLMs) is resource-intensive, often requiring months of training time even with high-end GPU clusters. There are two approaches of mitigating such computational demands: reusing smaller models to train…

Machine Learning · Computer Science 2025-06-17 Seng Pei Liew , Takuya Kato , Sho Takase

The Mixture of Experts (MoE) is an advanced model architecture in the industry that combines multiple specialized expert models from various domains into a single supermodel. This approach enables the model to scale without significantly…

Machine Learning · Computer Science 2024-11-04 Jingming Guo , Yan Liu , Yu Meng , Zhiwei Tao , Banglan Liu , Gang Chen , Xiang Li

The Mixture of Experts (MoE) architecture reduces the training and inference cost significantly compared to a dense model of equivalent capacity. Upcycling is an approach that initializes and trains an MoE model using a pre-trained dense…

Computation and Language · Computer Science 2025-03-18 Taishi Nakamura , Takuya Akiba , Kazuki Fujii , Yusuke Oda , Rio Yokota , Jun Suzuki

The Mixture-of-Experts (MoE) architecture is a powerful technique for scaling language models, yet it often suffers from expert homogenization, where experts learn redundant functionalities, thereby limiting MoE's full potential. To address…

Machine Learning · Computer Science 2026-03-03 Jiaang Li , Haibin Chen , Langming Liu , Yujin Yuan , Yadao Wang , Yizhen Zhang , Chengting Yu , Xin Tong , Weidong Zhang , Shilei Liu , Wenbo Su , Bo Zheng

The Mixture-of-Experts (MoE) technique has proven to be a promising solution to efficiently scale the model size, which has been widely applied in recent LLM advancements. However, the substantial memory overhead of MoE models has made…

Machine Learning · Computer Science 2025-10-17 Ruijie Miao , Yilun Yao , Zihan Wang , Zhiming Wang , Bairen Yi , LingJun Liu , Yikai Zhao , Tong Yang

Sparse mixture of expert architectures (MoEs) scale model capacity without significant increases in training or inference costs. Despite their success, MoEs suffer from a number of issues: training instability, token dropping, inability to…

Machine Learning · Computer Science 2024-05-28 Joan Puigcerver , Carlos Riquelme , Basil Mustafa , Neil Houlsby

Sparsely gated Mixture-of-Expert (MoE) has demonstrated its effectiveness in scaling up deep neural networks to an extreme scale. Despite that numerous efforts have been made to improve the performance of MoE from the model design or system…

Machine Learning · Computer Science 2023-02-21 Chang Chen , Min Li , Zhihua Wu , Dianhai Yu , Chao Yang

Sparse large language models (LLMs) with Mixture of Experts (MoE) and close to a trillion parameters are dominating the realm of most capable language models. However, the massive model scale poses significant challenges for the underlying…

Sparsely-activated Mixture-of-Expert (MoE) layers have found practical applications in enlarging the model size of large-scale foundation models, with only a sub-linear increase in computation demands. Despite the wide adoption of hybrid…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-04 Xinglin Pan , Wenxiang Lin , Shaohuai Shi , Xiaowen Chu , Weinong Sun , Bo Li

Large Language Models (LLMs) have achieved remarkable performance on a wide range of specialized tasks, exhibiting strong problem-solving capabilities. However, training these models is prohibitively expensive, and they often lack…

Machine Learning · Computer Science 2026-04-01 Eros Fanì , Oğuzhan Ersoy