English
Related papers

Related papers: MemFine: Memory-Aware Fine-Grained Scheduling for …

200 papers

The Mixture of Experts (MoE) architecture is an important method for scaling Large Language Models (LLMs). It increases model capacity while keeping computation cost low. However, the ultra-large MoE models still have hundreds of billions…

Artificial Intelligence · Computer Science 2025-10-01 Yixiao Chen , Yanyue Xie , Ruining Yang , Wei Jiang , Wei Wang , Yong He , Yue Chen , Pu Zhao , Yanzhi Wang

Mixture of Experts (MoE) is able to scale up vision transformers effectively. However, it requires prohibiting computation resources to train a large MoE transformer. In this paper, we propose Residual Mixture of Experts (RMoE), an…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Lemeng Wu , Mengchen Liu , Yinpeng Chen , Dongdong Chen , Xiyang Dai , Lu Yuan

Mixture-of-Experts (MoE) architectures enhance the efficiency of large language models by activating only a subset of experts per token. However, standard MoE employs a fixed Top-K routing strategy, leading to redundant computation and…

Artificial Intelligence · Computer Science 2026-05-15 Juntong Wu , Jialiang Cheng , Qishen Yin , Yue Dai , Yuliang Yan , Fuyu Lv , Ou Dan , Li Yuan

While Mixture of Experts (MoE) models achieve remarkable efficiency by activating only subsets of parameters, they suffer from high memory access costs during inference. Memory-layer architectures offer an appealing alternative with very…

Machine Learning · Computer Science 2025-08-27 Zihao Huang , Yu Bao , Qiyang Min , Siyan Chen , Ran Guo , Hongzhi Huang , Defa Zhu , Yutao Zeng , Banggu Wu , Xun Zhou , Siyuan Qiao

The Mixture-of-Experts (MoE) architecture has become a predominant paradigm for scaling large language models (LLMs). Despite offering strong performance and computational efficiency, large MoE-based LLMs like DeepSeek-V3-0324 and…

Machine Learning · Computer Science 2025-08-08 Xiaodong Chen , Mingming Ha , Zhenzhong Lan , Jing Zhang , Jianguo Li

Selective parameter activation provided by Mixture-of-Expert (MoE) models have made them a popular choice in modern foundational models. However, MoEs face a fundamental tension when employed for serving. Batching, critical for performance…

Machine Learning · Computer Science 2026-05-20 Vima Gupta , Jae Hyung Ju , Kartik Sinha , Ada Gavrilovska , Anand Padmanabha Iyer

It is a challenging task to train large DNN models on sophisticated GPU platforms with diversified interconnect capabilities. Recently, pipelined training has been proposed as an effective approach for improving device utilization. However,…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-03 Shiqing Fan , Yi Rong , Chen Meng , Zongyan Cao , Siyu Wang , Zhen Zheng , Chuan Wu , Guoping Long , Jun Yang , Lixue Xia , Lansong Diao , Xiaoyong Liu , Wei Lin

Mixture-of-Experts (MoE) models are typically pre-trained with explicit load-balancing constraints to ensure statistically balanced expert routing. Despite this, we observe that even well-trained MoE models exhibit significantly imbalanced…

Machine Learning · Computer Science 2026-01-27 Xuan-Phi Nguyen , Shrey Pandit , Austin Xu , Caiming Xiong , Shafiq Joty

The proliferation of large language models (LLMs) has led to the adoption of Mixture-of-Experts (MoE) architectures that dynamically leverage specialized subnetworks for improved efficiency and performance. Despite their benefits, MoE…

Computation and Language · Computer Science 2024-10-28 Ruisi Cai , Yeonju Ro , Geon-Woo Kim , Peihao Wang , Babak Ehteshami Bejnordi , Aditya Akella , Zhangyang Wang

Mixture-of-Experts (MoE) architectures are often considered a natural fit for continual learning because sparse routing should localize updates and reduce interference, yet MoE Transformers still forget substantially even with sparse,…

Mixture of Experts (MoE) architectures have emerged as pivotal for scaling Large Language Models (LLMs) efficiently. Fine-grained MoE approaches - utilizing more numerous, smaller experts - have demonstrated potential in improving model…

Machine Learning · Computer Science 2025-06-04 Jakub Krajewski , Marcin Chochowski , Daniel Korzekwa

By increasing model parameters but activating them sparsely when performing a task, the use of Mixture-of-Experts (MoE) architecture significantly improves the performance of Large Language Models (LLMs) without increasing the inference…

Computation and Language · Computer Science 2025-06-10 Zeliang Zhang , Xiaodong Liu , Hao Cheng , Chenliang Xu , Jianfeng Gao

The Sparsely-Activated Mixture-of-Experts (MoE) has gained increasing popularity for scaling up large language models (LLMs) without exploding computational costs. Despite its success, the current design faces a challenge where all experts…

Machine Learning · Computer Science 2024-09-20 Manxi Sun , Wei Liu , Jian Luan , Pengzhi Gao , Bin Wang

Mixture-of-Experts (MoE) architectures offer the promise of larger model capacity without the prohibitive costs of fully dense designs. However, in real-world inference serving, load skew across experts often leads to suboptimal device…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-30 Shaoyu Wang , Guangrong He , Geon-Woo Kim , Yanqi Zhou , Seo Jin Park

Mixture of Experts (MoE) models enable parameter-efficient scaling through sparse expert activations, yet optimizing their inference and memory costs remains challenging due to limited understanding of their specialization behavior. We…

Machine Learning · Computer Science 2026-03-09 Marmik Chaudhari , Idhant Gulati , Nishkal Hundia , Pranav Karra , Shivam Raval

Solving multi-objective optimization problems for large deep neural networks is a challenging task due to the complexity of the loss landscape and the expensive computational cost of training and evaluating models. Efficient Pareto front…

Machine Learning · Computer Science 2024-06-17 Anke Tang , Li Shen , Yong Luo , Shiwei Liu , Han Hu , Bo Du

Mixture-of-Experts (MoE) architectures are increasingly used to efficiently scale large language models. However, in production inference, request batching and speculative decoding significantly amplify expert activation, eroding these…

Machine Learning · Computer Science 2026-02-10 Daniil Vankov , Nikita Ivkin , Kyle Ulrich , Xiang Song , Ashish Khetan , George Karypis

Large language models are typically deployed as monolithic systems, requiring the full model even when applications need only a narrow subset of capabilities, e.g., code, math, or domain-specific knowledge. Mixture-of-Experts (MoEs)…

Computation and Language · Computer Science 2026-05-12 Ryan Wang , Akshita Bhagia , Sewon Min

With the widespread application of Mixture of Experts (MoE) reasoning models in the field of LLM learning, efficiently serving MoE models under limited GPU memory constraints has emerged as a significant challenge. Offloading the…

Machine Learning · Computer Science 2025-09-10 Songkai Ma , Zhaorui Zhang , Sheng Di , Benben Liu , Xiaodong Yu , Xiaoyi Lu , Dan Wang

Sparse Mixture of Experts (sMoE) has become a pivotal approach for scaling large vision-language models, offering substantial capacity while maintaining computational efficiency through dynamic, sparse activation of experts. However,…

Machine Learning · Computer Science 2025-10-21 Yongxiang Hua , Haoyu Cao , Zhou Tao , Bocheng Li , Zihao Wu , Chaohu Liu , Linli Xu