English
Related papers

Related papers: Towards Efficient Mixture of Experts: A Holistic S…

200 papers

Mixture-of-Experts (MoE) large language models (LLMs), which leverage dynamic routing and sparse activation to enhance efficiency and scalability, have achieved higher performance while reducing computational costs. However, these models…

Machine Learning · Computer Science 2025-05-08 Xing Hu , Zhixuan Chen , Dawei Yang , Zukang Xu , Chen Xu , Zhihang Yuan , Sifan Zhou , Jiangyong Yu

Mixture-of-Experts (MoE) has emerged as a prominent architecture for scaling model size while maintaining computational efficiency. In MoE, each token in the input sequence activates a different subset of experts determined by a routing…

Computation and Language · Computer Science 2024-11-05 Chufan Shi , Cheng Yang , Xinyu Zhu , Jiahao Wang , Taiqiang Wu , Siheng Li , Deng Cai , Yujiu Yang , Yu Meng

We propose Tensor-Trained Low-Rank Adaptation Mixture of Experts (TT-LoRA MoE), a novel computational framework integrating Parameter-Efficient Fine-Tuning (PEFT) with sparse MoE routing to address scalability challenges in large model…

Machine Learning · Computer Science 2026-01-27 Pradip Kunwar , Minh N. Vu , Maanak Gupta , Mahmoud Abdelsalam , Manish Bhattarai

Recent efforts on Diffusion Mixture-of-Experts (MoE) models have primarily focused on developing more sophisticated routing mechanisms. However, we observe that the underlying architectural configuration space remains markedly…

Machine Learning · Computer Science 2025-12-02 Yahui Liu , Yang Yue , Jingyuan Zhang , Chenxi Sun , Yang Zhou , Wencong Zeng , Ruiming Tang , Guorui Zhou

In parameter-efficient fine-tuning, mixture-of-experts (MoE), which involves specializing functionalities into different experts and sparsely activating them appropriately, has been widely adopted as a promising approach to trade-off…

Machine Learning · Computer Science 2025-08-29 Jinyuan Feng , Chaopeng Wei , Tenghai Qiu , Tianyi Hu , Zhiqiang Pu

Mixture-of-experts networks (MoEs) have demonstrated remarkable efficiency in modern deep learning. Despite their empirical success, the theoretical foundations underlying their ability to model complex tasks remain poorly understood. In…

Machine Learning · Computer Science 2026-02-19 Mingze Wang , Weinan E

Mixture-of-Experts (MoE) models enable efficient scaling of large language models (LLMs) by activating only a subset of experts per input. However, we observe that the commonly used auxiliary load balancing loss often leads to expert…

Computation and Language · Computer Science 2026-01-27 Hongcan Guo , Haolang Lu , Guoshun Nan , Bolun Chu , Jialin Zhuang , Yuan Yang , Wenhao Che , Xinye Cao , Sicong Leng , Qimei Cui , Xudong Jiang

Deep mixture-of-experts models have attracted a lot of attention for survival analysis problems, particularly for their ability to cluster similar patients together. In practice, grouping often comes at the expense of key metrics such as…

Machine Learning · Computer Science 2025-11-25 Todd Morrill , Aahlad Puli , Murad Megjhani , Soojin Park , Richard Zemel

Mixture-of-Experts (MoE) architectures enable efficient scaling of large language models by activating only a subset of parameters per input. However, existing MoE models suffer from two critical limitations: (1) inefficient token-to-expert…

Computation and Language · Computer Science 2025-10-10 Jing Li , Zhijie Sun , Dachao Lin , Xuan He , Binfan Zheng , Yi Lin , Rongqian Zhao , Xin Chen

Mixture-of-Experts (MoE) presents a naturally compatible and scalable framework for multimodal learning, demonstrating strong adaptability across diverse modalities and tasks. Despite its growing success, a comprehensive and systematic…

Machine Learning · Computer Science 2026-05-28 Liangwei Nathan Zheng , Wei Emma Zhang , Olaf Maennel , Lin Yue , Weitong Chen

Sparse Mixture-of-Experts (MoE) has been a successful approach for scaling multilingual translation models to billions of parameters without a proportional increase in training computation. However, MoE models are prohibitively large and…

Computation and Language · Computer Science 2021-10-11 Sneha Kudugunta , Yanping Huang , Ankur Bapna , Maxim Krikun , Dmitry Lepikhin , Minh-Thang Luong , Orhan Firat

Mixture of Experts (MoE) LLMs have recently gained attention for their ability to enhance performance by selectively engaging specialized subnetworks or "experts" for each input. However, deploying MoEs on memory-constrained devices remains…

While large language models (LLMs) excel on generation tasks, their decoder-only architecture often limits their potential as embedding models if no further representation finetuning is applied. Does this contradict their claim of…

Computation and Language · Computer Science 2024-10-17 Ziyue Li , Tianyi Zhou

In this study, we propose MoME, a Mixture of Visual Language Medical Experts, for Medical Image Segmentation. MoME adapts the successful Mixture of Experts (MoE) paradigm, widely used in Large Language Models (LLMs), for medical…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Arghavan Rezvani , Xiangyi Yan , Anthony T. Wu , Kun Han , Pooya Khosravi , Xiaohui Xie

Sparse Mixture of Experts (MoE) models offer a scalable and efficient architecture for training large neural networks by activating only a subset of parameters ("experts") for each input. A learned router computes a distribution over these…

Machine Learning · Computer Science 2025-10-14 Nabil Omi , Siddhartha Sen , Ali Farhadi

The Mixture-of-Experts (MoE) architecture has demonstrated significant advantages in the era of Large Language Models (LLMs), offering enhanced capabilities with reduced inference costs. However, deploying MoE-based LLMs on…

Machine Learning · Computer Science 2024-11-07 Peng Tang , Jiacheng Liu , Xiaofeng Hou , Yifei Pu , Jing Wang , Pheng-Ann Heng , Chao Li , Minyi Guo

Mixture-of-Experts (MoE) model architectures can significantly reduce the number of activated parameters per token, enabling computationally efficient training and inference. However, their large overall parameter counts and model sizes…

Machine Learning · Computer Science 2026-02-13 Arian Raje , Anupam Nayak , Gauri Joshi

The Mixture-of-Experts (MoE) architecture is a powerful technique for scaling language models, yet it often suffers from expert homogenization, where experts learn redundant functionalities, thereby limiting MoE's full potential. To address…

Machine Learning · Computer Science 2026-03-03 Jiaang Li , Haibin Chen , Langming Liu , Yujin Yuan , Yadao Wang , Yizhen Zhang , Chengting Yu , Xin Tong , Weidong Zhang , Shilei Liu , Wenbo Su , Bo Zheng

In this work, we aim to simultaneously enhance the effectiveness and efficiency of Mixture-of-Experts (MoE) methods. To achieve this, we propose MoE++, a general and heterogeneous MoE framework that integrates both Feed-Forward…

Machine Learning · Computer Science 2024-10-11 Peng Jin , Bo Zhu , Li Yuan , Shuicheng Yan

Mixture-of-Experts (MoE) models are designed to enhance the efficiency of large language models (LLMs) without proportionally increasing the computational demands. However, their deployment on edge devices still faces significant challenges…

Machine Learning · Computer Science 2024-08-21 Shuzhang Zhong , Ling Liang , Yuan Wang , Runsheng Wang , Ru Huang , Meng Li