English
Related papers

Related papers: Optimizing MoE Routers: Design, Implementation, an…

200 papers

Mixture-of-Experts (MoE) architectures have emerged as a key strategy for scaling large language models (LLMs) efficiently. However, current MoE systems suffer from severe load imbalance, where only a small subset of experts is consistently…

Machine Learning · Computer Science 2025-06-27 Jiajie Yang

Mixture of Experts (MoE) has become a key architectural paradigm for efficiently scaling Large Language Models (LLMs) by selectively activating a subset of parameters for each input token. However, standard MoE architectures face…

Machine Learning · Computer Science 2025-05-27 Zehua Liu , Han Wu , Ruifeng She , Xiaojin Fu , Xiongwei Han , Tao Zhong , Mingxuan Yuan

The interpretability of Mixture-of-Experts (MoE) models, especially those with heterogeneous designs, remains underexplored. Existing attribution methods for dense models fail to capture dynamic routing-expert interactions in sparse MoE…

Computation and Language · Computer Science 2025-06-12 Junzhuo Li , Bo Wang , Xiuze Zhou , Peijie Jiang , Jia Liu , Xuming Hu

Mixture of Experts (MoE) LLMs have recently gained attention for their ability to enhance performance by selectively engaging specialized subnetworks or "experts" for each input. However, deploying MoEs on memory-constrained devices remains…

Reinforcement learning (RL) has equipped LLM agents with a strong ability to solve complex tasks. However, existing RL methods normally use a \emph{single} policy network, causing \emph{simplicity bias} where simple tasks occupy most…

Artificial Intelligence · Computer Science 2026-05-20 Shengtian Yang , Yu Li , Shuo He , Yewen Li , Qingpeng Cai , Peng Jiang , Lei Feng

Mixture-of-Experts (MoE) architectures are often considered a natural fit for continual learning because sparse routing should localize updates and reduce interference, yet MoE Transformers still forget substantially even with sparse,…

Mixture of Experts (MoEs) have become a central component of many state-of-the-art open-source and proprietary large language models. Despite their widespread adoption, it remains unclear how close existing MoE architectures are to optimal…

Mixture-of-Experts (MoE) models are widely used to scale language models, yet their expert routing behavior and adaptation in a multilingual setting remain underexplored. In this work, we study multilingual routing dynamics during continual…

Computation and Language · Computer Science 2026-05-29 Aditi Khandelwal , Marius Mosbach , Verna Dankers , Siva Reddy , Golnoosh Farnadi

Mixture-of-experts (MoE) architectures used in large language models (LLMs) achieve state-of-the-art performance across diverse tasks yet face practical challenges such as deployment complexity and low activation efficiency. Expert pruning…

Machine Learning · Computer Science 2025-12-23 Xican Yang , Yuanhe Tian , Yan Song

Mixture-of-Experts (MoE) offers flexible graph reasoning by combining multiple views of a graph through a learned router. We investigate routing-aware explanations for MoE graph models in malware detection using control flow graphs (CFGs).…

Cryptography and Security · Computer Science 2026-02-24 Hossein Shokouhinejad , Roozbeh Razavi-Far , Griffin Higgins , Ali. A Ghorbani

Mixture-of-Experts (MoE) enables efficient scaling of large language models (LLMs) with sparsely activated experts during inference. To effectively deploy large MoE models on memory-constrained devices, many systems introduce *expert…

Machine Learning · Computer Science 2026-03-03 Jingcong Liang , Siyuan Wang , Miren Tian , Yitong Li , Duyu Tang , Zhongyu Wei

Recently, Mixture of Experts (MoE) based Transformer has shown promising results in many domains. This is largely due to the following advantages of this architecture: firstly, MoE based Transformer can increase model capacity without…

Sound · Computer Science 2021-05-10 Zhao You , Shulin Feng , Dan Su , Dong Yu

The Mixture-of-Experts (MoE) models have gained significant attention in deep learning due to their dynamic resource allocation and superior performance across diverse tasks. However, efficiently training these models remains challenging.…

Computation and Language · Computer Science 2025-09-03 Junfeng Ran , Guangxiang Zhao , Yuhan Wu , Dawei Zhu , Longyun Wu , Yikai Zhao , Tong Yang , Lin Sun , Xiangzheng Zhang , Sujian Li

Recent attempts to combine low-rank adaptation (LoRA) with mixture-of-experts (MoE) for multi-task adaptation of Large Language Models (LLMs) often replace whole attention/FFN layers with switch experts or append parallel expert branches,…

Machine Learning · Computer Science 2026-05-14 Wenbing Li , Zikai Song , Hang Zhou , Yunyao Zhang , Junqing Yu , Wei Yang

Sparse Mixture of Experts (MoE) architectures have emerged as a promising approach for scaling Transformer models. While initial works primarily incorporated MoE into feed-forward network (FFN) layers, recent studies have explored extending…

Machine Learning · Computer Science 2025-10-24 Yuanhang Yang , Chaozheng Wang , Jing Li

The advent of Large Language Models (LLMs) has ushered in a new era of artificial intelligence, with the potential to transform various sectors through automation and insightful analysis. The Mixture of Experts (MoE) architecture has been…

Machine Learning · Computer Science 2024-10-22 Xurui Li , Juanjuan Yao

Mixture-of-Experts (MoE) architectures face challenges such as high memory consumption and redundancy in experts. Pruning MoE can reduce network weights while maintaining model performance. Motivated by the recent observation of emergent…

Computation and Language · Computer Science 2024-10-17 Yanyue Xie , Zhi Zhang , Ding Zhou , Cong Xie , Ziang Song , Xin Liu , Yanzhi Wang , Xue Lin , An Xu

The Sparsely-Activated Mixture-of-Experts (MoE) has gained increasing popularity for scaling up large language models (LLMs) without exploding computational costs. Despite its success, the current design faces a challenge where all experts…

Machine Learning · Computer Science 2024-09-20 Manxi Sun , Wei Liu , Jian Luan , Pengzhi Gao , Bin Wang

Mixture of Experts (MoE) have shown remarkable success in leveraging specialized expert networks for complex machine learning tasks. However, their susceptibility to adversarial attacks presents a critical challenge for deployment in robust…

Machine Learning · Computer Science 2025-05-28 Xu Zhang , Kaidi Xu , Ziqing Hu , Ren Wang

Large language models (LLMs) encounter significant adaptation challenges in diverse multitask finetuning. Mixture-of-experts (MoE) provides a promising solution with a dynamic architecture, enabling effective task decoupling. However,…

Machine Learning · Computer Science 2025-05-28 Rongyu Zhang , Yijiang Liu , Huanrui Yang , Shenli Zheng , Dan Wang , Yuan Du , Li Du , Shanghang Zhang