English
Related papers

Related papers: Decoding Knowledge Attribution in Mixture-of-Exper…

200 papers

Sparsely activated Mixture-of-Experts (SMoE) has shown promise to scale up the learning capacity of neural networks, however, they have issues like (a) High Memory Usage, due to duplication of the network layers into multiple copies as…

Machine Learning · Computer Science 2024-03-15 Pingzhi Li , Zhenyu Zhang , Prateek Yadav , Yi-Lin Sung , Yu Cheng , Mohit Bansal , Tianlong Chen

Mixture of experts (MoE) architectures have become a cornerstone for scaling up and are a key component in most large language models such as GPT-OSS, DeepSeek-V3, Llama-4, and Gemini-2.5. However, systematic research on MoE remains…

Computation and Language · Computer Science 2026-02-11 Nam V. Nguyen , Thong T. Doan , Luong Tran , Van Nguyen , Quang Pham

Mixture of Experts (MoE) has become a key architectural paradigm for efficiently scaling Large Language Models (LLMs) by selectively activating a subset of parameters for each input token. However, standard MoE architectures face…

Machine Learning · Computer Science 2025-05-27 Zehua Liu , Han Wu , Ruifeng She , Xiaojin Fu , Xiongwei Han , Tao Zhong , Mingxuan Yuan

Mixture-of-Experts (MoE) models enable efficient scaling of large language models (LLMs) by activating only a subset of experts per input. However, we observe that the commonly used auxiliary load balancing loss often leads to expert…

Computation and Language · Computer Science 2026-01-27 Hongcan Guo , Haolang Lu , Guoshun Nan , Bolun Chu , Jialin Zhuang , Yuan Yang , Wenhao Che , Xinye Cao , Sicong Leng , Qimei Cui , Xudong Jiang

The Mixture of Experts (MoE) architecture has emerged as a key technique for scaling Large Language Models by activating only a subset of experts per query. Deploying MoE on consumer-grade edge hardware, however, is constrained by limited…

Artificial Intelligence · Computer Science 2026-05-05 Guoying Zhu , Meng Li , Haipeng Dai , Xuechen Liu , Weijun Wang , Keran Li , Jun xiao , Ligeng Chen , Wei Wang

Mixture-of-Experts (MoE) language models dramatically expand model capacity and achieve remarkable performance without increasing per-token compute. However, can MoEs surpass dense architectures under strictly equal resource constraints --…

Computation and Language · Computer Science 2026-05-19 Houyi Li , Ka Man Lo , Shijie Xuyang , Ziqi Wang , Wenzhen Zheng , Haocheng Zhang , Zhao Li , Shuigeng Zhou , Xiangyu Zhang , Daxin Jiang

To meet the growing demand for smarter, faster, and more efficient embodied AI solutions, we introduce a novel Mixture-of-Expert (MoE) method that significantly boosts reasoning and learning efficiency for embodied autonomous systems.…

Artificial Intelligence · Computer Science 2025-08-14 Lu Xu , Jiaqian Yu , Xiongfeng Peng , Yiwei Chen , Weiming Li , Jaewook Yoo , Sunghyun Chunag , Dongwook Lee , Daehyun Ji , Chao Zhang

Mixture of Experts (MoE) has emerged as a promising paradigm for scaling model capacity while preserving computational efficiency, particularly in large-scale machine learning architectures such as large language models (LLMs). Recent…

Networking and Internet Architecture · Computer Science 2026-01-29 Yunting Xu , Jiacheng Wang , Ruichen Zhang , Changyuan Zhao , Dusit Niyato , Jiawen Kang , Zehui Xiong , Bo Qian , Haibo Zhou , Shiwen Mao , Abbas Jamalipour , Xuemin Shen , Dong In Kim

Sparse Mixture-of-Experts (MoE) models can outperform dense large language models at similar computation by activating only a small set of experts per token. However, stacking many expert modules introduces substantial parameter memory,…

Artificial Intelligence · Computer Science 2026-04-03 Xin He , Shunkang Zhang , Kaijie Tang , Shaohuai Shi , Yuxin Wang , Zihao Zeng , Zhenheng Tang , Xiaowen Chu , Haiyan Yin , Ivor W. Tsang , Yew Soon Ong

Mixture-of-Experts (MoE) architectures have emerged as a key strategy for scaling large language models (LLMs) efficiently. However, current MoE systems suffer from severe load imbalance, where only a small subset of experts is consistently…

Machine Learning · Computer Science 2025-06-27 Jiajie Yang

Mixture-of-Experts (MoE) architectures have emerged as a promising direction, offering efficiency and scalability by activating only a subset of parameters during inference. However, current research remains largely performance-centric,…

Machine Learning · Computer Science 2025-09-30 Jiahao Ying , Mingbao Lin , Qianru Sun , Yixin Cao

Mixture-of-Experts (MoE) models scale capacity via sparse activation but stress memory and bandwidth. Offloading alleviates GPU memory by fetching experts on demand, yet token-level routing causes irregular transfers that make inference…

Machine Learning · Computer Science 2025-12-22 Zhenyu Liu , Yunzhen Liu , Zehao Fan , Garrett Gagnon , Yayue Hou , Nan Wu , Yangwook Kang , Liu Liu

Mixture-of-Experts (MoE) architectures are widely used for efficiency and conditional computation, but their effect on the geometry of learned functions and representations remains poorly understood. We study MoEs through a geometric lens,…

Machine Learning · Computer Science 2026-02-19 Feilong Liu

Mixture of Experts (MoE) models based on Transformer architecture are pushing the boundaries of language and vision tasks. The allure of these models lies in their ability to substantially increase the parameter count without a…

This paper presents a comprehensive review of the Mixture-of-Experts (MoE) architecture in large language models, highlighting its ability to significantly enhance model performance while maintaining minimal computational overhead. Through…

Machine Learning · Computer Science 2025-12-24 Danyang Zhang , Junhao Song , Ziqian Bi , Xinyuan Song , Yingfang Yuan , Tianyang Wang , Joe Yeong , Junfeng Hao

Most recent state-of-the-art (SOTA) large language models (LLMs) use Mixture-of-Experts (MoE) architectures to scale model capacity without proportional per-token compute, enabling higher-quality outputs at manageable serving costs.…

In large language models like the Generative Pre-trained Transformer, the Mixture of Experts paradigm has emerged as a powerful technique for enhancing model expressiveness and accuracy. However, deploying GPT MoE models for parallel…

Machine Learning · Computer Science 2024-01-18 Jinghan Yao , Quentin Anthony , Aamir Shafi , Hari Subramoni , Dhabaleswar K. , Panda

Mixture-of-Experts (MoE) Large Language Models (LLMs) face a trilemma of load imbalance, parameter redundancy, and communication overhead. We introduce a unified framework based on dynamic expert clustering and structured compression to…

Computation and Language · Computer Science 2026-02-06 Peijun Zhu , Ning Yang , Baoliang Tian , Jiayu Wei , Weihao Zhang , Haijun Zhang , Pin Lv

Imitation learning enables robots to acquire manipulation skills from demonstrations, yet deploying a policy across tasks with heterogeneous dynamics remains challenging, as models tend to average over distinct behavioral modes present in…

The Mixture-of-Experts (MoE) architecture enables a significant increase in the total number of model parameters with minimal computational overhead. However, it is not clear what performance tradeoffs, if any, exist between MoEs and…