English
Related papers

Related papers: MoE Routing Testbed: Studying Expert Specializatio…

200 papers

Mixture-of-Experts (MoE) architectures have become standard in large language models, yet many of their core design choices - expert count, granularity, shared experts, load balancing, token dropping - have only been studied one or two at a…

Machine Learning · Computer Science 2026-05-13 Margaret Li , Sneha Kudugunta , Danielle Rothermel , Luke Zettlemoyer

Mixture-of-Experts (MoE) architectures have become the dominant choice for scaling Large Language Models (LLMs), activating only a subset of parameters per token. While MoE architectures are primarily adopted for computational efficiency,…

Computation and Language · Computer Science 2026-05-19 Jeremy Herbst , Stefan Wermter , Jae Hee Lee

Mixture of experts (MoE) architectures have become a cornerstone for scaling up and are a key component in most large language models such as GPT-OSS, DeepSeek-V3, Llama-4, and Gemini-2.5. However, systematic research on MoE remains…

Computation and Language · Computer Science 2026-02-11 Nam V. Nguyen , Thong T. Doan , Luong Tran , Van Nguyen , Quang Pham

Mixture-of-Experts (MoE) architectures have emerged as a promising approach to scale Large Language Models (LLMs). MoE boosts the efficiency by activating a subset of experts per token. Recent works show that fine-grained experts…

Computation and Language · Computer Science 2025-10-21 Zheyue Tan , Zhiyuan Li , Tao Yuan , Dong Zhou , Weilin Liu , Yueqing Zhuang , Yadong Li , Guowei Niu , Cheng Qin , Zhuyu Yao , Congyi Liu , Haiyang Xu , Boxun Li , Guohao Dai , Bo Zhao , Yu Wang

Mixture-of-Experts (MoE) architectures enable conditional computation by routing inputs to multiple expert subnetworks and are often motivated as a mechanism for scaling large language models. In this project, we instead study MoE behavior…

Machine Learning · Computer Science 2026-01-22 Adam Rokah , Daniel Veress , Caleb Caulk , Sourav Sharan

Standard LoRA fine-tuning of Mixture-of-Experts (MoE) models applies adapters to every expert, yet our profiling shows that per-layer expert routing is highly skewed: a small subset of experts handles most tokens in each layer, while many…

Machine Learning · Computer Science 2026-03-26 Andrea Manzoni

This paper presents a comprehensive review of the Mixture-of-Experts (MoE) architecture in large language models, highlighting its ability to significantly enhance model performance while maintaining minimal computational overhead. Through…

Machine Learning · Computer Science 2025-12-24 Danyang Zhang , Junhao Song , Ziqian Bi , Xinyuan Song , Yingfang Yuan , Tianyang Wang , Joe Yeong , Junfeng Hao

Sparse Mixture-of-Experts (MoE) architectures route each token through a subset of experts at each layer independently. We propose viewing MoE computation through the lens of \emph{expert paths} -- the sequence of expert selections a token…

Machine Learning · Computer Science 2026-04-07 Zijin Gu , Tatiana Likhomanenko , Vimal Thilak , Jason Ramapuram , Navdeep Jaitly

Standard Mixture-of-Experts (MoE) models rely on centralized routing mechanisms that introduce rigid inductive biases. We propose Routing-Free MoE which eliminates any hard-coded centralized designs including external routers, Softmax,…

Machine Learning · Computer Science 2026-04-02 Yilun Liu , Jinru Han , Sikuan Yan , Volker Tresp , Yunpu Ma

In this study, we systematically evaluate the impact of common design choices in Mixture of Experts (MoEs) on validation performance, uncovering distinct influences at token and sequence levels. We also present empirical evidence showing…

Machine Learning · Computer Science 2024-02-21 Dongyang Fan , Bettina Messmer , Martin Jaggi

Mixture-of-Experts (MoE) has gained increasing popularity as a promising framework for scaling up large language models (LLMs). However, the reliability assessment of MoE lags behind its surging applications. Moreover, when transferred to…

Machine Learning · Computer Science 2024-06-18 Guanjie Chen , Xinyu Zhao , Tianlong Chen , Yu Cheng

Understanding the internal organization of neural networks remains a fundamental challenge in deep learning interpretability. We address this challenge by exploring a novel Sparse Mixture of Experts Variational Autoencoder (SMoE-VAE)…

Machine Learning · Computer Science 2025-09-15 Strahinja Nikolic , Ilker Oguz , Demetri Psaltis

Mixture of Experts (MoE) architectures increase large language model scalability, yet their performance depends on the router module that moves tokens to specialized experts. Bad routing can load imbalance and reduced accuracy. This project…

Machine Learning · Computer Science 2025-06-23 Daniel Fidel Harvey , George Weale , Berk Yilmaz

Sparse Mixture of Experts (SMoE) enables efficient training of large language models by routing input tokens to a select number of experts. However, training SMoE remains challenging due to the issue of representation collapse. Recent…

Computation and Language · Computer Science 2025-04-01 Giang Do , Hung Le , Truyen Tran

Mixture-of-Experts (MoE) architectures have emerged as a key strategy for scaling large language models (LLMs) efficiently. However, current MoE systems suffer from severe load imbalance, where only a small subset of experts is consistently…

Machine Learning · Computer Science 2025-06-27 Jiajie Yang

The Mixtures-of-Experts (MoE) model is a widespread distributed and integrated learning method for large language models (LLM), which is favored due to its ability to sparsify and expand models efficiently. However, the performance of MoE…

Machine Learning · Computer Science 2024-05-24 Jing Li , Zhijie Sun , Xuan He , Li Zeng , Yi Lin , Entong Li , Binfan Zheng , Rongqian Zhao , Xin Chen

Mixture of Experts (MoE) architectures have emerged as pivotal for scaling Large Language Models (LLMs) efficiently. Fine-grained MoE approaches - utilizing more numerous, smaller experts - have demonstrated potential in improving model…

Machine Learning · Computer Science 2025-06-04 Jakub Krajewski , Marcin Chochowski , Daniel Korzekwa

Mixture-of-Experts (MoE) LLMs rely on sparse, router-driven expert activation, yet how safety alignment interacts with routed expert specialization remains underexplored. A common intuition is that safety behavior may be controlled by…

Computation and Language · Computer Science 2026-05-29 Zhibo Zhang , Yuxi Li , Zhen Ouyang , Ling Shi , Kailong Wang

The Mixture-of-Experts (MoE) architecture has enabled the creation of massive yet efficient Large Language Models (LLMs). However, the standard deterministic routing mechanism presents a significant limitation: its inherent brittleness is a…

Machine Learning · Computer Science 2025-09-30 Albus Yizhuo Li

Modern applications increasingly involve many heterogeneous input streams, such as clinical sensors, wearable device data, imaging, and text, each with distinct measurement models, sampling rates, and noise characteristics. We define this…

Machine Learning · Computer Science 2026-03-03 Xing Han , Hsing-Huan Chung , Joydeep Ghosh , Paul Pu Liang , Suchi Saria