English
Related papers

Related papers: Routing Matters in MoE: Scaling Diffusion Transfor…

200 papers

Transformer-based Mixture-of-Experts (MoE) models have been driving several recent technological advancements in Natural Language Processing (NLP). These MoE models adopt a router mechanism to determine which experts to activate for routing…

Machine Learning · Computer Science 2024-09-11 Maryam Akhavan Aghdam , Hongpeng Jin , Yanzhao Wu

Mixture of Experts (MoE) models based on Transformer architecture are pushing the boundaries of language and vision tasks. The allure of these models lies in their ability to substantially increase the parameter count without a…

Mixture-of-Experts (MoE) architectures have emerged as a powerful paradigm for scaling neural networks while maintaining computational efficiency. However, standard MoE implementations rely on two rigid design assumptions: (1) fixed Top-K…

Machine Learning · Computer Science 2026-03-03 Gökdeniz Gülmez

Recently, mixture of experts (MoE) has become a popular paradigm for achieving the trade-off between modal capacity and efficiency of multi-modal large language models (MLLMs). Different from previous efforts, we are dedicated to exploring…

Multimedia · Computer Science 2025-02-13 Qiong Wu , Zhaoxi Ke , Yiyi Zhou , Xiaoshuai Sun , Rongrong Ji

Sparse Mixture-of-Experts (MoE) architectures route each token through a subset of experts at each layer independently. We propose viewing MoE computation through the lens of \emph{expert paths} -- the sequence of expert selections a token…

Machine Learning · Computer Science 2026-04-07 Zijin Gu , Tatiana Likhomanenko , Vimal Thilak , Jason Ramapuram , Navdeep Jaitly

Sparse Mixture of Experts (SMoE) enables efficient training of large language models by routing input tokens to a select number of experts. However, training SMoE remains challenging due to the issue of representation collapse. Recent…

Computation and Language · Computer Science 2025-04-01 Giang Do , Hung Le , Truyen Tran

Multimodal large language models (MLLMs) have achieved impressive performance, but high-resolution visual inputs result in long sequences of visual tokens and substantial inference latency. Reducing redundant visual tokens is critical to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Guoyang Xia , Yifeng Ding , Fengfa Li , Lei Ren , Wei Chen , Fangxiang Feng , Xiaojie Wang

Mixture of experts (MoE) architectures have become a cornerstone for scaling up and are a key component in most large language models such as GPT-OSS, DeepSeek-V3, Llama-4, and Gemini-2.5. However, systematic research on MoE remains…

Computation and Language · Computer Science 2026-02-11 Nam V. Nguyen , Thong T. Doan , Luong Tran , Van Nguyen , Quang Pham

Mixture-of-Experts (MoE) architectures enable conditional computation by routing inputs to multiple expert subnetworks and are often motivated as a mechanism for scaling large language models. In this project, we instead study MoE behavior…

Machine Learning · Computer Science 2026-01-22 Adam Rokah , Daniel Veress , Caleb Caulk , Sourav Sharan

Recently, Mixture of Experts (MoE) based Transformer has shown promising results in many domains. This is largely due to the following advantages of this architecture: firstly, MoE based Transformer can increase model capacity without…

Sound · Computer Science 2021-05-10 Zhao You , Shulin Feng , Dan Su , Dong Yu

Mixture of Experts (MoE) models enable parameter-efficient scaling through sparse expert activations, yet optimizing their inference and memory costs remains challenging due to limited understanding of their specialization behavior. We…

Machine Learning · Computer Science 2026-03-09 Marmik Chaudhari , Idhant Gulati , Nishkal Hundia , Pranav Karra , Shivam Raval

In deep learning, mixture-of-experts (MoE) activates one or few experts (sub-networks) on a per-sample or per-token basis, resulting in significant computation reduction. The recently proposed \underline{p}atch-level routing in…

Machine Learning · Computer Science 2023-07-10 Mohammed Nowaz Rabbani Chowdhury , Shuai Zhang , Meng Wang , Sijia Liu , Pin-Yu Chen

Sparse Mixture of Experts (MoE) models offer a scalable and efficient architecture for training large neural networks by activating only a subset of parameters ("experts") for each input. A learned router computes a distribution over these…

Machine Learning · Computer Science 2025-10-14 Nabil Omi , Siddhartha Sen , Ali Farhadi

Sparsely-gated mixture-of-experts (MoE) has been widely adopted to scale deep learning models to trillion-plus parameters with fixed computational cost. The algorithmic performance of MoE relies on its token routing mechanism that forwards…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-06 Changho Hwang , Wei Cui , Yifan Xiong , Ziyue Yang , Ze Liu , Han Hu , Zilong Wang , Rafael Salas , Jithin Jose , Prabhat Ram , Joe Chau , Peng Cheng , Fan Yang , Mao Yang , Yongqiang Xiong

Mixture-of-Experts (MoE) architectures have shown strong multilingual capabilities, yet the internal mechanisms underlying performance gains and cross-language differences remain insufficiently understood. In this work, we conduct a…

Computation and Language · Computer Science 2026-01-21 Yuxin Chen , Zhengzhou Cai , Xiangtian Ji , Weixiang Zhao , An Zhang , Xiang Wang , Tat-Seng Chua

Mixture-of-Experts (MoE) models scale large language models efficiently by sparsely activating experts, but once an expert is selected, it is executed fully. Hence, the trade-off between accuracy and computation in an MoE model typically…

Machine Learning · Computer Science 2026-02-09 Nurbek Tastan , Stefanos Laskaridis , Karthik Nandakumar , Samuel Horvath

Mixture-of-Experts (MoE) architectures scale large language models efficiently by employing a parametric ``router'' to dispatch tokens to a sparse subset of experts. Typically, this router is trained once and then frozen, rendering routing…

Computation and Language · Computer Science 2026-05-26 Boxuan Lyu , Soichiro Murakami , Hidetaka Kamigaito , Peinan Zhang

The Mixture-of-Experts (MoE) architecture is a powerful technique for scaling language models, yet it often suffers from expert homogenization, where experts learn redundant functionalities, thereby limiting MoE's full potential. To address…

Machine Learning · Computer Science 2026-03-03 Jiaang Li , Haibin Chen , Langming Liu , Yujin Yuan , Yadao Wang , Yizhen Zhang , Chengting Yu , Xin Tong , Weidong Zhang , Shilei Liu , Wenbo Su , Bo Zheng

Sparse Mixture-of-Experts (MoE) has been a successful approach for scaling multilingual translation models to billions of parameters without a proportional increase in training computation. However, MoE models are prohibitively large and…

Computation and Language · Computer Science 2021-10-11 Sneha Kudugunta , Yanping Huang , Ankur Bapna , Maxim Krikun , Dmitry Lepikhin , Minh-Thang Luong , Orhan Firat

Mixture-of-Experts (MoE) models are widely used to scale language models, yet their expert routing behavior and adaptation in a multilingual setting remain underexplored. In this work, we study multilingual routing dynamics during continual…

Computation and Language · Computer Science 2026-05-29 Aditi Khandelwal , Marius Mosbach , Verna Dankers , Siva Reddy , Golnoosh Farnadi