English
Related papers

Related papers: Grouter: Decoupling Routing from Representation fo…

200 papers

Mixture of Experts (MoE) is able to scale up vision transformers effectively. However, it requires prohibiting computation resources to train a large MoE transformer. In this paper, we propose Residual Mixture of Experts (RMoE), an…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Lemeng Wu , Mengchen Liu , Yinpeng Chen , Dongdong Chen , Xiyang Dai , Lu Yuan

Mixture-of-Experts (MoE) models mostly use a router to assign tokens to specific expert modules, activating only partial parameters and often outperforming dense models. We argue that the separation between the router's decision-making and…

Computation and Language · Computer Science 2025-06-02 Ang Lv , Ruobing Xie , Yining Qian , Songhao Wu , Xingwu Sun , Zhanhui Kang , Di Wang , Rui Yan

Solving multi-objective optimization problems for large deep neural networks is a challenging task due to the complexity of the loss landscape and the expensive computational cost of training and evaluating models. Efficient Pareto front…

Machine Learning · Computer Science 2024-06-17 Anke Tang , Li Shen , Yong Luo , Shiwei Liu , Han Hu , Bo Du

Mixture-of-Experts (MoE) architectures have emerged as a key strategy for scaling large language models (LLMs) efficiently. However, current MoE systems suffer from severe load imbalance, where only a small subset of experts is consistently…

Machine Learning · Computer Science 2025-06-27 Jiajie Yang

Scaling the size of a model enhances its capabilities but significantly increases computation complexity. Mixture-of-Experts models (MoE) address the issue by allowing model size to scale up without substantially increasing training or…

Computation and Language · Computer Science 2024-08-30 Zhenpeng Su , Zijia Lin , Xue Bai , Xing Wu , Yizhe Xiong , Haoran Lian , Guangyuan Ma , Hui Chen , Guiguang Ding , Wei Zhou , Songlin Hu

Class-incremental learning (CIL) requires deep learning models to continuously acquire new knowledge from streaming data while preserving previously learned information. Recently, CIL based on pre-trained models (PTMs) has achieved…

Machine Learning · Computer Science 2025-06-16 Linjie Li , Zhenyu Wu , Yang Ji

Mixture-of-Experts (MoE) architectures enable efficient model scaling, yet expert routing behavior across underrepresented languages remains poorly understood. We analyze routing dynamics in two architecturally distinct MoE models -- a pure…

Computation and Language · Computer Science 2026-05-19 Ori Bar Joseph , Smadar Arvatz , Noam Kayzer , Dan Revital , Sarel Weinberger

To meet the growing demand for smarter, faster, and more efficient embodied AI solutions, we introduce a novel Mixture-of-Expert (MoE) method that significantly boosts reasoning and learning efficiency for embodied autonomous systems.…

Artificial Intelligence · Computer Science 2025-08-14 Lu Xu , Jiaqian Yu , Xiongfeng Peng , Yiwei Chen , Weiming Li , Jaewook Yoo , Sunghyun Chunag , Dongwook Lee , Daehyun Ji , Chao Zhang

Sparsely activated Mixture-of-Experts (MoE) models effectively increase the number of parameters while maintaining consistent computational costs per token. However, vanilla MoE models often suffer from limited diversity and specialization…

Machine Learning · Computer Science 2025-07-11 Lei Kang , Jia Li , Mi Tian , Hua Huang

Mixture-of-Experts (MoE) models have gained popularity in achieving state-of-the-art performance in a wide range of tasks in computer vision and natural language processing. They effectively expand the model capacity while incurring a…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-21 Haiyang Huang , Newsha Ardalani , Anna Sun , Liu Ke , Hsien-Hsin S. Lee , Anjali Sridhar , Shruti Bhosale , Carole-Jean Wu , Benjamin Lee

Recently, mixture of experts (MoE) has become a popular paradigm for achieving the trade-off between modal capacity and efficiency of multi-modal large language models (MLLMs). Different from previous efforts, we are dedicated to exploring…

Multimedia · Computer Science 2025-02-13 Qiong Wu , Zhaoxi Ke , Yiyi Zhou , Xiaoshuai Sun , Rongrong Ji

The Mixture of Experts (MoE) is an advanced model architecture in the industry that combines multiple specialized expert models from various domains into a single supermodel. This approach enables the model to scale without significantly…

Machine Learning · Computer Science 2024-11-04 Jingming Guo , Yan Liu , Yu Meng , Zhiwei Tao , Banglan Liu , Gang Chen , Xiang Li

Sparsely Mixture of Experts (MoE) has received great interest due to its promising scaling capability with affordable computational overhead. MoE converts dense layers into sparse experts, and utilizes a gated routing network to make…

Computation and Language · Computer Science 2022-07-20 Yuan Xie , Shaohan Huang , Tianyu Chen , Furu Wei

The Mixture-of-Expert (MoE) technique plays a crucial role in expanding the size of DNN model parameters. However, it faces the challenge of extended all-to-all communication latency during the training process. Existing methods attempt to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-01 Chenyu Jiang , Ye Tian , Zhen Jia , Shuai Zheng , Chuan Wu , Yida Wang

Mixture-of-Experts (MoE) has successfully scaled up models while maintaining nearly constant computing costs. By employing a gating network to route input tokens, it selectively activates a subset of expert networks to process the…

Machine Learning · Computer Science 2025-04-22 Mohan Zhang , Pingzhi Li , Jie Peng , Mufan Qiu , Tianlong Chen

We introduce a Mixture of Raytraced Experts, a stacked Mixture of Experts (MoE) architecture which can dynamically select sequences of experts, producing computational graphs of variable width and depth. Existing MoE architectures generally…

Machine Learning · Computer Science 2025-07-17 Andrea Perin , Giacomo Lagomarsini , Claudio Gallicchio , Giuseppe Nuti

We introduce MoMa, a novel modality-aware mixture-of-experts (MoE) architecture designed for pre-training mixed-modal, early-fusion language models. MoMa processes images and text in arbitrary sequences by dividing expert modules into…

Artificial Intelligence · Computer Science 2024-08-13 Xi Victoria Lin , Akshat Shrivastava , Liang Luo , Srinivasan Iyer , Mike Lewis , Gargi Ghosh , Luke Zettlemoyer , Armen Aghajanyan

Machine unlearning (MU) for large language models has become critical for AI safety, yet existing methods fail to generalize to Mixture-of-Experts (MoE) architectures. We identify that traditional unlearning methods exploit MoE's…

Machine Learning · Computer Science 2026-02-17 Andy Zhu , Rongzhe Wei , Yupu Gu , Pan Li

Sparsely gated Mixture of Experts (MoE) models have been shown to be a compute-efficient method to scale model capacity for multilingual machine translation. However, for low-resource tasks, MoE models severely over-fit. We show effective…

Computation and Language · Computer Science 2022-12-19 Maha Elbayad , Anna Sun , Shruti Bhosale

Mixture-of-Experts (MoE) architectures enable efficient scaling of large language models by activating only a subset of parameters per input. However, existing MoE models suffer from two critical limitations: (1) inefficient token-to-expert…

Computation and Language · Computer Science 2025-10-10 Jing Li , Zhijie Sun , Dachao Lin , Xuan He , Binfan Zheng , Yi Lin , Rongqian Zhao , Xin Chen