English
Related papers

Related papers: When Does Sparse MoE Help in Vision? The Role of B…

200 papers

Mixture-of-Experts (MoE) architectures enable conditional computation by activating only a subset of model parameters for each input. Although sparse routing has been highly effective in language models and has also shown promise in vision,…

Machine Learning · Computer Science 2026-04-07 Vadim Vashkelis , Natalia Trukhina

Machine learning models based on the aggregated outputs of submodels, either at the activation or prediction levels, often exhibit strong performance compared to individual models. We study the interplay of two popular classes of such…

Mixture-of-Experts models enable large language models to scale efficiently, as they only activate a subset of experts for each input. Their core mechanisms, Top-k routing and auxiliary load balancing, remain heuristic, however, lacking a…

Machine Learning · Computer Science 2026-01-08 Ye Su , Yong Liu

Mixture-of-Experts (MoE) architectures achieve scalable capacity through sparse routing, yet the geometric structure of expert specialization remains poorly understood. We introduce a unified Jacobian-PCA-Grassmann framework for analyzing…

Machine Learning · Computer Science 2026-05-19 Feilong Liu

Understanding the internal organization of neural networks remains a fundamental challenge in deep learning interpretability. We address this challenge by exploring a novel Sparse Mixture of Experts Variational Autoencoder (SMoE-VAE)…

Machine Learning · Computer Science 2025-09-15 Strahinja Nikolic , Ilker Oguz , Demetri Psaltis

Mixture of Experts (MoE) pretraining is more scalable than dense Transformer pretraining, because MoEs learn to route inputs to a sparse set of their feedforward parameters. However, this means that MoEs only receive a sparse backward…

Machine Learning · Computer Science 2025-11-05 Ashwinee Panda , Vatsal Baherwani , Zain Sarwar , Benjamin Therien , Sambit Sahu , Tom Goldstein , Supriyo Chakraborty

Mixture of Experts (MoE) achieve parameter-efficient scaling through sparse expert routing, yet their internal representations remain poorly understood compared to dense models. We present a systematic comparison of MoE and dense model…

Machine Learning · Computer Science 2026-03-09 Marmik Chaudhari , Nishkal Hundia , Idhant Gulati

Mixture of Experts (MoE) models have enabled the scaling of Large Language Models (LLMs) and Vision Language Models (VLMs) by achieving massive parameter counts while maintaining computational efficiency. However, MoEs introduce several…

Mixture-of-Experts (MoE) architectures expand model capacity by sparsely activating experts but face two core challenges: misalignment between router logits and each expert's internal structure leads to unstable routing and expert…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Anzhe Cheng , Shukai Duan , Shixuan Li , Chenzhong Yin , Mingxi Cheng , Heng Ping , Tamoghna Chattopadhyay , Sophia I Thomopoulos , Shahin Nazarian , Paul Thompson , Paul Bogdan

The sparsely activated mixture of experts (MoE) model presents a promising alternative to traditional densely activated (dense) models, enhancing both quality and computational efficiency. However, training MoE models from scratch demands…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Xingkui Zhu , Yiran Guan , Dingkang Liang , Yuchao Chen , Yuliang Liu , Xiang Bai

In this paper, we explore a strategy that uses Mixture-of-Experts (MoE) to streamline, rather than augment, vision transformers. Each expert in an MoE layer is a SwiGLU feedforward network, where V and W2 are shared across the layer. No…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Jen Hong Tan

We propose Tensor-Trained Low-Rank Adaptation Mixture of Experts (TT-LoRA MoE), a novel computational framework integrating Parameter-Efficient Fine-Tuning (PEFT) with sparse MoE routing to address scalability challenges in large model…

Machine Learning · Computer Science 2026-01-27 Pradip Kunwar , Minh N. Vu , Maanak Gupta , Mahmoud Abdelsalam , Manish Bhattarai

Sparse Mixture-of-Experts (MoE) models can outperform dense large language models at similar computation by activating only a small set of experts per token. However, stacking many expert modules introduces substantial parameter memory,…

Artificial Intelligence · Computer Science 2026-04-03 Xin He , Shunkang Zhang , Kaijie Tang , Shaohuai Shi , Yuxin Wang , Zihao Zeng , Zhenheng Tang , Xiaowen Chu , Haiyan Yin , Ivor W. Tsang , Yew Soon Ong

The Mixture-of-Experts (MoE) approach has demonstrated outstanding scalability in multi-task learning including low-level upstream tasks such as concurrent removal of multiple adverse weather effects. However, the conventional MoE…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Rongyu Zhang , Yulin Luo , Jiaming Liu , Huanrui Yang , Zhen Dong , Denis Gudovskiy , Tomoyuki Okuno , Yohei Nakata , Kurt Keutzer , Yuan Du , Shanghang Zhang

Mixture of Experts (MoE) is able to scale up vision transformers effectively. However, it requires prohibiting computation resources to train a large MoE transformer. In this paper, we propose Residual Mixture of Experts (RMoE), an…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Lemeng Wu , Mengchen Liu , Yinpeng Chen , Dongdong Chen , Xiyang Dai , Lu Yuan

Mixture-of-Experts (MoE) models scale large language models efficiently by sparsely activating experts, but once an expert is selected, it is executed fully. Hence, the trade-off between accuracy and computation in an MoE model typically…

Machine Learning · Computer Science 2026-02-09 Nurbek Tastan , Stefanos Laskaridis , Karthik Nandakumar , Samuel Horvath

Routing networks in sparsely activated mixture-of-experts (MoE) dynamically allocate input tokens to top-k experts through differentiable sparse transformations, enabling scalable model capacity while preserving computational efficiency.…

Machine Learning · Computer Science 2025-08-19 Bowen Dong , Yilong Fan , Yutao Sun , Zhenyu Li , Tengyu Pan , Xun Zhou , Jianyong Wang

Sparse mixture of experts (SMoE) offers an appealing solution to scale up the model complexity beyond the mean of increasing the network's depth or width. However, effective training of SMoE has proven to be challenging due to the…

The Mixture-of-Experts (MoE) architecture has become a predominant paradigm for scaling large language models (LLMs). Despite offering strong performance and computational efficiency, large MoE-based LLMs like DeepSeek-V3-0324 and…

Machine Learning · Computer Science 2025-08-08 Xiaodong Chen , Mingming Ha , Zhenzhong Lan , Jing Zhang , Jianguo Li

Mixture-of-experts networks (MoEs) have demonstrated remarkable efficiency in modern deep learning. Despite their empirical success, the theoretical foundations underlying their ability to model complex tasks remain poorly understood. In…

Machine Learning · Computer Science 2026-02-19 Mingze Wang , Weinan E