English
Related papers

Related papers: When Does Sparse MoE Help in Vision? The Role of B…

200 papers

The sparsely-gated Mixture of Experts (MoE) can magnify a network capacity with a little computational complexity. In this work, we investigate how multi-lingual Automatic Speech Recognition (ASR) networks can be scaled up with a simple…

Computation and Language · Computer Science 2022-01-05 Kenichi Kumatani , Robert Gmyr , Felipe Cruz Salinas , Linquan Liu , Wei Zuo , Devang Patel , Eric Sun , Yu Shi

Sparse Mixture-of-Experts (SMoE) models enable scaling language models efficiently, but training them remains challenging, as routing can collapse onto few experts and auxiliary load-balancing losses can reduce specialization. Motivated by…

Machine Learning · Computer Science 2026-05-13 Sagi Ahrac , Noya Hochwald , Mor Geva

Mixture-of-Expert (MoE) models have obtained state-of-the-art performance in Neural Machine Translation (NMT) tasks. Existing works in MoE mostly consider a homogeneous design where the same number of experts of the same size are placed…

Mixture-of-Experts (MoE) has emerged as a prominent architecture for scaling model size while maintaining computational efficiency. In MoE, each token in the input sequence activates a different subset of experts determined by a routing…

Computation and Language · Computer Science 2024-11-05 Chufan Shi , Cheng Yang , Xinyu Zhu , Jiahao Wang , Taiqiang Wu , Siheng Li , Deng Cai , Yujiu Yang , Yu Meng

Sparse Mixture-of-Experts (MoE) has been a successful approach for scaling multilingual translation models to billions of parameters without a proportional increase in training computation. However, MoE models are prohibitively large and…

Computation and Language · Computer Science 2021-10-11 Sneha Kudugunta , Yanping Huang , Ankur Bapna , Maxim Krikun , Dmitry Lepikhin , Minh-Thang Luong , Orhan Firat

Multimodal large language models (MLLMs) have achieved impressive performance, but high-resolution visual inputs result in long sequences of visual tokens and substantial inference latency. Reducing redundant visual tokens is critical to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Guoyang Xia , Yifeng Ding , Fengfa Li , Lei Ren , Wei Chen , Fangxiang Feng , Xiaojie Wang

Scaling large language models has driven remarkable advancements across various domains, yet the continual increase in model size presents significant challenges for real-world deployment. The Mixture of Experts (MoE) architecture offers a…

Machine Learning · Computer Science 2025-03-18 Shwai He , Daize Dong , Liang Ding , Ang Li

Mixture of experts (MoE) architectures have become a cornerstone for scaling up and are a key component in most large language models such as GPT-OSS, DeepSeek-V3, Llama-4, and Gemini-2.5. However, systematic research on MoE remains…

Computation and Language · Computer Science 2026-02-11 Nam V. Nguyen , Thong T. Doan , Luong Tran , Van Nguyen , Quang Pham

Mixture-of-experts (MoE) models enable scalable transformer architectures by activating only a subset of experts per token. Recent evidence suggests that performance improves with increasingly granular experts, i.e., many small experts…

Machine Learning · Computer Science 2026-05-07 Klaus-Rudolf Kladny , Maximilian Mordig , Bernhard Schölkopf , Michael Muehlebach

Sparsely-gated mixture-of-experts (MoE) has been widely adopted to scale deep learning models to trillion-plus parameters with fixed computational cost. The algorithmic performance of MoE relies on its token routing mechanism that forwards…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-06 Changho Hwang , Wei Cui , Yifan Xiong , Ziyue Yang , Ze Liu , Han Hu , Zilong Wang , Rafael Salas , Jithin Jose , Prabhat Ram , Joe Chau , Peng Cheng , Fan Yang , Mao Yang , Yongqiang Xiong

Sparse Mixture-of-Experts (MoE) layers route tokens through a handful of experts, and learning-free compression of these layers reduces inference cost without retraining. A subtle obstruction blocks every existing compressor in this family:…

Machine Learning · Computer Science 2026-05-15 Tao Zhong , Dongzhe Zheng , Christine Allen-Blanchette

We focus on multi-domain Neural Machine Translation, with the goal of developing efficient models which can handle data from various domains seen during training and are robust to domains unseen during training. We hypothesize that Sparse…

Computation and Language · Computer Science 2024-07-02 Nadezhda Chirkova , Vassilina Nikoulina , Jean-Luc Meunier , Alexandre Bérard

Mixture-of-Experts (MoE) architectures are widely used in modern large language models and multimodal models. However, inference efficiency is often limited by highly dynamic and skewed expert workloads across different modalities. During…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-12 Yingping Wang , Yi Wu , Xiangyu Wu , Junwei Cui , Weilin Cai , Zhijiang Guo , Jiayi Huang

The advent of 6G/NextG networks comes along with a series of benefits, including extreme capacity, reliability, and efficiency. However, these networks may become vulnerable to new security threats. Therefore, 6G/NextG networks must be…

Machine Learning · Computer Science 2025-05-16 Loukas Ilias , George Doukas , Vangelis Lamprou , Christos Ntanos , Dimitris Askounis

Mixture-of-Experts (MoE) architectures leverage sparse activation to enhance the scalability of large language models (LLMs), making them suitable for deployment in resource-constrained edge networks. However, the sheer number of experts…

Information Theory · Computer Science 2026-03-26 Qian Chen , Xianhao Chen , Kaibin Huang

Mixture-of-Experts (MoE) models achieve a favorable trade-off between performance and inference efficiency by activating only a subset of experts. However, the memory overhead of storing all experts remains a major limitation, especially in…

Computation and Language · Computer Science 2025-05-29 Zican Dong , Han Peng , Peiyu Liu , Wayne Xin Zhao , Dong Wu , Feng Xiao , Zhifeng Wang

Amodal segmentation targets to predict complete object masks, covering both visible and occluded regions. This task poses significant challenges due to complex occlusions and extreme shape variation, from rigid furniture to highly…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Zhixuan Li , Yujia Liu , Chen Hui , Jeonghaeng Lee , Sanghoon Lee , Weisi Lin

Mixture-of-Experts (MoE) networks have been proposed as an efficient way to scale up model capacity and implement conditional computing. However, the study of MoE components mostly focused on the feedforward layer in Transformer…

Computation and Language · Computer Science 2022-10-12 Xiaofeng Zhang , Yikang Shen , Zeyu Huang , Jie Zhou , Wenge Rong , Zhang Xiong

Mixture-of-Experts (MoE) models have gained popularity as a means of scaling the capacity of large language models (LLMs) while maintaining sparse activations and reduced per-token compute. However, in memory-constrained inference settings,…

Machine Learning · Computer Science 2026-03-23 Vivan Madan , Prajwal Singhania , Abhinav Bhatele , Tom Goldstein , Ashwinee Panda

Mixture of Experts (MoE) architectures increase large language model scalability, yet their performance depends on the router module that moves tokens to specialized experts. Bad routing can load imbalance and reduced accuracy. This project…

Machine Learning · Computer Science 2025-06-23 Daniel Fidel Harvey , George Weale , Berk Yilmaz