English
Related papers

Related papers: Scaling Vision-Language Models with Sparse Mixture…

200 papers

Mixture of Experts (MoE) models with conditional execution of sparsely activated layers have enabled training models with a much larger number of parameters. As a result, these models have achieved significantly better quality on various…

Computation and Language · Computer Science 2022-11-21 Young Jin Kim , Rawn Henry , Raffy Fahim , Hany Hassan Awadalla

Sparsely gated Mixture of Experts (MoE) models have been shown to be a compute-efficient method to scale model capacity for multilingual machine translation. However, for low-resource tasks, MoE models severely over-fit. We show effective…

Computation and Language · Computer Science 2022-12-19 Maha Elbayad , Anna Sun , Shruti Bhosale

Mixture-of-Experts (MoE) decouples model capacity from per-token computation, yet their scalability remains limited by the physical dimensions of depth and width. To overcome this, we propose Mixture of Universal Experts (MOUE),a MoE…

Machine Learning · Computer Science 2026-03-06 Yilong Chen , Naibin Gu , Junyuan Shang , Zhenyu Zhang , Yuchen Feng , Jiawei Sheng , Tingwen Liu , Shuohuan Wang , Yu Sun , Hua Wu , Haifeng Wang

Due to the inherent difficulty in modeling phonetic similarities across different languages, code-switching speech recognition presents a formidable challenge. This study proposes a Collaborative-MoE, a Mixture of Experts (MoE) model that…

Computation and Language · Computer Science 2024-09-06 Hukai Huang , Jiayan Lin , Kaidi Wang , Yishuang Li , Wenhao Guan , Lin Li , Qingyang Hong

The advent of Large Language Models (LLMs) has significantly reshaped the trajectory of the AI revolution. Nevertheless, these LLMs exhibit a notable limitation, as they are primarily adept at processing textual information. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Akash Ghosh , Arkadeep Acharya , Sriparna Saha , Vinija Jain , Aman Chadha

Scale has opened new frontiers in natural language processing -- but at a high cost. In response, Mixture-of-Experts (MoE) and Switch Transformers have been proposed as an energy efficient path to even larger and more capable language…

Computation and Language · Computer Science 2022-05-03 Barret Zoph , Irwan Bello , Sameer Kumar , Nan Du , Yanping Huang , Jeff Dean , Noam Shazeer , William Fedus

Mixture-of-Experts (MoE) has become a dominant architecture for scaling Large Language Models (LLMs) efficiently by decoupling total parameters from computational cost. However, this decoupling creates a critical challenge: predicting the…

Computation and Language · Computer Science 2025-10-22 Changxin Tian , Kunlong Chen , Jia Liu , Ziqi Liu , Zhiqiang Zhang , Jun Zhou

Scaling Mixture-of-Experts (MoE) training introduces systems challenges absent in dense models. Because each token activates only a subset of experts, this sparsity allows total parameters to grow much faster than per-token computation,…

The proliferation of large language models (LLMs) has led to the adoption of Mixture-of-Experts (MoE) architectures that dynamically leverage specialized subnetworks for improved efficiency and performance. Despite their benefits, MoE…

Computation and Language · Computer Science 2024-10-28 Ruisi Cai , Yeonju Ro , Geon-Woo Kim , Peihao Wang , Babak Ehteshami Bejnordi , Aditya Akella , Zhangyang Wang

Mixture-of-Experts (MoE) models have become the consensus approach for enabling parameter-efficient scaling and cost-effective deployment in large language models. However, existing scaling laws for dense models are inapplicable to MoE…

The emergence of Mixture of Experts (MoE) LLMs has significantly advanced the development of language models. Compared to traditional LLMs, MoE LLMs outperform traditional LLMs by achieving higher performance with considerably fewer…

Machine Learning · Computer Science 2024-11-05 Cheng Yang , Yang Sui , Jinqi Xiao , Lingyi Huang , Yu Gong , Yuanlin Duan , Wenqi Jia , Miao Yin , Yu Cheng , Bo Yuan

Large Language Models (LLMs) have demonstrated remarkable abilities in tackling a wide range of complex tasks. However, their huge computational and memory costs raise significant challenges in deploying these models on resource-constrained…

Model editing aims to efficiently alter the behavior of Large Language Models (LLMs) within a desired scope, while ensuring no adverse impact on other inputs. Recent years have witnessed various model editing methods been proposed. However,…

Computation and Language · Computer Science 2024-06-04 Renzhi Wang , Piji Li

Mixture-of-Experts (MoE) presents a naturally compatible and scalable framework for multimodal learning, demonstrating strong adaptability across diverse modalities and tasks. Despite its growing success, a comprehensive and systematic…

Machine Learning · Computer Science 2026-05-28 Liangwei Nathan Zheng , Wei Emma Zhang , Olaf Maennel , Lin Yue , Weitong Chen

Large Language Models (LLMs) have achieved significant success in various natural language processing tasks, but how wireless communications can support LLMs has not been extensively studied. In this paper, we propose a wireless distributed…

Information Theory · Computer Science 2024-05-07 Nan Xue , Yaping Sun , Zhiyong Chen , Meixia Tao , Xiaodong Xu , Liang Qian , Shuguang Cui , Ping Zhang

Vision-Language Models (VLMs) based on Mixture-of-Experts (MoE) architectures have emerged as a pivotal paradigm in multimodal understanding, offering a powerful framework for integrating visual and linguistic information. However, the…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Xiaoda Yang , JunYu Lu , Hongshun Qiu , Sijing Li , Hao Li , Shengpeng Ji , Xudong Tang , Jiayang Xu , Jiaqi Duan , Ziyue Jiang , Cong Lin , Sihang Cai , Zejian Xie , Zhuoyang Song , Songxin Zhang

Multilingual speech recognition for both monolingual and code-switching speech is a challenging task. Recently, based on the Mixture of Experts (MoE), many works have made good progress in multilingual and code-switching ASR, but present…

Sound · Computer Science 2023-07-17 Wenxuan Wang , Guodong Ma , Yuke Li , Binbin Du

Sparse Mixture of Experts (SMoE) has become the key to unlocking unparalleled scalability in deep learning. SMoE has the potential to exponentially increase parameter count while maintaining the efficiency of the model by only activating a…

Machine Learning · Computer Science 2024-10-21 Rachel S. Y. Teo , Tan M. Nguyen

Mixture of Experts (MoE) architectures have recently advanced the scalability and adaptability of large language models (LLMs) for continual multimodal learning. However, efficiently extending these models to accommodate sequential tasks…

Computation and Language · Computer Science 2025-06-26 Hengyuan Zhao , Ziqin Wang , Qixin Sun , Kaiyou Song , Yilin Li , Xiaolin Hu , Qingpei Guo , Si Liu

Vision-Language Models (VLMs) have demonstrated remarkable proficiency in general multi-modal understanding; yet they struggle to efficiently acquire continually evolving domain-specific skills. Conventional approaches to enhancing VLM…

Computation and Language · Computer Science 2026-05-20 Zhiyu Xu , Lean Wang , Yuanxin Liu , Lei Li , Hao Zhou , Fandong Meng , Jie Zhou , Xu Sun