English
Related papers

Related papers: Mixtures of SubExperts for Large Language Continua…

200 papers

Mixture-of-Experts (MoE) models are widely used to scale language models, yet their expert routing behavior and adaptation in a multilingual setting remain underexplored. In this work, we study multilingual routing dynamics during continual…

Computation and Language · Computer Science 2026-05-29 Aditi Khandelwal , Marius Mosbach , Verna Dankers , Siva Reddy , Golnoosh Farnadi

Parameter-efficient fine-tuning (PEFT) has become a common method for fine-tuning large language models, where a base model can serve multiple users through PEFT module switching. To enhance user experience, base models require periodic…

Computation and Language · Computer Science 2025-06-10 Naibin Gu , Peng Fu , Xiyu Liu , Ke Ma , Zheng Lin , Weiping Wang

Large Language Models (LLMs) need to adapt to the continuous changes in data, tasks, and user preferences. Due to their massive size and the high costs associated with training, LLMs are not suitable for frequent retraining. However,…

Computation and Language · Computer Science 2024-12-11 Dongfang Li , Zetian Sun , Xinshuo Hu , Baotian Hu , Min Zhang

Fine-tuning Large Language Models (LLMs) is a common practice to adapt pre-trained models for specific applications. While methods like LoRA have effectively addressed GPU memory constraints during fine-tuning, their performance often falls…

Computation and Language · Computer Science 2024-07-23 Dengchun Li , Yingzi Ma , Naizheng Wang , Zhengmao Ye , Zhiyuan Cheng , Yinghao Tang , Yan Zhang , Lei Duan , Jie Zuo , Cal Yang , Mingjie Tang

Sparse Mixture-of-Experts (MoE) has been a successful approach for scaling multilingual translation models to billions of parameters without a proportional increase in training computation. However, MoE models are prohibitively large and…

Computation and Language · Computer Science 2021-10-11 Sneha Kudugunta , Yanping Huang , Ankur Bapna , Maxim Krikun , Dmitry Lepikhin , Minh-Thang Luong , Orhan Firat

Mixture-of-Experts (MoE) models are designed to enhance the efficiency of large language models (LLMs) without proportionally increasing the computational demands. However, their deployment on edge devices still faces significant challenges…

Machine Learning · Computer Science 2024-08-21 Shuzhang Zhong , Ling Liang , Yuan Wang , Runsheng Wang , Ru Huang , Meng Li

Adapting pre-trained vision models using parameter-efficient fine-tuning (PEFT) remains challenging, as it aims to achieve performance comparable to full fine-tuning using a minimal number of trainable parameters. When applied to complex…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Meng Lou , Stanley Yu , Yizhou Yu

In deep learning, models typically reuse the same parameters for all inputs. Mixture of Experts (MoE) defies this and instead selects different parameters for each incoming example. The result is a sparsely-activated model -- with…

Machine Learning · Computer Science 2022-06-20 William Fedus , Barret Zoph , Noam Shazeer

With the continuous growth in the number of parameters of transformer-based pretrained language models (PLMs), particularly the emergence of large language models (LLMs) with billions of parameters, many natural language processing (NLP)…

Computation and Language · Computer Science 2023-12-20 Lingling Xu , Haoran Xie , Si-Zhao Joe Qin , Xiaohui Tao , Fu Lee Wang

Recent advances in reinforcement learning (RL) have substantially improved the training of large-scale language models, leading to significant gains in generation quality and reasoning ability. However, most existing research focuses on…

Machine Learning · Computer Science 2026-01-13 Di Zhang , Xun Wu , Shaohan Huang , Lingjie Jiang , Yaru Hao , Li Dong , Zewen Chi , Zhifang Sui , Furu Wei

Fine-tuning large language models (LLMs) on downstream tasks requires substantial computational resources. Selective PEFT, a class of parameter-efficient fine-tuning (PEFT) methodologies, aims to mitigate these computational challenges by…

Computation and Language · Computer Science 2025-06-24 Aradhye Agarwal , Suhas K Ramesh , Ayan Sengupta , Tanmoy Chakraborty

The advent of Large Language Models (LLMs) has ushered in a new era of artificial intelligence, with the potential to transform various sectors through automation and insightful analysis. The Mixture of Experts (MoE) architecture has been…

Machine Learning · Computer Science 2024-10-22 Xurui Li , Juanjuan Yao

To meet the growing demand for smarter, faster, and more efficient embodied AI solutions, we introduce a novel Mixture-of-Expert (MoE) method that significantly boosts reasoning and learning efficiency for embodied autonomous systems.…

Artificial Intelligence · Computer Science 2025-08-14 Lu Xu , Jiaqian Yu , Xiongfeng Peng , Yiwei Chen , Weiming Li , Jaewook Yoo , Sunghyun Chunag , Dongwook Lee , Daehyun Ji , Chao Zhang

The success of large language models (LLMs), like GPT-4 and ChatGPT, has led to the development of numerous cost-effective and accessible alternatives that are created by finetuning open-access LLMs with task-specific data (e.g.,…

Computation and Language · Computer Science 2023-10-10 Zhiqiang Hu , Lei Wang , Yihuai Lan , Wanyu Xu , Ee-Peng Lim , Lidong Bing , Xing Xu , Soujanya Poria , Roy Ka-Wei Lee

Mixture of Experts (MoE) has become a mainstream architecture for building Large Language Models (LLMs) by reducing per-token computation while enabling model scaling. It can be viewed as partitioning a large Feed-Forward Network (FFN) at…

Machine Learning · Computer Science 2025-08-27 Weilin Cai , Le Qin , Shwai He , Junwei Cui , Ang Li , Jiayi Huang

Mixture-of-Experts (MoE) has gained increasing popularity as a promising framework for scaling up large language models (LLMs). However, the reliability assessment of MoE lags behind its surging applications. Moreover, when transferred to…

Machine Learning · Computer Science 2024-06-18 Guanjie Chen , Xinyu Zhao , Tianlong Chen , Yu Cheng

Mixture-of-Experts (MoE) is an emerging technique for scaling large models with sparse activation. MoE models are typically trained in a distributed manner with an expert parallelism scheme, where experts in each MoE layer are distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-26 Fahao Chen , Peng Li , Zicong Hong , Zhou Su , Song Guo

Mixture-of-Experts (MoE) has become a prevalent backbone for large vision-language models (VLMs), yet how modality-specific signals should guide expert routing remains under-explored. Existing routing strategies are either hand-crafted or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Zi-Hao Bo , Yaqian Li , Anzhou Hou , Rinyoichi Takezoe , Ertao Zhao , Tianxiang Pan , Jiale Yan , Mo Guang , Kaiwen Long

Solving multi-objective optimization problems for large deep neural networks is a challenging task due to the complexity of the loss landscape and the expensive computational cost of training and evaluating models. Efficient Pareto front…

Machine Learning · Computer Science 2024-06-17 Anke Tang , Li Shen , Yong Luo , Shiwei Liu , Han Hu , Bo Du

Multimodal Large Language Models (MLLMs) achieve strong performance through instruction tuning, but real-world deployment requires them to continually expand their capabilities, making Multimodal Continual Instruction Tuning (MCIT)…

Machine Learning · Computer Science 2026-05-28 Zhen-Hao Xie , Jun-Tao Tang , Yu-Cheng Shi , Han-Jia Ye , De-Chuan Zhan , Da-Wei Zhou