English
Related papers

Related papers: Fusing Models with Complementary Expertise

200 papers

By increasing model parameters but activating them sparsely when performing a task, the use of Mixture-of-Experts (MoE) architecture significantly improves the performance of Large Language Models (LLMs) without increasing the inference…

Computation and Language · Computer Science 2025-06-10 Zeliang Zhang , Xiaodong Liu , Hao Cheng , Chenliang Xu , Jianfeng Gao

Federated fine-tuning of Mixture-of-Experts (MoE)-based large language models (LLMs) is challenging due to their massive computational requirements and the resource constraints of participants. Existing working attempts to fill this gap…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-13 Fahao Chen , Jie Wan , Peng Li , Zhou Su , Dongxiao Yu

Fine-tuning pre-trained language models has become the prevalent paradigm for building downstream NLP models. Oftentimes fine-tuned models are readily available but their training data is not, due to data privacy or intellectual property…

Computation and Language · Computer Science 2025-05-23 Xisen Jin , Xiang Ren , Daniel Preotiuc-Pietro , Pengxiang Cheng

Grounded text generation, encompassing tasks such as long-form question-answering and summarization, necessitates both content selection and content consolidation. Current end-to-end methods are difficult to control and interpret due to…

Computation and Language · Computer Science 2024-04-02 Aviv Slobodkin , Ori Shapira , Ran Levy , Ido Dagan

As Large Language Models (LLMs) push the boundaries of AI capabilities, their demand for data is growing. Much of this data is private and distributed across edge devices, making Federated Learning (FL) a de-facto alternative for…

Machine Learning · Computer Science 2024-08-22 Hanzi Mei , Dongqi Cai , Ao Zhou , Shangguang Wang , Mengwei Xu

Solving multi-objective optimization problems for large deep neural networks is a challenging task due to the complexity of the loss landscape and the expensive computational cost of training and evaluating models. Efficient Pareto front…

Machine Learning · Computer Science 2024-06-17 Anke Tang , Li Shen , Yong Luo , Shiwei Liu , Han Hu , Bo Du

Federated learning (FL) is an emerging distributed machine learning paradigm that avoids data sharing among training nodes so as to protect data privacy. Under coordination of the FL server, each client conducts model training using its own…

Machine Learning · Computer Science 2021-01-01 Binbin Guo , Yuan Mei , Danyang Xiao , Weigang Wu , Ye Yin , Hongli Chang

Federated learning (FL) is a distributed machine learning technique in which multiple clients cooperate to train a shared model without exchanging their raw data. However, heterogeneity of data distribution among clients usually leads to…

Machine Learning · Computer Science 2023-03-23 Yu Qiao , Seong-Bae Park , Sun Moo Kang , Choong Seon Hong

Machine learning models often need to adapt to new data after deployment due to structured or unstructured real-world dynamics. The Continual Learning (CL) framework enables continuous model adaptation, but most existing approaches either…

Machine Learning · Computer Science 2026-03-25 Connor Mclaughlin , Nigel Lee , Lili Su

Mixture-of-Experts (MoE) is an emerging technique for scaling large models with sparse activation. MoE models are typically trained in a distributed manner with an expert parallelism scheme, where experts in each MoE layer are distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-26 Fahao Chen , Peng Li , Zicong Hong , Zhou Su , Song Guo

Scaling up the number of parameters of language models has proven to be an effective approach to improve performance. For dense models, increasing model size proportionally increases the model's computation footprint. In this work, we seek…

Computation and Language · Computer Science 2023-11-21 Cicero Nogueira dos Santos , James Lee-Thorp , Isaac Noble , Chung-Ching Chang , David Uthus

The Mixture-of-Experts (MoE) technique has proven to be a promising solution to efficiently scale the model size, which has been widely applied in recent LLM advancements. However, the substantial memory overhead of MoE models has made…

Machine Learning · Computer Science 2025-10-17 Ruijie Miao , Yilun Yao , Zihan Wang , Zhiming Wang , Bairen Yi , LingJun Liu , Yikai Zhao , Tong Yang

Federated learning (FL) is a collaborative machine learning approach that enables multiple clients to train models without sharing their private data. With the rise of deep learning, large-scale models have garnered significant attention…

Machine Learning · Computer Science 2025-09-09 Ziwei Zhan , Wenkuan Zhao , Yuanqing Li , Weijie Liu , Xiaoxi Zhang , Chee Wei Tan , Chuan Wu , Deke Guo , Xu Chen

Mixture of Experts (MoE) has become a key architectural paradigm for efficiently scaling Large Language Models (LLMs) by selectively activating a subset of parameters for each input token. However, standard MoE architectures face…

Machine Learning · Computer Science 2025-05-27 Zehua Liu , Han Wu , Ruifeng She , Xiaojin Fu , Xiongwei Han , Tao Zhong , Mingxuan Yuan

The sparse Mixture-of-Experts (MoE) model is powerful for large-scale pre-training and has achieved promising results due to its model capacity. However, with trillions of parameters, MoE is hard to be deployed on cloud or mobile…

Machine Learning · Computer Science 2022-06-03 Tianyu Chen , Shaohan Huang , Yuan Xie , Binxing Jiao , Daxin Jiang , Haoyi Zhou , Jianxin Li , Furu Wei

Fine-tuning pre-trained models for downstream tasks is a widely adopted technique known for its adaptability and reliability across various domains. Despite its conceptual simplicity, fine-tuning entails several troublesome engineering…

Artificial Intelligence · Computer Science 2024-12-30 Chaeyun Jang , Hyungi Lee , Jungtaek Kim , Juho Lee

Fine-tuning pre-trained language models, particularly large language models, demands extensive computing resources and can result in varying performance outcomes across different domains and datasets. This paper examines the approach of…

Computation and Language · Computer Science 2024-06-19 Guodong Du , Jing Li , Hanting Liu , Runhua Jiang , Shuyang Yu , Yifei Guo , Sim Kuan Goh , Ho-Kin Tang

Mixture of experts (MoE), introduced over 20 years ago, is the simplest gated modular neural network architecture. There is renewed interest in MoE because the conditional computation allows only parts of the network to be used during each…

Machine Learning · Computer Science 2023-03-01 Yamuna Krishnamurthy , Chris Watkins , Thomas Gaertner

Training a general-purpose time series foundation models with robust generalization capabilities across diverse applications from scratch is still an open challenge. Efforts are primarily focused on fusing cross-domain time series datasets…

Machine Learning · Computer Science 2024-12-13 Shengchao Chen , Guodong Long , Jing Jiang , Chengqi Zhang

Mixture-of-Experts (MoE) models have gained popularity as a means of scaling the capacity of large language models (LLMs) while maintaining sparse activations and reduced per-token compute. However, in memory-constrained inference settings,…

Machine Learning · Computer Science 2026-03-23 Vivan Madan , Prajwal Singhania , Abhinav Bhatele , Tom Goldstein , Ashwinee Panda