English
Related papers

Related papers: Dynamic Data Mixing Maximizes Instruction Tuning f…

200 papers

We propose a novel adaptive Mixture-of-Experts (MoE) framework for time series forecasting that enhances expert specialization by incorporating expert-specific loss information directly into the training process. Notably, the overall…

Machine Learning · Statistics 2026-05-12 Btissame El Mahtout , Florian Ziel

The challenge of building neural networks that can continuously learn and adapt to evolving data streams is central to the fields of continual learning (CL) and reinforcement learning (RL). This lifelong learning problem is often framed in…

Machine Learning · Computer Science 2025-11-25 Donghu Kim

Multilevel data are prevalent in many real-world applications. However, it remains an open research problem to identify and justify a class of models that flexibly capture a wide range of multilevel data. Motivated by the versatility of the…

Statistics Theory · Mathematics 2022-10-03 Tsz Chai Fung , Spark C. Tseung

Mixture-of-Experts (MoE) models have gained popularity in achieving state-of-the-art performance in a wide range of tasks in computer vision and natural language processing. They effectively expand the model capacity while incurring a…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-21 Haiyang Huang , Newsha Ardalani , Anna Sun , Liu Ke , Hsien-Hsin S. Lee , Anjali Sridhar , Shruti Bhosale , Carole-Jean Wu , Benjamin Lee

Traditional multi-task learning (MTL) methods use dense networks that use the same set of shared weights across several different tasks. This often creates interference where two or more tasks compete to pull model parameters in different…

Large language models (LLMs) are typically fine-tuned on diverse and extensive datasets sourced from various origins to develop a comprehensive range of skills, such as writing, reasoning, chatting, coding, and more. Each skill has unique…

Computation and Language · Computer Science 2024-10-08 Minghao Wu , Thuy-Trang Vu , Lizhen Qu , Gholamreza Haffari

Mixture of Experts (MoE) is able to scale up vision transformers effectively. However, it requires prohibiting computation resources to train a large MoE transformer. In this paper, we propose Residual Mixture of Experts (RMoE), an…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Lemeng Wu , Mengchen Liu , Yinpeng Chen , Dongdong Chen , Xiyang Dai , Lu Yuan

Mixture-of-Experts (MoE) models have become a widely-adopted solution to continue scaling model sizes without a corresponding linear increase in compute. During MoE model training, each input token is dynamically routed to a subset of…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-20 Athinagoras Skiadopoulos , Mark Zhao , Swapnil Gandhi , Thomas Norrie , Shrijeet Mukherjee , Christos Kozyrakis

Mixture-of-Experts (MoE) represents an ensemble methodology that amalgamates predictions from several specialized sub-models (referred to as experts). This fusion is accomplished through a router mechanism, dynamically assigning weights to…

Machine Learning · Computer Science 2024-03-27 Jinze Zhao , Peihao Wang , Zhangyang Wang

Multi-task learning (MTL) leverages a shared model to accomplish multiple tasks and facilitate knowledge transfer. Recent research on task arithmetic-based MTL demonstrates that merging the parameters of independently fine-tuned models can…

Machine Learning · Computer Science 2024-10-30 Li Shen , Anke Tang , Enneng Yang , Guibing Guo , Yong Luo , Lefei Zhang , Xiaochun Cao , Bo Du , Dacheng Tao

The Mixture of Experts (MoE) is an advanced model architecture in the industry that combines multiple specialized expert models from various domains into a single supermodel. This approach enables the model to scale without significantly…

Machine Learning · Computer Science 2024-11-04 Jingming Guo , Yan Liu , Yu Meng , Zhiwei Tao , Banglan Liu , Gang Chen , Xiang Li

Mixtures of Experts (MoEs) have gained prominence in (self-)supervised learning due to their enhanced inference efficiency, adaptability to distributed training, and modularity. Previous research has illustrated that MoEs can significantly…

Machine Learning · Computer Science 2024-06-27 Timon Willi , Johan Obando-Ceron , Jakob Foerster , Karolina Dziugaite , Pablo Samuel Castro

Data-driven weather models have recently achieved state-of-the-art performance, yet progress has plateaued in recent years. This paper introduces a Mixture of Experts (MoWE) approach as a novel paradigm to overcome these limitations, not by…

As foundational models reshape scientific discovery, a bottleneck persists in dynamical system reconstruction (DSR): the ability to learn across system hierarchies. Many meta-learning approaches have been applied successfully to single…

Machine Learning · Computer Science 2025-06-12 Roussel Desmond Nzoyem , Grant Stevens , Amarpal Sahota , David A. W. Barton , Tom Deakin

Mixture of Experts (MoE) models enable parameter-efficient scaling through sparse expert activations, yet optimizing their inference and memory costs remains challenging due to limited understanding of their specialization behavior. We…

Machine Learning · Computer Science 2026-03-09 Marmik Chaudhari , Idhant Gulati , Nishkal Hundia , Pranav Karra , Shivam Raval

Mixture-of-Experts (MoE) is an emerging technique for scaling large models with sparse activation. MoE models are typically trained in a distributed manner with an expert parallelism scheme, where experts in each MoE layer are distributed…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-26 Fahao Chen , Peng Li , Zicong Hong , Zhou Su , Song Guo

Mixture-of-Experts large language models (MoE-LLMs) marks a significant step forward of language models, however, they encounter two critical challenges in practice: 1) expert parameters lead to considerable memory consumption and loading…

Machine Learning · Computer Science 2025-02-25 Wei Huang , Yue Liao , Jianhui Liu , Ruifei He , Haoru Tan , Shiming Zhang , Hongsheng Li , Si Liu , Xiaojuan Qi

In this paper, we tackle the problem of domain shift. Most existing methods perform training on multiple source domains using a single model, and the same trained model is used on all unseen target domains. Such solutions are sub-optimal as…

Machine Learning · Computer Science 2023-01-13 Tao Zhong , Zhixiang Chi , Li Gu , Yang Wang , Yuanhao Yu , Jin Tang

Mixture-of-Experts (MoE) networks have been proposed as an efficient way to scale up model capacity and implement conditional computing. However, the study of MoE components mostly focused on the feedforward layer in Transformer…

Computation and Language · Computer Science 2022-10-12 Xiaofeng Zhang , Yikang Shen , Zeyu Huang , Jie Zhou , Wenge Rong , Zhang Xiong

Mixture of Experts (MoE) is a popular framework in the fields of statistics and machine learning for modeling heterogeneity in data for regression, classification and clustering. MoE for continuous data are usually based on the normal…

Methodology · Statistics 2016-12-22 Faicel Chamroukhi