English
Related papers

Related papers: Taming Latency-Memory Trade-Off in MoE-Based LLM S…

200 papers

To help the open-source community have a better understanding of Mixture-of-Experts (MoE) based large language models (LLMs), we train and release OpenMoE, a series of fully open-sourced and reproducible decoder-only MoE LLMs, ranging from…

Computation and Language · Computer Science 2024-03-28 Fuzhao Xue , Zian Zheng , Yao Fu , Jinjie Ni , Zangwei Zheng , Wangchunshu Zhou , Yang You

Mixture-of-Expert (MoE) based large language models (LLMs), such as the recent Mixtral and DeepSeek-MoE, have shown great promise in scaling model size without suffering from the quadratic growth of training cost of dense transformers. Like…

Machine Learning · Computer Science 2024-04-04 Longfei Yun , Yonghao Zhuang , Yao Fu , Eric P Xing , Hao Zhang

Multimodal large language models (MLLMs) have achieved impressive performance, but high-resolution visual inputs result in long sequences of visual tokens and substantial inference latency. Reducing redundant visual tokens is critical to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Guoyang Xia , Yifeng Ding , Fengfa Li , Lei Ren , Wei Chen , Fangxiang Feng , Xiaojie Wang

The Mixture-of-Experts (MoE) architecture has demonstrated significant advantages in the era of Large Language Models (LLMs), offering enhanced capabilities with reduced inference costs. However, deploying MoE-based LLMs on…

Machine Learning · Computer Science 2024-11-07 Peng Tang , Jiacheng Liu , Xiaofeng Hou , Yifei Pu , Jing Wang , Pheng-Ann Heng , Chao Li , Minyi Guo

The Mixture of Experts (MoE) architecture has emerged as a powerful paradigm for scaling large language models (LLMs) while maintaining inference efficiency. However, their enormous memory requirements make them prohibitively expensive to…

Machine Learning · Computer Science 2025-06-24 Zichong Li , Chen Liang , Zixuan Zhang , Ilgee Hong , Young Jin Kim , Weizhu Chen , Tuo Zhao

Mixture-of-Experts (MoE) models have recently demonstrated exceptional performance across a diverse range of applications. The principle of sparse activation in MoE models facilitates an offloading strategy, wherein active experts are…

Computation and Language · Computer Science 2025-10-15 Yushu Zhao , Yubin Qin , Yang Wang , Xiaolong Yang , Huiming Han , Shaojun Wei , Yang Hu , Shouyi Yin

The deployment of mixture-of-experts (MoE) large language models (LLMs) presents significant challenges due to their high memory demands. These challenges become even more pronounced in multi-tenant environments, where shared resources must…

Machine Learning · Computer Science 2025-05-13 HamidReza Imani , Jiaxin Peng , Peiman Mohseni , Abdolah Amirany , Tarek El-Ghazawi

Large-scale Mixture of Experts (MoE) Large Language Models (LLMs) have recently become the frontier open-weight models, achieving remarkable model capability similar to proprietary ones. But their random expert selection mechanism…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-13 Zhongkai Yu , Yue Guan , Zihao Yu , Chenyang Zhou , Zhengding Hu , Shuyi Pei , Yangwook Kang , Yufei Ding , Po-An Tsai

Mixture-of-Experts (MoE) models are designed to enhance the efficiency of large language models (LLMs) without proportionally increasing the computational demands. However, their deployment on edge devices still faces significant challenges…

Machine Learning · Computer Science 2024-08-21 Shuzhang Zhong , Ling Liang , Yuan Wang , Runsheng Wang , Ru Huang , Meng Li

Large language models (LLMs) have demonstrated remarkable capabilities across a wide range of natural language processing tasks. Exploiting the heterogeneous capabilities of edge LLMs is crucial for diverse emerging applications, as it…

Networking and Internet Architecture · Computer Science 2025-01-17 Lyudong Jin , Yanning Zhang , Yanhan Li , Shurong Wang , Howard H. Yang , Jian Wu , Meng Zhang

Mixture of Experts (MoE) models have enabled the scaling of Large Language Models (LLMs) and Vision Language Models (VLMs) by achieving massive parameter counts while maintaining computational efficiency. However, MoEs introduce several…

Large Language Models (LLMs) have achieved significant success in various natural language processing tasks, but how wireless communications can support LLMs has not been extensively studied. In this paper, we propose a wireless distributed…

Information Theory · Computer Science 2024-05-07 Nan Xue , Yaping Sun , Zhiyong Chen , Meixia Tao , Xiaodong Xu , Liang Qian , Shuguang Cui , Ping Zhang

Recent advancements have shown that the Mixture of Experts (MoE) approach significantly enhances the capacity of large language models (LLMs) and improves performance on downstream tasks. Building on these promising results, multi-modal…

Computation and Language · Computer Science 2025-06-02 Linglin Jing , Yuting Gao , Zhigang Wang , Wang Lan , Yiwen Tang , Wenhai Wang , Kaipeng Zhang , Qingpei Guo

Mixture-of-Experts (MoE) model architectures can significantly reduce the number of activated parameters per token, enabling computationally efficient training and inference. However, their large overall parameter counts and model sizes…

Machine Learning · Computer Science 2026-02-13 Arian Raje , Anupam Nayak , Gauri Joshi

While large language models (LLMs) excel on generation tasks, their decoder-only architecture often limits their potential as embedding models if no further representation finetuning is applied. Does this contradict their claim of…

Computation and Language · Computer Science 2024-10-17 Ziyue Li , Tianyi Zhou

As Large Language Models (LLMs) push the boundaries of AI capabilities, their demand for data is growing. Much of this data is private and distributed across edge devices, making Federated Learning (FL) a de-facto alternative for…

Machine Learning · Computer Science 2024-08-22 Hanzi Mei , Dongqi Cai , Ao Zhou , Shangguang Wang , Mengwei Xu

Mixture-of-Experts large language models (MoE-LLMs) marks a significant step forward of language models, however, they encounter two critical challenges in practice: 1) expert parameters lead to considerable memory consumption and loading…

Machine Learning · Computer Science 2025-02-25 Wei Huang , Yue Liao , Jianhui Liu , Ruifei He , Haoru Tan , Shiming Zhang , Hongsheng Li , Si Liu , Xiaojuan Qi

Mixture-of-Experts (MoE) has become the de facto architecture for hundred-billion-parameter language models, yet its advantages at sub-billion scales for on-device deployment remain largely unexplored. To close this gap, we present…

Large Language Models (LLMs) have achieved remarkable success across a wide range of tasks, but serving them efficiently at scale remains a critical challenge due to their substantial computational and latency demands. While most existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-04 Yifan Sun , Gholamreza Haffari , Minxian Xu , Rajkumar Buyya , Adel N. Toosi

Due to the cost-prohibitive nature of training Large Language Models (LLMs), fine-tuning has emerged as an attractive alternative for specializing LLMs for specific tasks using limited compute resources in a cost-effective manner. In this…

Computation and Language · Computer Science 2024-08-15 Yuchen Xia , Jiho Kim , Yuhan Chen , Haojie Ye , Souvik Kundu , Cong Hao , Nishil Talati