English
Related papers

Related papers: Optimizing Mixture of Experts using Dynamic Recomp…

200 papers

Graph neural networks (GNNs) have found extensive applications in learning from graph data. However, real-world graphs often possess diverse structures and comprise nodes and edges of varying types. To bolster the generalization capacity of…

Machine Learning · Computer Science 2023-10-18 Haotao Wang , Ziyu Jiang , Yuning You , Yan Han , Gaowen Liu , Jayanth Srinivasa , Ramana Rao Kompella , Zhangyang Wang

Mixture of experts (MoE) architectures have become a cornerstone for scaling up and are a key component in most large language models such as GPT-OSS, DeepSeek-V3, Llama-4, and Gemini-2.5. However, systematic research on MoE remains…

Computation and Language · Computer Science 2026-02-11 Nam V. Nguyen , Thong T. Doan , Luong Tran , Van Nguyen , Quang Pham

Mixture-of-Experts (MoE) models substantially improve performance by increasing the capacity of dense architectures. However, directly training MoE models requires considerable computational resources and introduces extra overhead in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Jiacheng Ruan , Daize Dong , Xiaoye Qu , Tong Zhu , Ting Liu , Yuzhuo Fu , Yu Cheng , Suncheng Xiang

Mixture of Experts (MoE) has become a key architectural paradigm for efficiently scaling Large Language Models (LLMs) by selectively activating a subset of parameters for each input token. However, standard MoE architectures face…

Machine Learning · Computer Science 2025-05-27 Zehua Liu , Han Wu , Ruifeng She , Xiaojin Fu , Xiongwei Han , Tao Zhong , Mingxuan Yuan

Model editing aims to efficiently alter the behavior of Large Language Models (LLMs) within a desired scope, while ensuring no adverse impact on other inputs. Recent years have witnessed various model editing methods been proposed. However,…

Computation and Language · Computer Science 2024-06-04 Renzhi Wang , Piji Li

Large language models (LLMs) with the Mixture-of-Experts (MoE) architecture achieve high cost-efficiency by selectively activating a subset of the parameters. Despite the inference efficiency of MoE LLMs, the training of extensive experts…

Computation and Language · Computer Science 2025-06-12 Yuchen Feng , Bowen Shen , Naibin Gu , Jiaxuan Zhao , Peng Fu , Zheng Lin , Weiping Wang

Sparsely Mixture of Experts (MoE) has received great interest due to its promising scaling capability with affordable computational overhead. MoE converts dense layers into sparse experts, and utilizes a gated routing network to make…

Computation and Language · Computer Science 2022-07-20 Yuan Xie , Shaohan Huang , Tianyu Chen , Furu Wei

The Mixture of Experts (MoE) architecture has emerged as a key technique for scaling Large Language Models by activating only a subset of experts per query. Deploying MoE on consumer-grade edge hardware, however, is constrained by limited…

Artificial Intelligence · Computer Science 2026-05-05 Guoying Zhu , Meng Li , Haipeng Dai , Xuechen Liu , Weijun Wang , Keran Li , Jun xiao , Ligeng Chen , Wei Wang

Transformer models can face practical limitations due to their high computational requirements. At the same time, such models exhibit significant activation sparsity, which can be leveraged to reduce the inference cost by converting parts…

Machine Learning · Computer Science 2024-11-13 Filip Szatkowski , Bartosz Wójcik , Mikołaj Piórczyński , Simone Scardapane

The visual medium (images and videos) naturally contains a large amount of information redundancy, thereby providing a great opportunity for leveraging efficiency in processing. While Vision Transformer (ViT) based models scale effectively…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Gagan Jain , Nidhi Hegde , Aditya Kusupati , Arsha Nagrani , Shyamal Buch , Prateek Jain , Anurag Arnab , Sujoy Paul

Learning-based autonomous driving requires continuous integration of diverse knowledge in complex traffic , yet existing methods exhibit significant limitations in adaptive capabilities. Addressing this gap demands autonomous driving…

Robotics · Computer Science 2025-02-18 Yixin Cui , Shuo Yang , Chi Wan , Xincheng Li , Jiaming Xing , Yuanjian Zhang , Yanjun Huang , Hong Chen

Mixture of Experts (MoE) models have emerged as a primary solution for reducing the computational cost of Large Language Models. In this work, we analyze their scaling properties, incorporating an expanded range of variables. Specifically,…

Large Language Models (LLMs) with Mixture-of-Expert (MoE) architectures achieve superior model performance with reduced computation costs, but at the cost of high memory capacity and bandwidth requirements. Near-Memory Processing (NMP)…

Performance · Computer Science 2025-09-12 Haochen Huang , Shuzhang Zhong , Zhe Zhang , Shuangchen Li , Dimin Niu , Hongzhong Zheng , Runsheng Wang , Meng Li

Mixture-of-Experts (MoE) enables efficient scaling of large language models by activating only a subset of experts per input token. However, deploying MoE-based models incurs significant memory overhead due to the need to retain all experts…

Machine Learning · Computer Science 2026-02-24 Geng Zhang , Yuxuan Han , Yuxuan Lou , Yiqi Zhang , Wangbo Zhao , Yang You

The Mixture-of-Experts (MoE) model uses a set of expert networks that specialize on subsets of a dataset under the supervision of a gating network. A common issue in MoE architectures is ``expert collapse'' where overlapping class…

Neural and Evolutionary Computing · Computer Science 2026-03-31 Abien Fred Agarap , Arnulfo P. Azcarraga

The proliferation of large language models (LLMs) has driven the adoption of Mixture-of-Experts (MoE) architectures as a promising solution to scale model capacity while controlling computational costs. However, deploying MoE models in…

Networking and Internet Architecture · Computer Science 2025-08-14 Muqing Li , Ning Li , Xin Yuan , Wenchao Xu , Quan Chen , Song Guo , Haijun Zhang

Mixtures of Experts (MoEs) have gained prominence in (self-)supervised learning due to their enhanced inference efficiency, adaptability to distributed training, and modularity. Previous research has illustrated that MoEs can significantly…

Machine Learning · Computer Science 2024-06-27 Timon Willi , Johan Obando-Ceron , Jakob Foerster , Karolina Dziugaite , Pablo Samuel Castro

Graph Neural Networks (GNNs) face a fundamental adaptability challenge: their fixed message-passing architectures struggle with the immense diversity of real-world graphs, where optimal computational strategies vary by local structure and…

Machine Learning · Computer Science 2025-10-27 Yunlong Chu , Minglai Shao , Zengyi Wo , Bing Hao , Yuhang Liu , Ruijie Wang , Jianxin Li

In the context of wireless networking, it was recently shown that multiple DNNs can be jointly trained to offer a desired collaborative behaviour capable of coping with a broad range of sensing uncertainties. In particular, it was…

Information Theory · Computer Science 2020-07-29 Matteo Zecchin , David Gesbert , Marios Kountouris

Vision-Language-Action (VLA) models are experiencing rapid development and demonstrating promising capabilities in robotic manipulation tasks. However, scaling up VLA models presents several critical challenges: (1) Training new VLA models…