English
Related papers

Related papers: Mol-MoE: Training Preference-Guided Routers for Mo…

200 papers

Multi-objective reinforcement learning (MORL) aims to find a set of high-performing and diverse policies that address trade-offs between multiple conflicting objectives. However, in practice, decision makers (DMs) often deploy only one or a…

Neural and Evolutionary Computing · Computer Science 2024-01-05 Ke Li , Han Guo

Multi-objective reinforcement learning (MORL) is an extension of ordinary, single-objective reinforcement learning (RL) that is applicable to many real-world tasks where multiple objectives exist without known relative costs. We study the…

Machine Learning · Computer Science 2021-01-12 Dongruo Zhou , Jiahao Chen , Quanquan Gu

A major challenge in the pharmaceutical industry is to design novel molecules with specific desired properties, especially when the property evaluation is costly. Here, we propose MNCE-RL, a graph convolutional policy network for molecular…

Machine Learning · Computer Science 2020-11-17 Chencheng Xu , Qiao Liu , Minlie Huang , Tao Jiang

Optimizing various wireless user tasks poses a significant challenge for networking systems because of the expanding range of user requirements. Despite advancements in Deep Reinforcement Learning (DRL), the need for customized optimization…

Networking and Internet Architecture · Computer Science 2024-02-16 Hongyang Du , Guangyuan Liu , Yijing Lin , Dusit Niyato , Jiawen Kang , Zehui Xiong , Dong In Kim

In parameter-efficient fine-tuning, mixture-of-experts (MoE), which involves specializing functionalities into different experts and sparsely activating them appropriately, has been widely adopted as a promising approach to trade-off…

Machine Learning · Computer Science 2025-08-29 Jinyuan Feng , Chaopeng Wei , Tenghai Qiu , Tianyi Hu , Zhiqiang Pu

Mixture of Experts (MoE) pretraining is more scalable than dense Transformer pretraining, because MoEs learn to route inputs to a sparse set of their feedforward parameters. However, this means that MoEs only receive a sparse backward…

Machine Learning · Computer Science 2025-11-05 Ashwinee Panda , Vatsal Baherwani , Zain Sarwar , Benjamin Therien , Sambit Sahu , Tom Goldstein , Supriyo Chakraborty

Recent studies have shown that combining parameter-efficient fine-tuning (PEFT) with mixture-of-experts (MoE) is an effective strategy for adapting large language models (LLMs) to the downstream tasks. However, most existing approaches rely…

Computation and Language · Computer Science 2026-02-25 Yuan Zhuang , Yi Shen , Yuexin Bian , Qing Su , Shihao Ji , Yuanyuan Shi , Fei Miao

Mobile edge computing (MEC) is essential for next-generation mobile network applications that prioritize various performance metrics, including delays and energy consumption. However, conventional single-objective scheduling solutions…

Networking and Internet Architecture · Computer Science 2023-07-28 Ning Yang , Junrui Wen , Meng Zhang , Ming Tang

Multi-objective reinforcement learning (MORL) is used to solve problems involving multiple objectives. An MORL agent must make decisions based on the diverse signals provided by distinct reward functions. Training an MORL agent yields a set…

Artificial Intelligence · Computer Science 2024-11-08 Zuzanna Osika , Jazmin Zatarain-Salazar , Frans A. Oliehoek , Pradeep K. Murukannaiah

The application of mixture-of-experts (MoE) is gaining popularity due to its ability to improve model's performance. In an MoE structure, the gate layer plays a significant role in distinguishing and routing input features to different…

Machine Learning · Computer Science 2024-02-05 Zhitian Xie , Yinger Zhang , Chenyi Zhuang , Qitao Shi , Zhining Liu , Jinjie Gu , Guannan Zhang

Mixture-of-Experts (MoE) approaches have recently gained traction in robotics applications due to their ability to dynamically allocate computational resources and specialize sub-networks for distinct tasks or environmental contexts,…

Robotics · Computer Science 2026-02-18 Dmytro Kuzmenko , Nadiya Shvai

Pre-training has proven effective in addressing data scarcity and performance limitations in solving PDE problems with neural operators. However, challenges remain due to the heterogeneity of PDE datasets in equation types, which leads to…

Machine Learning · Computer Science 2025-11-03 Hong Wang , Haiyang Xin , Jie Wang , Xuanze Yang , Fei Zha , Huanshuo Dong , Yan Jiang

Reinforcement learning (RL) has emerged as a crucial approach for enhancing the capabilities of large language models. However, in Mixture-of-Experts (MoE) models, the routing mechanism often introduces instability, even leading to…

Computation and Language · Computer Science 2025-10-22 Wenhan Ma , Hailin Zhang , Liang Zhao , Yifan Song , Yudong Wang , Zhifang Sui , Fuli Luo

While Large Language Models (LLMs) are commonly fine-tuned to handle domain-specific tasks before being applied to vertical applications, adapting them to complex scenarios with diverse specialized knowledge remains challenging. Meanwhile,…

Machine Learning · Computer Science 2026-05-26 Mengyang Sun , Maochuan Dou , Tao Feng , Dan Zhang , Yihao Wang , Junpeng Liu , Yifan Zhu , Jie Tang

In supply chain management, decision-making often involves balancing multiple conflicting objectives, such as cost reduction, service level improvement, and environmental sustainability. Traditional multi-objective optimization methods,…

Artificial Intelligence · Computer Science 2025-09-09 Niki Kotecha , Ehecatl Antonio del Rio Chanona

Mixture-of-Experts (MoE) activates only a subset of experts during inference, allowing the model to maintain low inference FLOPs and latency even as the parameter count scales up. However, since MoE dynamically selects the experts, all the…

Machine Learning · Computer Science 2025-05-27 Shibo Jie , Yehui Tang , Kai Han , Yitong Li , Duyu Tang , Zhi-Hong Deng , Yunhe Wang

Despite the success of foundation models in language and vision, molecular graph generation still lacks a unified framework for heterogeneous design tasks with reliable controllability. While reinforcement learning (RL) offers a natural…

Machine Learning · Computer Science 2026-05-18 Yihan Zhu , Yuhan Liu , Weijiang Li , Tengfei Luo , Meng Jiang

We introduce a Mixture of Raytraced Experts, a stacked Mixture of Experts (MoE) architecture which can dynamically select sequences of experts, producing computational graphs of variable width and depth. Existing MoE architectures generally…

Machine Learning · Computer Science 2025-07-17 Andrea Perin , Giacomo Lagomarsini , Claudio Gallicchio , Giuseppe Nuti

Quadrupedal locomotion is a complex, open-ended problem vital to expanding autonomous vehicle reach. Traditional reinforcement learning approaches often fall short due to training instability and sample inefficiency. We propose a novel…

Robotics · Computer Science 2024-11-14 Martin Robert , Simon Brodeur , Francois Ferland

In deep learning, mixture-of-experts (MoE) activates one or few experts (sub-networks) on a per-sample or per-token basis, resulting in significant computation reduction. The recently proposed \underline{p}atch-level routing in…

Machine Learning · Computer Science 2023-07-10 Mohammed Nowaz Rabbani Chowdhury , Shuai Zhang , Meng Wang , Sijia Liu , Pin-Yu Chen