中文
相关论文

相关论文: Variance Reduced Policy Gradient Method for Multi-…

200 篇论文

A major challenge of reinforcement learning (RL) in real-world applications is the variation between environments, tasks or clients. Meta-RL (MRL) addresses this issue by learning a meta-policy that adapts to new tasks. Standard MRL methods…

机器学习 · 计算机科学 2023-10-03 Ido Greenberg , Shie Mannor , Gal Chechik , Eli Meirom

We consider the reinforcement learning (RL) problem with general utilities which consists in maximizing a function of the state-action occupancy measure. Beyond the standard cumulative reward RL setting, this problem includes as particular…

机器学习 · 计算机科学 2023-06-06 Anas Barakat , Ilyas Fatkhullin , Niao He

Reinforcement learning with multiple, potentially conflicting objectives is pervasive in real-world applications, while this problem remains theoretically under-explored. This paper tackles the multi-objective reinforcement learning (MORL)…

机器学习 · 计算机科学 2024-05-10 Tianchen Zhou , FNU Hairi , Haibo Yang , Jia Liu , Tian Tong , Fan Yang , Michinari Momma , Yan Gao

One of the notorious issues for Reinforcement Learning (RL) is poor sample efficiency. Compared to single agent RL, the sample efficiency for Multi-Agent Reinforcement Learning (MARL) is more challenging because of its inherent partial…

机器学习 · 计算机科学 2024-04-16 Linjie Xu , Zichuan Liu , Alexander Dockhorn , Diego Perez-Liebana , Jinyu Wang , Lei Song , Jiang Bian

Transmission grid congestion increases as the electrification of various sectors requires transmitting more power. Topology control, through substation reconfiguration, can reduce congestion but its potential remains under-exploited in…

机器学习 · 计算机科学 2025-05-02 Thomas Lautenbacher , Ali Rajaei , Davide Barbieri , Jan Viebahn , Jochen L. Cremer

Policy gradient (PG) methods are popular reinforcement learning (RL) methods where a baseline is often applied to reduce the variance of gradient estimates. In multi-agent RL (MARL), although the PG theorem can be naturally extended, the…

In real-world decision optimization, often multiple competing objectives must be taken into account. Following classical reinforcement learning, these objectives have to be combined into a single reward function. In contrast,…

机器学习 · 计算机科学 2022-04-12 Johannes Dornheim

Offline reinforcement learning (RL) optimizes the policy on a previously collected dataset without any interactions with the environment, yet usually suffers from the distributional shift problem. To mitigate this issue, a typical solution…

机器学习 · 计算机科学 2023-09-06 Qisen Yang , Shenzhi Wang , Qihang Zhang , Gao Huang , Shiji Song

Offline multi-agent reinforcement learning (MARL) aims to learn the optimal joint policy from pre-collected datasets, requiring a trade-off between maximizing global returns and mitigating distribution shift from offline data. Recent…

机器学习 · 计算机科学 2026-04-10 Teng Pang , Zhiqiang Dong , Yan Zhang , Rongjian Xu , Guoqiang Wu , Yilong Yin

Lexicographic multi-objective problems, which consist of multiple conflicting subtasks with explicit priorities, are common in real-world applications. Despite the advantages of Reinforcement Learning (RL) in single tasks, extending…

机器学习 · 计算机科学 2025-11-12 Ruiyu Qiu , Rui Wang , Guanghui Yang , Xiang Li , Zhijiang Shao

The deployment of multi-agent systems in dynamic, adversarial environments like robotic soccer necessitates real-time decision-making, sophisticated cooperation, and scalable algorithms to avoid the curse of dimensionality. While…

机器人学 · 计算机科学 2025-12-04 Aya Taourirte , Md Sohag Mia

This paper studies a distributed policy gradient in collaborative multi-agent reinforcement learning (MARL), where agents over a communication network aim to find the optimal policy to maximize the average of all agents' local returns. Due…

多智能体系统 · 计算机科学 2022-12-06 Xiaoxiao Zhao , Jinlong Lei , Li Li , Jie Chen

Solving multi-objective optimization problems is important in various applications where users are interested in obtaining optimal policies subject to multiple, yet often conflicting objectives. A typical approach to obtain optimal policies…

系统与控制 · 电气工程与系统科学 2019-09-27 Huixin Zhan , Yongcan Cao

Reinforcement learning (RL) is a valuable tool for the creation of AI systems. However it may be problematic to adequately align RL based on scalar rewards if there are multiple conflicting values or stakeholders to be considered. Over the…

机器学习 · 计算机科学 2024-10-16 Peter Vamplew , Conor F Hayes , Cameron Foale , Richard Dazeley , Hadassah Harland

Multi-objective reinforcement learning (MORL) algorithms extend conventional reinforcement learning (RL) to the more general case of problems with multiple, conflicting objectives, represented by vector-valued rewards. Widely-used scalar RL…

机器学习 · 计算机科学 2026-04-23 Peter Vamplew , Ethan , Watkins , Cameron Foale , Richard Dazeley

Multi-objective reinforcement learning (MORL) aims to find a set of high-performing and diverse policies that address trade-offs between multiple conflicting objectives. However, in practice, decision makers (DMs) often deploy only one or a…

神经与进化计算 · 计算机科学 2024-01-05 Ke Li , Han Guo

Although well-established in general reinforcement learning (RL), value-based methods are rarely explored in constrained RL (CRL) for their incapability of finding policies that can randomize among multiple actions. To apply value-based…

机器学习 · 计算机科学 2022-06-28 Tianchi Cai , Wenpeng Zhang , Lihong Gu , Xiaodong Zeng , Jinjie Gu

Offline reinforcement learning (RL) seeks to learn optimal policies from static datasets without interacting with the environment. A common challenge is handling multi-modal action distributions, where multiple behaviours are represented in…

机器学习 · 计算机科学 2025-03-20 Mianchu Wang , Yue Jin , Giovanni Montana

Reinforcement Learning (RL) has made significant strides in complex tasks but struggles in multi-task settings with different embodiments. World model methods offer scalability by learning a simulation of the environment but often rely on…

机器学习 · 计算机科学 2025-02-25 Ignat Georgiev , Varun Giridhar , Nicklas Hansen , Animesh Garg

Multi-objective reinforcement learning (MORL) addresses the challenge of simultaneously optimizing multiple, often conflicting, rewards, moving beyond the single-reward focus of conventional reinforcement learning (RL). This approach is…

神经与进化计算 · 计算机科学 2025-05-21 Carlos Hernández , Roberto Santana