中文
相关论文

相关论文: Regularization of the policy updates for stabilizi…

200 篇论文

Autonomous driving (AD) requires safe and reliable decision-making among interacting agents, e.g., vehicles, bicycles, and pedestrians. Multi-agent reinforcement learning (MARL) modeled by Markov games (MGs) provides a suitable framework to…

系统与控制 · 电气工程与系统科学 2026-03-20 Huiwen Yan , Mushuang Liu

Mean-field games (MFG) were introduced to efficiently analyze approximate Nash equilibria in large population settings. In this work, we consider entropy-regularized mean-field games with a finite state-action space in a discrete time…

计算机科学与博弈论 · 计算机科学 2022-07-26 Yue Guan , Mi Zhou , Ali Pakniyat , Panagiotis Tsiotras

Agent-based models (ABMs) have shown promise for modelling various real world phenomena incompatible with traditional equilibrium analysis. However, a critical concern is the manual definition of behavioural rules in ABMs. Recent…

多智能体系统 · 计算机科学 2024-02-02 Benjamin Patrick Evans , Sumitra Ganesh

Many advances in cooperative multi-agent reinforcement learning (MARL) are based on two common design principles: value decomposition and parameter sharing. A typical MARL algorithm of this fashion decomposes a centralized Q-function into…

人工智能 · 计算机科学 2022-08-09 Wei Fu , Chao Yu , Zelai Xu , Jiaqi Yang , Yi Wu

In this paper, we propose a distributed zeroth-order policy optimization method for Multi-Agent Reinforcement Learning (MARL). Existing MARL algorithms often assume that every agent can observe the states and actions of all the other agents…

机器学习 · 计算机科学 2023-06-21 Yan Zhang , Michael M. Zavlanos

Intraday surgical scheduling is a multi-objective decision problem under uncertainty-balancing elective throughput, urgent and emergency demand, delays, sequence-dependent setups, and overtime. We formulate the problem as a cooperative…

机器学习 · 计算机科学 2025-12-05 Kailiang Liu , Ying Chen , Ralf Borndörfer , Thorsten Koch

Multi-agent reinforcement learning (MARL) provides an efficient way for simultaneously learning policies for multiple agents interacting with each other. However, in scenarios requiring complex interactions, existing algorithms can suffer…

机器学习 · 计算机科学 2022-03-08 Xiaobai Ma , David Isele , Jayesh K. Gupta , Kikuo Fujimura , Mykel J. Kochenderfer

Coordinating large populations of interacting agents is a central challenge in multi-agent reinforcement learning (MARL), where the size of the joint state-action space scales exponentially with the number of agents. Mean-field methods…

机器学习 · 计算机科学 2026-02-19 Emile Anand , Richard Hoffmann , Sarah Liaw , Adam Wierman

Instability and slowness are two main problems in deep reinforcement learning. Even if proximal policy optimization (PPO) is the state of the art, it still suffers from these two problems. We introduce an improved algorithm based on…

机器学习 · 计算机科学 2019-10-01 Zhenyu Zhang , Xiangfeng Luo , Tong Liu , Shaorong Xie , Jianshu Wang , Wei Wang , Yang Li , Yan Peng

Two-player games such as board games have long been used as traditional benchmarks for reinforcement learning. This work revisits a policy optimization method with reverse Kullback-Leibler regularization and entropy regularization and…

机器学习 · 计算机科学 2026-05-22 Kazuki Ota , Takayuki Osa , Motoki Omura , Tatsuya Harada

Multi-agent Reinforcement Learning (MARL) is a powerful tool for training autonomous agents acting independently in a common environment. However, it can lead to sub-optimal behavior when individual incentives and group incentives diverge.…

人工智能 · 计算机科学 2024-01-30 Andreas A. Haupt , Phillip J. K. Christoffersen , Mehul Damani , Dylan Hadfield-Menell

Advancements in deep multi-agent reinforcement learning (MARL) have positioned it as a promising approach for decision-making in cooperative games. However, it still remains challenging for MARL agents to learn cooperative strategies for…

多智能体系统 · 计算机科学 2025-06-19 Yuan Zhuang , Yi Shen , Zhili Zhang , Yuxiao Chen , Fei Miao

This paper aims to develop a paradigm that models the learning behavior of intelligent agents (including but not limited to autonomous vehicles, connected and automated vehicles, or human-driven vehicles with intelligent navigation systems…

机器学习 · 计算机科学 2022-03-01 Zhenyu Shou , Xu Chen , Yongjie Fu , Xuan Di

Recent advancements in multi-agent reinforcement learning (MARL) have opened up vast application prospects, such as swarm control of drones, collaborative manipulation by robotic arms, and multi-target encirclement. However, potential…

机器学习 · 计算机科学 2024-06-27 Oubo Ma , Yuwen Pu , Linkang Du , Yang Dai , Ruo Wang , Xiaolei Liu , Yingcai Wu , Shouling Ji

A fundamental challenge in multi-agent reinforcement learning (MARL) is to learn the joint policy in an extremely large search space, which grows exponentially with the number of agents. Moreover, fully decentralized policy factorization…

多智能体系统 · 计算机科学 2024-01-24 Zhiyuan Li , Wenshuai Zhao , Lijun Wu , Joni Pajarinen

This paper studies a distributed policy gradient in collaborative multi-agent reinforcement learning (MARL), where agents over a communication network aim to find the optimal policy to maximize the average of all agents' local returns. Due…

多智能体系统 · 计算机科学 2022-12-06 Xiaoxiao Zhao , Jinlong Lei , Li Li , Jie Chen

The primary focus of multi-agent reinforcement learning (MARL) has been to study interactions among a fixed number of agents embedded in an environment. However, in the real world, the number of agents is neither fixed nor known a priori.…

机器学习 · 计算机科学 2026-02-17 Shishir Sharma , Doina Precup , Theodore J. Perkins

In single-agent Markov decision processes, an agent can optimize its policy based on the interaction with environment. In multi-player Markov games (MGs), however, the interaction is non-stationary due to the behaviors of other players, so…

计算机科学与博弈论 · 计算机科学 2021-10-19 Yuanheng Zhu , Dongbin Zhao , Mengchen Zhao , Dong Li

This paper proposes an exploration technique for multi-agent reinforcement learning (MARL) with graph-based communication among agents. We assume the individual rewards received by the agents are independent of the actions by the other…

机器学习 · 计算机科学 2025-08-11 Ainur Zhaikhan , Ali H. Sayed

Entropy regularization is a popular method in reinforcement learning (RL). Although it has many advantages, it alters the RL objective of the original Markov Decision Process (MDP). Though divergence regularization has been proposed to…

机器学习 · 计算机科学 2022-06-22 Kefan Su , Zongqing Lu