English
Related papers

Related papers: B2MAPO: A Batch-by-Batch Multi-Agent Policy Optimi…

200 papers

In heterogeneous multi-agent reinforcement learning (MARL), achieving monotonic improvement plays a pivotal role in enhancing performance. The HAPPO algorithm proposes a feasible solution by introducing a sequential update scheme, which…

Artificial Intelligence · Computer Science 2025-07-15 Xiaoyang Yu , Youfang Lin , Shuo Wang , Sheng Han

This paper introduces two novel modifications to the Dynamic sAmpling Policy Optimization (DAPO) algorithm [1], approached from a mixed-policy perspective. Standard policy gradient methods can suffer from instability and sample…

Machine Learning · Computer Science 2025-08-20 Hongze Tan , Yuchen Li

Decentralized multi-agent path finding (MAPF) routes a team of agents on a shared grid, each acting from its own local view. The standard solution trains one shared neural policy with Proximal Policy Optimization (PPO), a popular on-policy…

Machine Learning · Computer Science 2026-05-13 Riad Ahmed

This work considers the problem of learning cooperative policies in multi-agent settings with partially observable and non-stationary environments without a communication channel. We focus on improving information sharing between agents and…

Machine Learning · Computer Science 2021-09-03 Eshagh Kargar , Ville Kyrki

We propose Multi Agent Reflective Policy Optimization (MARPO) to alleviate the issue of sample inefficiency in multi agent reinforcement learning. MARPO consists of two key components: a reflection mechanism that leverages subsequent…

Multiagent Systems · Computer Science 2025-12-30 Cuiling Wu , Yaozhong Gan , Junliang Xing , Ying Fu

We study capacity- and budget-constrained multi-agent MDPs (CB-MA-MDPs), a class that captures many maintenance and scheduling tasks in which each agent can irreversibly fail and a planner must decide (i) when to apply a restorative action…

Machine Learning · Computer Science 2025-10-08 Manav Vora , Ilan Shomorony , Melkior Ornik

Developing reinforcement learning algorithms that satisfy safety constraints is becoming increasingly important in real-world applications. In multi-agent reinforcement learning (MARL) settings, policy optimisation with safety awareness is…

Artificial Intelligence · Computer Science 2022-02-11 Shangding Gu , Jakub Grudzien Kuba , Munning Wen , Ruiqing Chen , Ziyan Wang , Zheng Tian , Jun Wang , Alois Knoll , Yaodong Yang

Multi-agent systems have a wide range of applications in cooperative and competitive tasks. As the number of agents increases, nonstationarity gets more serious in multi-agent reinforcement learning (MARL), which brings great difficulties…

Machine Learning · Computer Science 2019-08-20 Jiancheng Long , Hongming Zhang , Tianyang Yu , Bo Xu

Reinforcement learning algorithms require a large amount of samples; this often limits their real-world applications on even simple tasks. Such a challenge is more outstanding in multi-agent tasks, as each step of operation is more costly…

Machine Learning · Computer Science 2022-09-05 Yali Du , Chengdong Ma , Yuchen Liu , Runji Lin , Hao Dong , Jun Wang , Yaodong Yang

Multicasting is an efficient technique for simultaneously transmitting common messages from the base station (BS) to multiple mobile users (MUs). Multicast scheduling over multiple channels, which aims to jointly minimize the energy…

Information Theory · Computer Science 2023-08-22 Ran Li , Chuan Huang , Xiaoqi Qin , Shengpei Jiang

Generative models, especially diffusion and flow-based models, have been promising in offline multi-agent reinforcement learning. However, integrating powerful generative models into this framework poses unique challenges. In particular,…

Machine Learning · Computer Science 2026-03-02 Zhuoran Li , Xun Wang , Hai Zhong , Qingxin Xia , Lihua Zhang , Longbo Huang

In this paper, we consider a goal-oriented communication problem for edge server monitoring, where jobs arrive intermittently at multiple dispatchers and must be assigned to shared edge servers with finite queues and time-varying…

Systems and Control · Electrical Eng. & Systems 2025-10-01 Samuel Chamoun , Christian McDowell , Robin Buchanan , Kevin Chan , Eric Graves , Yin Sun

We consider infinite horizon dynamic programming problems, where the control at each stage consists of several distinct decisions, each one made by one of several agents. In an earlier work we introduced a policy iteration algorithm, where…

Optimization and Control · Mathematics 2020-05-05 Dimitri Bertsekas

Multi-agent reinforcement learning (MARL) requires coordinated and stable policy updates among interacting agents. Heterogeneous-Agent Trust Region Policy Optimization (HATRPO) enforces per-agent trust region constraints using…

Artificial Intelligence · Computer Science 2025-08-15 Chak Lam Shek , Guangyao Shi , Pratap Tokekar

We develop a multi-agent reinforcement learning (MARL) algorithm to minimize the total energy consumption of multiple massive MIMO (multiple-input multiple-output) base stations (BSs) in a multi-cell network while preserving the overall…

Information Theory · Computer Science 2024-02-06 Tianzhang Cai , Qichen Wang , Shuai Zhang , Özlem Tuğfe Demir , Cicek Cavdar

Resource allocation and task prioritisation are key problem domains in the fields of autonomous vehicles, networking, and cloud computing. The challenge in developing efficient and robust algorithms comes from the dynamic nature of these…

Artificial Intelligence · Computer Science 2021-02-17 Niall Creech , Natalia Criado Pacheco , Simon Miles

We propose a novel approach to address one aspect of the non-stationarity problem in multi-agent reinforcement learning (RL), where the other agents may alter their policies due to environment changes during execution. This violates the…

Machine Learning · Computer Science 2019-12-03 Yixiang Wang , Feng Wu

In this work, we address the cooperation problem among large language model (LLM) based embodied agents, where agents must cooperate to achieve a common goal. Previous methods often execute actions extemporaneously and incoherently, without…

Artificial Intelligence · Computer Science 2025-03-04 Jie Liu , Pan Zhou , Yingjun Du , Ah-Hwee Tan , Cees G. M. Snoek , Jan-Jakob Sonke , Efstratios Gavves

Existing multi-agent PPO algorithms lack compatibility with different types of parameter sharing when extending the theoretical guarantee of PPO to cooperative multi-agent reinforcement learning (MARL). In this paper, we propose a novel and…

Machine Learning · Computer Science 2023-10-10 Lang Feng , Dong Xing , Junru Zhang , Gang Pan

Cooperative multi-agent tasks require agents to deduce their own contributions with shared global rewards, known as the challenge of credit assignment. General methods for policy based multi-agent reinforcement learning to solve the…

Machine Learning · Computer Science 2021-05-11 Lipeng Wan , Xuwei Song , Xuguang Lan , Nanning Zheng