English
Related papers

Related papers: Non-Stationary Policy Learning for Multi-Timescale…

200 papers

Before taking actions in an environment with more than one intelligent agent, an autonomous agent may benefit from reasoning about the other agents and utilizing a notion of a guarantee or confidence about the behavior of the system. In…

Machine Learning · Computer Science 2024-02-12 Nikunj Gupta , Somjit Nath , Samira Ebrahimi Kahou

We propose using regularization for Multi-Agent Reinforcement Learning rather than learning explicit cooperative structures called {\em Multi-Agent Regularized Q-learning} (MARQ). Many MARL approaches leverage centralized structures in…

Machine Learning · Computer Science 2021-09-21 Chapman Siu , Jason Traish , Richard Yi Da Xu

In this paper, we propose a distributed zeroth-order policy optimization method for Multi-Agent Reinforcement Learning (MARL). Existing MARL algorithms often assume that every agent can observe the states and actions of all the other agents…

Machine Learning · Computer Science 2023-06-21 Yan Zhang , Michael M. Zavlanos

Multi-agent reinforcement learning (MARL) under partial observability has long been considered challenging, primarily due to the requirement for each agent to maintain a belief over all other agents' local histories -- a domain that…

Artificial Intelligence · Computer Science 2020-08-18 Weichao Mao , Kaiqing Zhang , Erik Miehling , Tamer Başar

Recently, many cooperative distributed multi-agent reinforcement learning (MARL) algorithms have been proposed in the literature. In this work, we study the effect of adversarial attacks on a network that employs a consensus-based MARL…

Systems and Control · Electrical Eng. & Systems 2021-03-15 Martin Figura , Krishna Chaitanya Kosaraju , Vijay Gupta

Cooperative multi-agent reinforcement learning (MARL) is typically formalised as a Decentralised Partially Observable Markov Decision Process (Dec-POMDP), where agents must reason about the environment and other agents' behaviour. In…

Machine Learning · Computer Science 2025-07-25 Kale-ab Abebe Tessera , Leonard Hinckeldey , Riccardo Zamboni , David Abel , Amos Storkey

We consider a warehouse in which dozens of mobile robots and human pickers work together to collect and deliver items within the warehouse. The fundamental problem we tackle, called the order-picking problem, is how these worker agents must…

Multi-Agent Reinforcement Learning can lead to the development of collaborative agent behaviors that show similarities with organizational concepts. Pushing forward this perspective, we introduce a novel framework that explicitly…

Artificial Intelligence · Computer Science 2025-04-01 Julien Soulé , Jean-Paul Jamont , Michel Occello , Louis-Marie Traonouez , Paul Théron

In this paper, we propose a maximum mutual information (MMI) framework for multi-agent reinforcement learning (MARL) to enable multiple agents to learn coordinated behaviors by regularizing the accumulated return with the mutual information…

Multiagent Systems · Computer Science 2020-06-05 Woojun Kim , Whiyoung Jung , Myungsik Cho , Youngchul Sung

This work explores the large-scale multi-agent communication mechanism under a multi-agent reinforcement learning (MARL) setting. We summarize the general categories of topology for communication structures in MARL literature, which are…

Machine Learning · Computer Science 2020-02-12 Junjie Sheng , Xiangfeng Wang , Bo Jin , Junchi Yan , Wenhao Li , Tsung-Hui Chang , Jun Wang , Hongyuan Zha

Multi-agent adversarial inverse reinforcement learning (MA-AIRL) is a recent approach that applies single-agent AIRL to multi-agent problems where we seek to recover both policies for our agents and reward functions that promote expert-like…

Multiagent Systems · Computer Science 2020-02-26 Wonseok Jeon , Paul Barde , Derek Nowrouzezahrai , Joelle Pineau

The inability to communicate poses a major challenge to coordination in multi-agent reinforcement learning (MARL). Prior work has explored correlating local policies via shared randomness, sometimes in the form of a correlation device, as a…

Multiagent Systems · Computer Science 2026-02-12 John Gardiner , Orlando Romero , Brendan Tivnan , Nicolò Dal Fabbro , George J. Pappas

Multi-agent reinforcement learning (MARL) has become effective in tackling discrete cooperative game scenarios. However, MARL has yet to penetrate settings beyond those modelled by team and zero-sum games, confining it to a small subset of…

Multiagent Systems · Computer Science 2021-06-16 David Mguni , Yutong Wu , Yali Du , Yaodong Yang , Ziyi Wang , Minne Li , Ying Wen , Joel Jennings , Jun Wang

When developing reinforcement learning agents, the standard approach is to train an agent to converge to a fixed policy that is as close to optimal as possible for a single fixed reward function. If different agent behaviour is required in…

Multiagent Systems · Computer Science 2021-01-29 David O'Callaghan , Patrick Mannion

Cooperative multi-agent reinforcement learning (MARL) has made substantial strides in addressing the distributed decision-making challenges. However, as multi-agent systems grow in complexity, gaining a comprehensive understanding of their…

Artificial Intelligence · Computer Science 2023-12-15 Wiem Khlifi , Siddarth Singh , Omayma Mahjoub , Ruan de Kock , Abidine Vall , Rihab Gorsane , Arnu Pretorius

This paper considers multi-agent reinforcement learning (MARL) tasks where agents receive a shared global reward at the end of an episode. The delayed nature of this reward affects the ability of the agents to assess the quality of their…

Multiagent Systems · Computer Science 2022-01-13 Baicen Xiao , Bhaskar Ramasubramanian , Radha Poovendran

Despite the recent advancement in multi-agent reinforcement learning (MARL), the MARL agents easily overfit the training environment and perform poorly in the evaluation scenarios where other agents behave differently. Obtaining…

Multiagent Systems · Computer Science 2022-10-19 Wei Qiu , Xiao Ma , Bo An , Svetlana Obraztsova , Shuicheng Yan , Zhongwen Xu

Hierarchies of temporally decoupled policies present a promising approach for enabling structured exploration in complex long-term planning problems. To fully achieve this approach an end-to-end training paradigm is needed. However,…

Machine Learning · Computer Science 2021-11-19 Abdul Rahman Kreidieh , Glen Berseth , Brandon Trabucco , Samyak Parajuli , Sergey Levine , Alexandre M. Bayen

The field of cooperative multi-agent reinforcement learning (MARL) has seen widespread use in addressing complex coordination tasks. While value decomposition methods in MARL have been popular, they have limitations in solving tasks with…

Multiagent Systems · Computer Science 2023-07-06 Shanqi Liu , Weiwei Liu , Wenzhou Chen , Guanzhong Tian , Yong Liu

This paper studies algorithmic decision-making in the presence of strategic individual behaviors, where an ML model is used to make decisions about human agents and the latter can adapt their behavior strategically to improve their future…

Artificial Intelligence · Computer Science 2025-08-22 Tian Xie , Xueru Zhang