English
Related papers

Related papers: On Feasible Rewards in Multi-Agent Inverse Reinfor…

200 papers

Coordination is one of the essential problems in multi-agent systems. Typically multi-agent reinforcement learning (MARL) methods treat agents equally and the goal is to solve the Markov game to an arbitrary Nash equilibrium (NE) when…

Multiagent Systems · Computer Science 2020-04-07 Haifeng Zhang , Weizhe Chen , Zeren Huang , Minne Li , Yaodong Yang , Weinan Zhang , Jun Wang

Multi-agent learning is a promising method to simulate aggregate competitive behaviour in finance. Learning expert agents' reward functions through their external demonstrations is hence particularly relevant for subsequent design of…

Machine Learning · Computer Science 2019-06-13 Jacobo Roa-Vicens , Cyrine Chtourou , Angelos Filos , Francisco Rullan , Yarin Gal , Ricardo Silva

We consider model-based multi-agent reinforcement learning, where the environment transition model is unknown and can only be learned via expensive interactions with the environment. We propose H-MARL (Hallucinated Multi-Agent Reinforcement…

Machine Learning · Computer Science 2022-07-12 Pier Giuseppe Sessa , Maryam Kamgarpour , Andreas Krause

This paper considers the challenging tasks of Multi-Agent Reinforcement Learning (MARL) under partial observability, where each agent only sees her own individual observations and actions that reveal incomplete information about the…

Machine Learning · Computer Science 2022-10-18 Qinghua Liu , Csaba Szepesvári , Chi Jin

Multi-agent reinforcement learning (MARL) has achieved notable success in cooperative tasks, demonstrating impressive performance and scalability. However, deploying MARL agents in real-world applications presents critical safety…

Machine Learning · Computer Science 2024-11-25 Zeyang Li , Navid Azizan

Multi-agent reinforcement learning (MARL) optimizes strategic interactions in non-cooperative dynamic games, where agents have misaligned objectives. However, data-driven methods such as multi-agent policy gradients (MA-PG) often suffer…

Systems and Control · Electrical Eng. & Systems 2026-02-13 Jingqi Li , Gechen Qu , Jason J. Choi , Somayeh Sojoudi , Claire Tomlin

Estimating the unknown reward functions driving agents' behaviors is of central interest in inverse reinforcement learning and game theory. To tackle this problem, we develop a unified framework for reward function recovery in two-player…

Machine Learning · Computer Science 2026-05-20 Junyi Liao , Zihan Zhu , Ethan Fang , Zhuoran Yang , Vahid Tarokh

The recent mean field game (MFG) formalism has enabled the application of inverse reinforcement learning (IRL) methods in large-scale multi-agent systems, with the goal of inferring reward signals that can explain demonstrated behaviours of…

Machine Learning · Computer Science 2022-02-15 Yang Chen , Libo Zhang , Jiamou Liu , Shuyue Hu

Multi-agent Reinforcement Learning (MARL) is a powerful tool for training autonomous agents acting independently in a common environment. However, it can lead to sub-optimal behavior when individual incentives and group incentives diverge.…

Artificial Intelligence · Computer Science 2024-01-30 Andreas A. Haupt , Phillip J. K. Christoffersen , Mehul Damani , Dylan Hadfield-Menell

Trust region methods are widely applied in single-agent reinforcement learning problems due to their monotonic performance-improvement guarantee at every iteration. Nonetheless, when applied in multi-agent settings, the guarantee of trust…

Multiagent Systems · Computer Science 2021-06-15 Ying Wen , Hui Chen , Yaodong Yang , Zheng Tian , Minne Li , Xu Chen , Jun Wang

Constrained Markov games offer a formal mathematical framework for modeling multi-agent reinforcement learning problems where the behavior of the agents is subject to constraints. In this work, we focus on the recently introduced class of…

Machine Learning · Computer Science 2024-02-29 Philip Jordan , Anas Barakat , Niao He

Multi-agent reinforcement learning is a challenging and active field of research due to the inherent nonstationary property and coupling between agents. A popular approach to modeling the multi-agent interactions underlying the multi-agent…

Multiagent Systems · Computer Science 2025-10-07 Jushan Chen , Santiago Paternain

This paper considers the problem of inverse reinforcement learning in zero-sum stochastic games when expert demonstrations are known to be not optimal. Compared to previous works that decouple agents in the game by assuming optimality in…

Machine Learning · Statistics 2018-06-07 Xingyu Wang , Diego Klabjan

A significant roadblock to the development of principled multi-agent reinforcement learning is the fact that desired solution concepts like Nash equilibria may be intractable to compute. To overcome this obstacle, we take inspiration from…

Computer Science and Game Theory · Computer Science 2024-08-28 Eric Mazumdar , Kishan Panaganti , Laixi Shi

Multi-agent reinforcement learning (MARL) provides an efficient way for simultaneously learning policies for multiple agents interacting with each other. However, in scenarios requiring complex interactions, existing algorithms can suffer…

Machine Learning · Computer Science 2022-03-08 Xiaobai Ma , David Isele , Jayesh K. Gupta , Kikuo Fujimura , Mykel J. Kochenderfer

This paper addresses the problem of multi-agent inverse reinforcement learning (MIRL) in a two-player general-sum stochastic game framework. Five variants of MIRL are considered: uCS-MIRL, advE-MIRL, cooE-MIRL, uCE-MIRL, and uNE-MIRL, each…

Machine Learning · Computer Science 2021-01-01 Xiaomin Lin , Stephen C. Adams , Peter A. Beling

In order for agents in multi-agent systems (MAS) to be safe, they need to take into account the risks posed by the actions of other agents. However, the dominant paradigm in game theory (GT) assumes that agents are not affected by risk from…

Machine Learning · Computer Science 2023-03-03 Oliver Slumbers , David Henry Mguni , Stephen Marcus McAleer , Stefano B. Blumberg , Jun Wang , Yaodong Yang

A central problem in the theory of multi-agent reinforcement learning (MARL) is to understand what structural conditions and algorithmic principles lead to sample-efficient learning guarantees, and how these considerations change as we move…

Machine Learning · Computer Science 2023-05-02 Dylan J. Foster , Dean P. Foster , Noah Golowich , Alexander Rakhlin

This paper studies multi-agent reinforcement learning in Markov games, with the goal of learning Nash equilibria or coarse correlated equilibria (CCE) sample-optimally. All prior results suffer from at least one of the two obstacles: the…

Machine Learning · Computer Science 2022-10-13 Gen Li , Yuejie Chi , Yuting Wei , Yuxin Chen

We characterize offline data poisoning attacks on Multi-Agent Reinforcement Learning (MARL), where an attacker may change a data set in an attempt to install a (potentially fictitious) unique Markov-perfect Nash equilibrium for a two-player…

Multiagent Systems · Computer Science 2024-06-19 Young Wu , Jeremy McMahan , Xiaojin Zhu , Qiaomin Xie