English
Related papers

Related papers: Decentralized Q-Learning in Zero-sum Markov Games

200 papers

This paper addresses a critical challenge in the high-speed passenger railway industry: designing effective dynamic pricing strategies in the context of competing and cooperating operators. To address this, a multi-agent reinforcement…

While many robotic tasks can be addressed using either centralized single-agent control with full state observation or decentralized multi-agent control, clear criteria for choosing between these approaches remain underexplored. This paper…

This work studies the application of Multi-Agent Reinforcement Learning (MARL) to decentralized control of unmanned aerial vehicles to relay a critical data package to a known position. For this purpose, a family of deterministic games is…

Systems and Control · Electrical Eng. & Systems 2026-05-11 Mika Persson , Jonas Lidman , Jacob Ljungberg , Samuel Sandelius , Adam Andersson

We develop a Multi-Agent Reinforcement Learning (MARL) method to learn scalable control policies for target tracking. Our method can handle an arbitrary number of pursuers and targets; we show results for tasks consisting up to 1000…

Multiagent Systems · Computer Science 2021-11-11 Christopher D. Hsu , Heejin Jeong , George J. Pappas , Pratik Chaudhari

Designing efficient algorithms for multi-agent reinforcement learning (MARL) is fundamentally challenging because the size of the joint state and action spaces grows exponentially in the number of agents. These difficulties are exacerbated…

Machine Learning · Computer Science 2025-10-27 Emile Anand , Ishani Karmarkar , Guannan Qu

Multi-Agent Reinforcement Learning (MARL) considers settings in which a set of coexisting agents interact with one another and their environment. The adaptation and learning of other agents induces non-stationarity in the environment…

Machine Learning · Computer Science 2020-06-09 Ian Davies , Zheng Tian , Jun Wang

We propose a novel independent and payoff-based learning framework for stochastic games that is model-free, game-agnostic, and gradient-free. The learning dynamics follow a best-response-type actor-critic architecture, where agents update…

Machine Learning · Computer Science 2026-02-03 Ahmed Said Donmez , Yuksel Arslantas , Muhammed O. Sayin

The paper considers a class of multi-agent Markov decision processes (MDPs), in which the network agents respond differently (as manifested by the instantaneous one-stage random costs) to a global controlled state and the control actions of…

Machine Learning · Statistics 2015-06-04 Soummya Kar , Jose' M. F. Moura , H. Vincent Poor

Recently, deep multiagent reinforcement learning (MARL) has become a highly active research area as many real-world problems can be inherently viewed as multiagent systems. A particularly interesting and widely applicable class of problems…

Multiagent Systems · Computer Science 2020-02-11 Yaodong Yang , Jianye Hao , Guangyong Chen , Hongyao Tang , Yingfeng Chen , Yujing Hu , Changjie Fan , Zhongyu Wei

Multi-agent Reinforcement Learning (MARL) problems often require cooperation among agents in order to solve a task. Centralization and decentralization are two approaches used for cooperation in MARL. While fully decentralized methods are…

Multiagent Systems · Computer Science 2021-11-30 Bengisu Guresti , Nazim Kemal Ure

While there has been substantial success for solving continuous control with actor-critic methods, simpler critic-only methods such as Q-learning find limited application in the associated high-dimensional action spaces. However, most…

Machine Learning · Computer Science 2023-09-27 Tim Seyde , Peter Werner , Wilko Schwarting , Igor Gilitschenski , Martin Riedmiller , Daniela Rus , Markus Wulfmeier

Many advances in cooperative multi-agent reinforcement learning (MARL) are based on two common design principles: value decomposition and parameter sharing. A typical MARL algorithm of this fashion decomposes a centralized Q-function into…

Artificial Intelligence · Computer Science 2022-08-09 Wei Fu , Chao Yu , Zelai Xu , Jiaqi Yang , Yi Wu

The focus of this paper is a Bayesian framework for solving a class of problems termed multi-agent inverse reinforcement learning (MIRL). Compared to the well-known inverse reinforcement learning (IRL) problem, MIRL is formalized in the…

Computer Science and Game Theory · Computer Science 2019-07-31 Xiaomin Lin , Peter A. Beling , Randy Cogill

We introduce hybrid execution in multi-agent reinforcement learning (MARL), a new paradigm in which agents aim to successfully complete cooperative tasks with arbitrary communication levels at execution time by taking advantage of…

Machine Learning · Computer Science 2023-06-06 Pedro P. Santos , Diogo S. Carvalho , Miguel Vasco , Alberto Sardinha , Pedro A. Santos , Ana Paiva , Francisco S. Melo

We study the problem of learning a Nash equilibrium (NE) in Markov games which is a cornerstone in multi-agent reinforcement learning (MARL). In particular, we focus on infinite-horizon adversarial team Markov games (ATMGs) in which agents…

Computer Science and Game Theory · Computer Science 2024-10-10 Fivos Kalogiannis , Jingming Yan , Ioannis Panageas

Much work has been dedicated to the exploration of Multi-Agent Reinforcement Learning (MARL) paradigms implementing a centralized learning with decentralized execution (CLDE) approach to achieve human-like collaboration in cooperative…

Multiagent Systems · Computer Science 2023-07-26 Piyush K. Sharma , Rolando Fernandez , Erin Zaroukian , Michael Dorothy , Anjon Basak , Derrik E. Asher

Reinforcement learning (RL) has recently achieved tremendous successes in many artificial intelligence applications. Many of the forefront applications of RL involve multiple agents, e.g., playing chess and Go games, autonomous driving, and…

Computer Science and Game Theory · Computer Science 2021-11-24 Asuman Ozdaglar , Muhammed O. Sayin , Kaiqing Zhang

Self-play, a learning paradigm where agents iteratively refine their policies by interacting with historical or concurrent versions of themselves or other evolving agents, has shown remarkable success in solving complex non-cooperative…

Artificial Intelligence · Computer Science 2025-10-21 Ruize Zhang , Zelai Xu , Chengdong Ma , Chao Yu , Wei-Wei Tu , Wenhao Tang , Shiyu Huang , Deheng Ye , Wenbo Ding , Yaodong Yang , Yu Wang

The behaviour of multi-agent learning in many player games has been shown to display complex dynamics outside of restrictive examples such as network zero-sum games. In addition, it has been shown that convergent behaviour is less likely to…

Computer Science and Game Theory · Computer Science 2023-07-27 Aamal Hussain , Dan Leonte , Francesco Belardinelli , Georgios Piliouras

Multi-agent reinforcement learning tasks put a high demand on the volume of training samples. Different from its single-agent counterpart, distributed value-based multi-agent reinforcement learning faces the unique challenges of demanding…

Machine Learning · Computer Science 2021-12-06 Siyang Wu , Tonghan Wang , Chenghao Li , Yang Hu , Chongjie Zhang