English
Related papers

Related papers: Accelerate Multi-Agent Reinforcement Learning in Z…

200 papers

Multi-agent reinforcement learning (MARL) optimizes strategic interactions in non-cooperative dynamic games, where agents have misaligned objectives. However, data-driven methods such as multi-agent policy gradients (MA-PG) often suffer…

Systems and Control · Electrical Eng. & Systems 2026-02-13 Jingqi Li , Gechen Qu , Jason J. Choi , Somayeh Sojoudi , Claire Tomlin

Text-based games are a popular testbed for language-based reinforcement learning (RL). In previous work, deep Q-learning is commonly used as the learning agent. Q-learning algorithms are challenging to apply to complex real-world domains…

Machine Learning · Computer Science 2023-06-28 Weichen Li , Rati Devidze , Sophie Fellenz

Multi-agent reinforcement learning (MARL) algorithms often struggle to find strategies close to Pareto optimal Nash Equilibrium, owing largely to the lack of efficient exploration. The problem is exacerbated in sparse-reward settings,…

Machine Learning · Computer Science 2024-05-03 Zhicheng Zhang , Yancheng Liang , Yi Wu , Fei Fang

This paper considers the problem of inverse reinforcement learning in zero-sum stochastic games when expert demonstrations are known to be not optimal. Compared to previous works that decouple agents in the game by assuming optimality in…

Machine Learning · Statistics 2018-06-07 Xingyu Wang , Diego Klabjan

This paper considers the problem of designing optimal algorithms for reinforcement learning in two-player zero-sum games. We focus on self-play algorithms which learn the optimal policy by playing against itself without any direct…

Machine Learning · Computer Science 2020-07-15 Yu Bai , Chi Jin , Tiancheng Yu

Robustness against adversarial attacks and distribution shifts is a long-standing goal of Reinforcement Learning (RL). To this end, Robust Adversarial Reinforcement Learning (RARL) trains a protagonist against destabilizing forces exercised…

Machine Learning · Computer Science 2023-11-06 Aryaman Reddi , Maximilian Tölle , Jan Peters , Georgia Chalvatzaki , Carlo D'Eramo

We develop provably efficient reinforcement learning algorithms for two-player zero-sum finite-horizon Markov games with simultaneous moves. To incorporate function approximation, we consider a family of Markov games where the reward…

Machine Learning · Computer Science 2020-06-25 Qiaomin Xie , Yudong Chen , Zhaoran Wang , Zhuoran Yang

Reinforcement learning from self-play has recently reported many successes. Self-play, where the agents compete with themselves, is often used to generate training data for iterative policy improvement. In previous work, heuristic rules are…

Machine Learning · Computer Science 2020-09-15 Yuanyi Zhong , Yuan Zhou , Jian Peng

Sparse rewards are a major bottleneck in multi-agent reinforcement learning (MARL), where simultaneous learning induces non-stationarity and makes reward design especially delicate. Reward shaping can accelerate learning, but in the…

Multiagent Systems · Computer Science 2026-05-25 Elie Abboud , Oren Gal

Zero-shot coordination problem in multi-agent reinforcement learning (MARL), which requires agents to adapt to unseen agents, has attracted increasing attention. Traditional approaches often rely on the Self-Play (SP) framework to generate…

Multiagent Systems · Computer Science 2024-11-05 Weifan Long , Wen Wen , Peng Zhai , Lihua Zhang

We propose a deep reinforcement learning approach for solving a mapless navigation problem in warehouse scenarios. In our approach, an automation guided vehicle is equipped with LiDAR and frontal RGB sensors and learns to perform a targeted…

Robotics · Computer Science 2022-03-17 Honghu Xue , Benedikt Hein , Mohamed Bakr , Georg Schildbach , Bengt Abel , Elmar Rueckert

Robust Reinforcement Learning (RL) focuses on improving performances under model errors or adversarial attacks, which facilitates the real-life deployment of RL agents. Robust Adversarial Reinforcement Learning (RARL) is one of the most…

Machine Learning · Computer Science 2022-09-27 Peide Huang , Mengdi Xu , Fei Fang , Ding Zhao

Cybersecurity defense involves interactions between adversarial parties (namely defenders and hackers), making multi-agent reinforcement learning (MARL) an ideal approach for modeling and learning strategies for these scenarios. This paper…

Multiagent Systems · Computer Science 2025-09-03 Qintong Xie , Edward Koh , Xavier Cadet , Peter Chin

Coordinating multiple large language models (LLMs) to solve complex tasks collaboratively poses a fundamental trade-off between the computation costs and collective performance compared with individual model. We introduce a novel,…

Artificial Intelligence · Computer Science 2025-08-05 Yunhao Liang , Yuan Qu , Jingyuan Yang , Shaochong Lin , Zuo-Jun Max Shen

Multiagent reinforcement learning (MARL) has achieved a remarkable amount of success in solving various types of video games. A cornerstone of this success is the auto-curriculum framework, which shapes the learning process by continually…

Artificial Intelligence · Computer Science 2021-02-17 Yaodong Yang , Jun Luo , Ying Wen , Oliver Slumbers , Daniel Graves , Haitham Bou Ammar , Jun Wang , Matthew E. Taylor

This work focuses on equilibrium selection in no-conflict multi-agent games, where we specifically study the problem of selecting a Pareto-optimal Nash equilibrium among several existing equilibria. It has been shown that many…

Machine Learning · Computer Science 2023-10-17 Filippos Christianos , Georgios Papoudakis , Stefano V. Albrecht

Various methods for Multi-Agent Reinforcement Learning (MARL) have been developed with the assumption that agents' policies are based on accurate state information. However, policies learned through Deep Reinforcement Learning (DRL) are…

Artificial Intelligence · Computer Science 2024-04-15 Songyang Han , Sanbao Su , Sihong He , Shuo Han , Haizhao Yang , Shaofeng Zou , Fei Miao

Multi-Agent Reinforcement Learning (MARL) -- where multiple agents learn to interact in a shared dynamic environment -- permeates across a wide range of critical applications. While there has been substantial progress on understanding the…

Computer Science and Game Theory · Computer Science 2022-10-05 Shicong Cen , Yuejie Chi , Simon S. Du , Lin Xiao

In this paper, we consider cooperative multi-agent reinforcement learning (MARL) with sparse reward. To tackle this problem, we propose a novel method named MASER: MARL with subgoals generated from experience replay buffer. Under the…

Machine Learning · Computer Science 2022-06-23 Jeewon Jeon , Woojun Kim , Whiyoung Jung , Youngchul Sung

Self-play, a learning paradigm where agents iteratively refine their policies by interacting with historical or concurrent versions of themselves or other evolving agents, has shown remarkable success in solving complex non-cooperative…

Artificial Intelligence · Computer Science 2025-10-21 Ruize Zhang , Zelai Xu , Chengdong Ma , Chao Yu , Wei-Wei Tu , Wenhao Tang , Shiyu Huang , Deheng Ye , Wenbo Ding , Yaodong Yang , Yu Wang