English
Related papers

Related papers: Independent RL for Cooperative-Competitive Agents:…

200 papers

Traditional multi-agent reinforcement learning algorithms are not scalable to environments with more than a few agents, since these algorithms are exponential in the number of agents. Recent research has introduced successful methods to…

Multiagent Systems · Computer Science 2021-01-26 Sriram Ganapathi Subramanian , Matthew E. Taylor , Mark Crowley , Pascal Poupart

Financial markets are often driven by latent factors which traders cannot observe. Here, we address an algorithmic trading problem with collections of heterogeneous agents who aim to perform optimal execution or statistical arbitrage, where…

Mathematical Finance · Quantitative Finance 2019-04-02 Philippe Casgrain , Sebastian Jaimungal

Multi-agent reinforcement learning (MARL) has become effective in tackling discrete cooperative game scenarios. However, MARL has yet to penetrate settings beyond those modelled by team and zero-sum games, confining it to a small subset of…

Multiagent Systems · Computer Science 2021-06-16 David Mguni , Yutong Wu , Yali Du , Yaodong Yang , Ziyi Wang , Minne Li , Ying Wen , Joel Jennings , Jun Wang

Reinforcement Learning (RL) is a learning paradigm concerned with learning to control a system so as to maximize an objective over the long term. This approach to learning has received immense interest in recent times and success manifests…

Artificial Intelligence · Computer Science 2018-07-26 Sanyam Kapoor

We explore deep Reinforcement Learning(RL) algorithms for scalping trading and knew that there is no appropriate trading gym and agent examples. Thus we propose gym and agent like Open AI gym in finance. Not only that, we introduce new RL…

Artificial Intelligence · Computer Science 2019-04-02 Uk Jo , Taehyun Jo , Wanjun Kim , Iljoo Yoon , Dongseok Lee , Seungho Lee

In this tutorial, we provide an introduction to machine learning methods for finding Nash equilibria in games with large number of agents. These types of problems are important for the operations research community because of their…

Optimization and Control · Mathematics 2024-06-18 Gokce Dayanikli , Mathieu Lauriere

In an infinitely repeated general-sum pricing game, independent reinforcement learners may exhibit collusive behavior without any communication, raising concerns about algorithmic collusion. To better understand the learning dynamics, we…

General Economics · Economics 2025-10-07 Bingyan Han

This paper considers the challenging tasks of Multi-Agent Reinforcement Learning (MARL) under partial observability, where each agent only sees her own individual observations and actions that reveal incomplete information about the…

Machine Learning · Computer Science 2022-10-18 Qinghua Liu , Csaba Szepesvári , Chi Jin

Coordination is one of the essential problems in multi-agent systems. Typically multi-agent reinforcement learning (MARL) methods treat agents equally and the goal is to solve the Markov game to an arbitrary Nash equilibrium (NE) when…

Multiagent Systems · Computer Science 2020-04-07 Haifeng Zhang , Weizhe Chen , Zeren Huang , Minne Li , Yaodong Yang , Weinan Zhang , Jun Wang

Multi-agent reinforcement learning, despite its popularity and empirical success, faces significant scalability challenges in large-population dynamic games. Graphon mean field games (GMFGs) offer a principled framework for approximating…

Optimization and Control · Mathematics 2025-06-09 Philipp Plank , Yufei Zhang

We develop a game-theoretic framework for predicting and steering the behavior of populations of large language models (LLMs) through Nash equilibrium (NE) analysis. To avoid the intractability of equilibrium computation in open-ended text…

Artificial Intelligence · Computer Science 2026-02-09 Tonghan Wang , Yuqi Pan , Xinyi Yang , Yanchen Jiang , Milind Tambe , David C. Parkes

We design and analyze reinforcement learning algorithms for Graphon Mean-Field Games (GMFGs). In contrast to previous works that require the precise values of the graphons, we aim to learn the Nash Equilibrium (NE) of the regularized GMFGs…

Computer Science and Game Theory · Computer Science 2023-10-27 Fengzhuo Zhang , Vincent Y. F. Tan , Zhaoran Wang , Zhuoran Yang

The intersection of Mean Field Games (MFGs) and Reinforcement Learning (RL) has fostered a growing family of algorithms designed to solve large-scale multi-agent systems. However, the field currently lacks a standardized evaluation…

Machine Learning · Computer Science 2026-02-16 Lorenzo Magnino , Jiacheng Shen , Matthieu Geist , Olivier Pietquin , Mathieu Laurière

Multi-agent reinforcement learning (MARL) lies at the heart of a plethora of applications involving the interaction of a group of agents in a shared unknown environment. A prominent framework for studying MARL is Markov games, with the goal…

Machine Learning · Computer Science 2025-02-17 Tong Yang , Bo Dai , Lin Xiao , Yuejie Chi

We study the problem of training a principal in a multi-agent general-sum game using reinforcement learning (RL). Learning a robust principal policy requires anticipating the worst possible strategic responses of other agents, which is…

Machine Learning · Computer Science 2022-12-21 Eric Zhao , Alexander R. Trott , Caiming Xiong , Stephan Zheng

Mean Field Games (MFG) are the class of games with a very large number of agents and the standard equilibrium concept is a Mean Field Equilibrium (MFE). Algorithms for learning MFE in dynamic MFGs are unknown in general. Our focus is on an…

Optimization and Control · Mathematics 2021-02-02 Kiyeob Lee , Desik Rengarajan , Dileep Kalathil , Srinivas Shakkottai

We present a simulation-based approach for solution of mean field games (MFGs), using the framework of empirical game-theoretical analysis (EGTA). Our primary method employs a version of the double oracle, iteratively adding strategies…

Multiagent Systems · Computer Science 2023-02-14 Yongzhao Wang , Michael P. Wellman

We investigate an infinite-horizon time-inconsistent mean-field game (MFG) in a discrete time setting. We first present a classic equilibrium for the MFG and its associated existence result. This classic equilibrium aligns with the…

Optimization and Control · Mathematics 2024-09-13 Erhan Bayraktar , Zhenhua Wang

The standard Reinforcement Learning from Human Feedback (RLHF) framework primarily focuses on optimizing the performance of large language models using pre-collected prompts. However, collecting prompts that provide comprehensive coverage…

Computation and Language · Computer Science 2024-06-18 Rui Zheng , Hongyi Guo , Zhihan Liu , Xiaoying Zhang , Yuanshun Yao , Xiaojun Xu , Zhaoran Wang , Zhiheng Xi , Tao Gui , Qi Zhang , Xuanjing Huang , Hang Li , Yang Liu

Recent advances in mean-field game literature enable the reduction of large-scale multi-agent problems to tractable interactions between a representative agent and a population distribution. However, existing approaches typically assume a…

Multiagent Systems · Computer Science 2026-02-17 Bhavini Jeloka , Yue Guan , Panagiotis Tsiotras