English
Related papers

Related papers: Population-size-Aware Policy Optimization for Mean…

200 papers

In this paper, we consider both finite and infinite horizon discounted dynamic mean-field games where there is a large population of homogeneous players sequentially making strategic decisions and each player is affected by other players…

Computer Science and Game Theory · Computer Science 2019-10-23 Deepanshu Vasal

Evolutionary game theory is a successful mathematical framework geared towards understanding the selective pressures that affect the evolution of the strategies of agents engaged in interactions with potential conflicts. While a…

Populations and Evolution · Quantitative Biology 2016-09-01 Christoph Adami , Jory Schossau , Arend Hintze

Throughout scientific history, overarching theoretical frameworks have allowed researchers to grow beyond personal intuitions and culturally biased theories. They allow to verify and replicate existing findings, and to link is connected…

Artificial Intelligence · Computer Science 2020-06-09 Daniel Hernandez , Kevin Denamganai , Sam Devlin , Spyridon Samothrakis , James Alfred Walker

The Policy-Space Response Oracles (PSRO) framework scales equilibrium computation to large zero-sum games by iteratively expanding a restricted strategy set using deep reinforcement learning (DRL). A central challenge is to construct, under…

Artificial Intelligence · Computer Science 2026-05-28 Junyu Zhang , Feihong Yang , Jian Wang , Chao Wang , Xudong Zhang

Experience replay enables reinforcement learning agents to memorize and reuse past experiences, just as humans replay memories for the situation at hand. Contemporary off-policy algorithms either replay past experiences uniformly or utilize…

Machine Learning · Computer Science 2019-06-21 Daochen Zha , Kwei-Herng Lai , Kaixiong Zhou , Xia Hu

As AI technology advances, research in playing text-based games with agents has becomeprogressively popular. In this paper, a novel approach to agent design and agent learning ispresented with the context of reinforcement learning. A model…

Computation and Language · Computer Science 2025-09-04 Haonan Wang , Mingjia Zhao , Junfeng Sun , Wei Liu

Multi-agent reinforcement learning, despite its popularity and empirical success, faces significant scalability challenges in large-population dynamic games. Graphon mean field games (GMFGs) offer a principled framework for approximating…

Optimization and Control · Mathematics 2025-06-09 Philipp Plank , Yufei Zhang

Conventions are crucial for strong performance in cooperative multi-agent games, because they allow players to coordinate on a shared strategy without explicit communication. Unfortunately, standard multi-agent reinforcement learning…

Artificial Intelligence · Computer Science 2023-10-25 Bidipta Sarkar , Andy Shih , Dorsa Sadigh

Mean Field Games (MFGs) provide a powerful framework for modeling the collective behavior of large populations of interacting agents. In this paper, we address the problem of Imitation Learning (IL) in MFGs subject to common noise, where…

Machine Learning · Computer Science 2026-05-06 Grégoire Lambrecht , Mathieu Laurière

Learning in strategy games (e.g. StarCraft, poker) requires the discovery of diverse policies. This is often achieved by iteratively training new policies against existing ones, growing a policy population that is robust to exploit. This…

Artificial Intelligence · Computer Science 2022-02-16 Siqi Liu , Luke Marris , Daniel Hennes , Josh Merel , Nicolas Heess , Thore Graepel

This study investigates cooperation evolution mechanisms in the spatial public goods game. A novel deep reinforcement learning framework, Proximal Policy Optimization with Adversarial Curriculum Transfer (PPO-ACT), is proposed to model…

Computer Science and Game Theory · Computer Science 2025-07-03 Zhaoqilin Yang , Chanchan Li , Xin Wang , Youliang Tian

In this paper, we consider discrete-time partially observed mean-field games with the risk-sensitive optimality criterion. We introduce risk-sensitivity behaviour for each agent via an exponential utility function. In the game model, each…

Systems and Control · Electrical Eng. & Systems 2022-11-11 Naci Saldi , Tamer Basar , Maxim Raginsky

Adversarial optimization algorithms that explicitly search for flaws in agents' policies have been successfully applied to finding robust and diverse policies in multi-agent settings. However, the success of adversarial optimization has…

Artificial Intelligence · Computer Science 2025-11-13 Niklas Lauffer , Ameesh Shah , Micah Carroll , Sanjit A. Seshia , Stuart Russell , Michael Dennis

Game theory serves as a powerful tool for distributed optimization in multi-agent systems in different applications. In this paper we consider multi-agent systems that can be modeled by means of potential games whose potential function…

Optimization and Control · Mathematics 2018-04-13 Tatiana Tatarenko

In this paper we propose a method that learns to play Pac-Man. We define a set of high-level observation and action modules. Actions are temporally extended, and multiple action modules may be in effect concurrently. A decision of the agent…

Machine Learning · Computer Science 2007-05-23 Istvan Szita , Andras Lorincz

Multi-agent reinforcement learning methods have shown remarkable potential in solving complex multi-agent problems but mostly lack theoretical guarantees. Recently, mean field control and mean field games have been established as a…

Machine Learning · Computer Science 2021-12-20 Kai Cui , Anam Tahir , Mark Sinzger , Heinz Koeppl

Training large language models (LLMs) as interactive agents for controlling graphical user interfaces (GUIs) presents a unique challenge to optimize long-horizon action sequences with multimodal feedback from complex environments. While…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Fanbin Lu , Zhisheng Zhong , Shu Liu , Chi-Wing Fu , Jiaya Jia

We study the problem of training a Reinforcement Learning (RL) agent that is collaborative with humans without using any human data. Although such agents can be obtained through self-play training, they can suffer significantly from…

Artificial Intelligence · Computer Science 2022-06-28 Rui Zhao , Jinming Song , Yufeng Yuan , Hu Haifeng , Yang Gao , Yi Wu , Zhongqian Sun , Yang Wei

This paper studies an $N$--agent cost-coupled game where the agents are connected via an unreliable capacity constrained network. Each agent receives state information over that network which loses packets with probability $p$. A Base…

Systems and Control · Electrical Eng. & Systems 2023-03-17 Shubham Aggarwal , Muhammad Aneeq uz Zaman , Melih Bastopcu , Tamer Başar

In single-agent Markov decision processes, an agent can optimize its policy based on the interaction with environment. In multi-player Markov games (MGs), however, the interaction is non-stationary due to the behaviors of other players, so…

Computer Science and Game Theory · Computer Science 2021-10-19 Yuanheng Zhu , Dongbin Zhao , Mengchen Zhao , Dong Li