中文
相关论文

相关论文: Equilibrium Selection in Multi-Agent Policy Gradie…

200 篇论文

We study the problem of computing an approximate Nash equilibrium of continuous-action game without access to gradients. Such game access is common in reinforcement learning settings, where the environment is typically treated as a black…

计算机科学与博弈论 · 计算机科学 2023-08-30 Carlos Martin , Tuomas Sandholm

Systems of competing agents can often be modeled as games. Assuming rationality, the most likely outcomes are given by an equilibrium (e.g. a Nash equilibrium). In many practical settings, games are influenced by context, i.e. additional…

机器学习 · 计算机科学 2024-06-13 Daniel McKenzie , Howard Heaton , Qiuwei Li , Samy Wu Fung , Stanley Osher , Wotao Yin

Multi-agent reinforcement learning (MARL) optimizes strategic interactions in non-cooperative dynamic games, where agents have misaligned objectives. However, data-driven methods such as multi-agent policy gradients (MA-PG) often suffer…

系统与控制 · 电气工程与系统科学 2026-02-13 Jingqi Li , Gechen Qu , Jason J. Choi , Somayeh Sojoudi , Claire Tomlin

We test the performance of deep deterministic policy gradient (DDPG), a deep reinforcement learning algorithm, able to handle continuous state and action spaces, to learn Nash equilibria in a setting where firms compete in prices. These…

计算机科学与博弈论 · 计算机科学 2025-09-30 Christoph Graf , Viktor Zobernig , Johannes Schmidt , Claude Klöckl

In this paper, we investigate the impact of introducing relative entropy regularization on the Nash Equilibria (NE) of General-Sum $N$-agent games, revealing the fact that the NE of such games conform to linear Gaussian policies. Moreover,…

计算机科学与博弈论 · 计算机科学 2024-09-16 Muhammad Aneeq uz Zaman , Shubham Aggarwal , Melih Bastopcu , Tamer Başar

We study decentralized learning in two-player zero-sum discounted Markov games where the goal is to design a policy optimization algorithm for either agent satisfying two properties. First, the player does not need to know the policy of the…

计算机科学与博弈论 · 计算机科学 2023-03-07 Zhuoqing Song , Jason D. Lee , Zhuoran Yang

We study the problem of finding the Nash equilibrium in a two-player zero-sum Markov game. Due to its formulation as a minimax optimization program, a natural approach to solve the problem is to perform gradient descent/ascent with respect…

最优化与控制 · 数学 2022-10-13 Sihan Zeng , Thinh T. Doan , Justin Romberg

Several multiagent reinforcement learning (MARL) algorithms have been proposed to optimize agents decisions. Due to the complexity of the problem, the majority of the previously developed MARL algorithms assumed agents either had some…

机器学习 · 计算机科学 2014-01-16 Sherief Abdallah , Victor Lesser

We study the problem of computing an approximate Nash equilibrium of a game whose strategy space is continuous without access to gradients of the utility function. Such games arise, for example, when players' strategies are represented by…

计算机科学与博弈论 · 计算机科学 2025-10-28 Carlos Martin , Tuomas Sandholm

Many large-scale platforms and networked control systems have a centralized decision maker interacting with a massive population of agents under strict observability constraints. Motivated by such applications, we study a cooperative Markov…

多智能体系统 · 计算机科学 2026-05-12 Emile Anand , Ishani Karmarkar

Consider a set of agents who play a network game repeatedly. Agents may not know the network. They may even be unaware that they are interacting with other agents in a network. Possibly, they just understand that their payoffs depend on an…

理论经济学 · 经济学 2022-07-26 Pierpaolo Battigalli , Fabrizio Panebianco , Paolo Pin

In this work, we study the interaction of strategic agents in continuous action Cournot games with limited information feedback. Cournot game is the essential market model for many socio-economic systems where agents learn and compete…

最优化与控制 · 数学 2020-09-15 Yuanyuan Shi , Baosen Zhang

Repeated games consider a situation where multiple agents are motivated by their independent rewards throughout learning. In general, the dynamics of their learning become complex. Especially when their rewards compete with each other like…

计算机科学与博弈论 · 计算机科学 2023-05-23 Yuma Fujimoto , Kaito Ariu , Kenshi Abe

In game-theoretic learning, several agents are simultaneously following their individual interests, so the environment is non-stationary from each player's perspective. In this context, the performance of a learning algorithm is often…

计算机科学与博弈论 · 计算机科学 2021-10-19 Yu-Guan Hsieh , Kimon Antonakopoulos , Panayotis Mertikopoulos

Correlated equilibria arise naturally when agents communicate or rely on intermediaries such as recommendation systems. We study when a given Nash equilibrium can be improved within the set of correlated equilibria for general objectives.…

理论经济学 · 经济学 2026-05-01 Kirill Rudov , Fedor Sandomirskiy , Leeat Yariv

In this work, we study the system of interacting non-cooperative two Q-learning agents, where one agent has the privilege of observing the other's actions. We show that this information asymmetry can lead to a stable outcome of population…

机器学习 · 计算机科学 2021-01-26 Ezra Tampubolon , Haris Ceribasic , Holger Boche

We study the global convergence of policy optimization for finding the Nash equilibria (NE) in zero-sum linear quadratic (LQ) games. To this end, we first investigate the landscape of LQ games, viewing it as a nonconvex-nonconcave…

机器学习 · 计算机科学 2021-02-12 Kaiqing Zhang , Zhuoran Yang , Tamer Başar

We consider payoff-based learning of a generalized Nash equilibrium (GNE) in multi-agent systems. Our focus is on games with jointly convex constraints of a linear structure and strongly monotone pseudo-gradients. We present a convergent…

最优化与控制 · 数学 2025-07-18 Tatiana Tatarenko , Maryam Kamgarpour

For effective matching of resources (e.g., taxis, food, bikes, shopping items) to customer demand, aggregation systems have been extremely successful. In aggregation systems, a central entity (e.g., Uber, Food Panda, Ofo) aggregates supply…

机器学习 · 计算机科学 2020-03-17 Tanvi Verma , Pradeep Varakantham

The use of reinforcement learning algorithms in financial trading is becoming increasingly prevalent. However, the autonomous nature of these algorithms can lead to unexpected outcomes that deviate from traditional game-theoretical…

交易与市场微观结构 · 定量金融 2026-02-16 Fabrizio Lillo , Andrea Macrì