English
Related papers

Related papers: Fast Planning in Stochastic Games

200 papers

In this paper, we introduce discrete-time linear mean-field games subject to an infinite-horizon discounted-cost optimality criterion. The state space of a generic agent is a compact Borel space. At every time, each agent is randomly…

Systems and Control · Electrical Eng. & Systems 2023-01-18 Naci Saldi

We address payoff-based decentralized learning in infinite-horizon zero-sum Markov games. In this setting, each player makes decisions based solely on received rewards, without observing the opponent's strategy or actions nor sharing…

Computer Science and Game Theory · Computer Science 2025-02-11 Reda Ouhamma , Maryam Kamgarpour

We describe a new complete algorithm for computing Nash equilibrium in multiplayer general-sum games, based on a quadratically-constrained feasibility program formulation. We demonstrate that the algorithm runs significantly faster than the…

Computer Science and Game Theory · Computer Science 2023-01-18 Sam Ganzfried

Stochastic differential games have been used extensively to model agents' competitions in Finance, for instance, in P2P lending platforms from the Fintech industry, the banking system for systemic risk, and insurance markets. The recently…

Optimization and Control · Mathematics 2021-03-23 Jiequn Han , Ruimeng Hu , Jihao Long

We present a framework for computing approximate mixed-strategy Nash equilibria of continuous-action games. It is a modification of the traditional double oracle algorithm, extended to multiple players and continuous action spaces. Unlike…

Computer Science and Game Theory · Computer Science 2024-06-14 Carlos Martin , Tuomas Sandholm

In this paper, we consider two-player zero-sum matrix and stochastic games and develop learning dynamics that are payoff-based, convergent, rational, and symmetric between the two players. Specifically, the learning dynamics for matrix…

Machine Learning · Computer Science 2024-09-06 Zaiwei Chen , Kaiqing Zhang , Eric Mazumdar , Asuman Ozdaglar , Adam Wierman

We study the complexity of computing stationary Nash equilibrium (NE) in n-player infinite-horizon general-sum stochastic games. We focus on the problem of computing NE in such stochastic games when each player is restricted to choosing a…

Computer Science and Game Theory · Computer Science 2022-11-30 Yujia Jin , Vidya Muthukumar , Aaron Sidford

Nash equilibrium is a key concept in game theory fundamental for elucidating the equilibrium state of strategic interactions, finding applications in diverse fields such as economics, political science, and biology. However, the Nash…

Computer Science and Game Theory · Computer Science 2024-04-02 Elie Eshoa , Ali R. Zomorrodi

While multi-agent reinforcement learning (MARL) has produced numerous algorithms that converge to Nash or related equilibria, such equilibria are often non-unique and can exhibit widely varying efficiency. This raises a fundamental…

Computer Science and Game Theory · Computer Science 2026-01-29 Runyu Zhang , Gioele Zardini , Asuman Ozdaglar , Jeff Shamma , Na Li

We consider the problem of computing mixed Nash equilibria of two-player zero-sum games with continuous sets of pure strategies and with first-order access to the payoff function. This problem arises for example in game-theory-inspired…

Optimization and Control · Mathematics 2025-09-04 Guillaume Wang , Lénaïc Chizat

We analyse the computational complexity of finding Nash equilibria in stochastic multiplayer games with $\omega$-regular objectives. While the existence of an equilibrium whose payoff falls into a certain interval may be undecidable, we…

Computer Science and Game Theory · Computer Science 2010-06-24 Michael Ummels , Dominik Wojtczak

We consider for the first time a stochastic generalized Nash equilibrium problem, i.e., with expected-value cost functions and joint feasibility constraints, under partial-decision information, meaning that the agents communicate only with…

Optimization and Control · Mathematics 2021-06-02 Barbara Franci , Sergio Grammatico

We introduce a framework for stochastic games on large sparse graphs, covering continuous-time and discrete-time dynamic games as well as static games. Players are indexed by the vertices of simple, locally finite graphs, allowing both…

Optimization and Control · Mathematics 2026-02-27 Eyal Neuman , Sturmius Tuschmann

We study finite-player dynamic stochastic games with heterogeneous interactions and non-Markovian linear-quadratic objective functionals. We derive the Nash equilibrium explicitly by converting the first-order conditions into a coupled…

Optimization and Control · Mathematics 2024-11-12 Eyal Neuman , Sturmius Tuschmann

Equilibria of realistic multiplayer games constitute a key solution concept both in practical applications, such as online advertising auctions and electricity markets, and in analytical frameworks used to study strategic voting in…

Computer Science and Game Theory · Computer Science 2025-11-18 Jakub Černý , Shuvomoy Das Gupta , Christian Kroer

Mean field games (MFGs) model equilibria in games with a continuum of weakly interacting players as limiting systems of symmetric $n$-player games. We consider the finite-state, infinite-horizon problem with ergodic cost. Assuming Markovian…

Optimization and Control · Mathematics 2025-03-25 Asaf Cohen , Ethan Zell

Synthesis of finite-state controllers from high-level specifications in multi-agent systems can be reduced to solving multi-player concurrent games over finite graphs. The complexity of solving such games with qualitative objectives for…

Computer Science and Game Theory · Computer Science 2018-09-28 Shaull Almagor , Rajeev Alur , Suguman Bansal

This paper addresses the problem of learning a Nash equilibrium in $\gamma$-discounted multiplayer general-sum Markov Games (MG). A key component of this model is the possibility for the players to either collaborate or team apart to…

Computer Science and Game Theory · Computer Science 2017-03-07 Julien Pérolat , Florian Strub , Bilal Piot , Olivier Pietquin

Nash equilibrium has long been a desired solution concept in multi-player games, especially for those on continuous strategy spaces, which have attracted a rapidly growing amount of interests due to advances in research applications such as…

Computer Science and Game Theory · Computer Science 2019-10-29 Zehao Dou , Xiang Yan , Dongge Wang , Xiaotie Deng

The distributed computation of equilibria and optima has seen growing interest in a broad collection of networked problems. We consider the computation of equilibria of convex stochastic Nash games characterized by a possibly nonconvex…

Optimization and Control · Mathematics 2019-08-05 Jinlong Lei , Uday V. Shanbhag