English
Related papers

Related papers: A fixed-point policy-iteration-type algorithm for …

200 papers

We study nonzero-sum stochastic switching games. Two players compete for market dominance through controlling (via timing options) the discrete-state market regime $M$. Switching decisions are driven by a continuous stochastic factor $X$…

General Economics · Economics 2018-07-23 Liangchen Li , Michael Ludkovski

While discounted payoff games and classic games that reduce to them, like parity and mean-payoff games, are symmetric, their solutions are not. We have taken a fresh view on the properties that optimal solutions need to have, and devised a…

Data Structures and Algorithms · Computer Science 2026-03-11 Daniele Dell'Erba , Arthur Dumas , Sven Schewe

We consider a general type of non-Markovian impulse control problems under adverse non-linear expectation or, more specifically, the zero-sum game problem where the adversary player decides the probability measure. We show that the upper…

Optimization and Control · Mathematics 2022-06-30 Magnus Perninge

In this letter, we study dynamic game optimal control with imperfect state observations and introduce an iterative method to find a local Nash equilibrium. The algorithm consists of an iterative procedure combining a backward recursion…

Optimization and Control · Mathematics 2022-06-24 Armand Jordana , Bilal Hammoud , Justin Carpentier , Ludovic Righetti

In many multi-player interactions, players incur strictly positive costs each time they execute actions e.g. 'menu costs' or transaction costs in financial systems. Since acting at each available opportunity would accumulate prohibitively…

Multiagent Systems · Computer Science 2024-08-02 David Mguni

We introduce and study a class of infinite-horizon non-zero-sum non-cooperative stochastic games with infinitely many interacting agents using ideas of statistical mechanics. First we show, in the general case of asymmetric interactions,…

Probability · Mathematics 2007-08-16 Emilio De Santis , Carlo Marinelli

Many real-world domains contain multiple agents behaving strategically with probabilistic transitions and uncertain (potentially infinite) duration. Such settings can be modeled as stochastic games. While algorithms have been developed for…

Computer Science and Game Theory · Computer Science 2020-06-25 Sam Ganzfried , Conner Laughlin , Charles Morefield

Computing approximate Nash equilibria in multi-player general-sum Markov games is a computationally intractable task. However, multi-player Markov games with certain cooperative or competitive structures might circumvent this…

Computer Science and Game Theory · Computer Science 2023-08-17 Zailin Ma , Jiansheng Yang , Zhihua Zhang

Zero-sum games arise in a wide variety of problems, including robust optimization and adversarial learning. However, algorithms deployed for finding a local Nash equilibrium in these games often converge to non-Nash stationary points. This…

Computer Science and Game Theory · Computer Science 2025-09-30 Kushagra Gupta , Xinjie Liu , Ross Allen , Ufuk Topcu , David Fridovich-Keil

Stochastic games are an important class of problems that generalize Markov decision processes to game theoretic scenarios. We consider finite state two-player zero-sum stochastic games over an infinite time horizon with discounted rewards.…

Optimization and Control · Mathematics 2008-06-17 Parikshit Shah , Pablo A. Parrilo

This article is related to risk-sensitive nonzero-sum stochastic differential games in the Markovian framework. This game takes into account the attitudes of the players toward risk and the utility is of exponential form. We show the…

Optimization and Control · Mathematics 2014-12-04 Said Hamadène , Rui Mu

We study strategic interaction in data-driven games where players face uncertainty about payoff distributions inferred from finite samples. To model calibrated attitudes toward such uncertainty, we formulate distributionally robust games…

Computer Science and Game Theory · Computer Science 2026-05-28 Bharat Gangwani , Arunesh Sinha

This paper considers the discounted criterion of nonzero-sum decentralized stochastic games with prospect players. The state and action spaces are finite. The state transition probability is nonstationary. Each player independently controls…

Optimization and Control · Mathematics 2024-05-16 Yiting Wu , Junyu Zhang

In this work, we establish near-linear and strong convergence for a natural first-order iterative algorithm that simulates Von Neumann's Alternating Projections method in zero-sum games. First, we provide a precise analysis of Optimistic…

Optimization and Control · Mathematics 2021-08-18 Ioannis Anagnostides , Paolo Penna

In this paper, we first devise two algorithms to determine whether or not a bimatrix game has a strategically equivalent zero-sum game. If so, we propose an algorithm that computes the strategically equivalent zero-sum game. If a given…

Computer Science and Game Theory · Computer Science 2021-08-12 Jianzong Pi , Joseph L. Heyman , Abhishek Gupta

We consider strongly monotone games with convex separable coupling constraints, played by dynamical agents, in a partial-decision information scenario. We start by designing continuous-time fully distributed feedback controllers, based on…

Optimization and Control · Mathematics 2021-05-05 Mattia Bianchi , Sergio Grammatico

Nash equilibrium is one of the most influential solution concepts in game theory. With the development of computer science and artificial intelligence, there is an increasing demand on Nash equilibrium computation, especially for Internet…

Computer Science and Game Theory · Computer Science 2023-12-19 Hanyu Li , Wenhan Huang , Zhijian Duan , David Henry Mguni , Kun Shao , Jun Wang , Xiaotie Deng

Synthesizing near-optimal mixed strategies for zero-sum differential games (ZSDGs) has been a longstanding challenge. Existing research mainly focuses on characterizing the theoretical value function, while the practical design of…

Optimization and Control · Mathematics 2026-05-13 Tao Xu , Wang Xi , Jianping He

Many security and other real-world situations are dynamic in nature and can be modelled as strictly competitive (or zero-sum) dynamic games. In these domains, agents perform actions to affect the environment and receive observations --…

Computer Science and Game Theory · Computer Science 2020-10-23 Karel Horák , Branislav Bošanský , Vojtěch Kovařík , Christopher Kiekintveld

Two-player graph games have found numerous applications, most notably in the synthesis of reactive systems from temporal specifications, but also in verification. The relevance of infinite-state systems in these areas has lead to…

Logic in Computer Science · Computer Science 2023-11-08 Philippe Heim , Rayna Dimitrova