English
Related papers

Related papers: Nonstationary nonzero-sum Markov games under a pro…

200 papers

We consider a general type of non-Markovian impulse control problems under adverse non-linear expectation or, more specifically, the zero-sum game problem where the adversary player decides the probability measure. We show that the upper…

Optimization and Control · Mathematics 2022-06-30 Magnus Perninge

In this paper, we investigate a partially observable zero sum games where the state process is a discrete time Markov chain. We consider a general utility function in the optimization criterion. We show the existence of value for both…

Optimization and Control · Mathematics 2022-11-16 Arnab Bhabak , Subhamay saha

This paper considers a two-person zero-sum continuous-time Markov pure jump game in Borel state and action spaces over a fixed finite horizon. The main assumption on the model is the existence of a drift function, which bounds the reward…

Optimization and Control · Mathematics 2017-03-31 Xin Guo , Yi Zhang

Zero-sum stochastic games have found important applications in a variety of fields, from machine learning to economics. Work on this model has primarily focused on the computation of Nash equilibrium due to its effectiveness in solving…

Computer Science and Game Theory · Computer Science 2022-11-28 Denizalp Goktas , Jiayi Zhao , Amy Greenwald

This survey is organized around three main topics: models, econometrics, and empirical applications. Section 2 presents the theoretical framework, introduces the concept of Markov Perfect Nash Equilibrium, discusses existence and…

Econometrics · Economics 2021-09-17 Victor Aguirregabiria , Allan Collard-Wexler , Stephen P. Ryan

The paper is concerned with a variant of the continuous-time finite state Markov game of control and stopping where both players can affect transition rates, while only one player can choose a stopping time. We use the dynamic programming…

Optimization and Control · Mathematics 2022-08-09 Yurii Averboukh

We study nonzero-sum hypothesis testing games that arise in the context of adversarial classification, in both the Bayesian as well as the Neyman-Pearson frameworks. We first show that these games admit mixed strategy Nash equilibria, and…

Computer Science and Game Theory · Computer Science 2019-10-01 Sarath Yasodharan , Patrick Loiseau

We present a framework that incorporates the idea of bounded rationality into dynamic stochastic pursuit-evasion games. The solution of a stochastic game is characterized, in general, by its (Nash) equilibria in feedback form. However,…

Systems and Control · Electrical Eng. & Systems 2020-03-17 Yue Guan , Dipankar Maity , Christopher M. Kroninger , Panagiotis Tsiotras

Markov games model interactions among multiple players in a stochastic, dynamic environment. Each player in a Markov game maximizes its expected total discounted reward, which depends upon the policies of the other players. We formulate a…

Computer Science and Game Theory · Computer Science 2023-09-11 Shenghui Chen , Yue Yu , David Fridovich-Keil , Ufuk Topcu

This paper is concerned with the development of rigorous approximations to various expectations associated with Markov chains and processes having non-stationary transition probabilities. Such non-stationary models arise naturally in…

Probability · Mathematics 2018-05-07 Zeyu Zheng , Harsha Honnappa , Peter W. Glynn

Policy gradient methods enjoy strong practical performance in numerous tasks in reinforcement learning. Their theoretical understanding in multiagent settings, however, remains limited, especially beyond two-player competitive and potential…

Computer Science and Game Theory · Computer Science 2023-12-22 Ioannis Anagnostides , Ioannis Panageas , Gabriele Farina , Tuomas Sandholm

Through a stochastic control theoretic approach, we analyze reputation games where a strategic long-lived player acts in a sequential repeated game against a collection of short-lived players. The key assumption in our model is that the…

Optimization and Control · Mathematics 2020-01-22 Nuh Aygün Dalkıran , Serdar Yüksel

In many multi-player interactions, players incur strictly positive costs each time they execute actions e.g. 'menu costs' or transaction costs in financial systems. Since acting at each available opportunity would accumulate prohibitively…

Multiagent Systems · Computer Science 2024-08-02 David Mguni

We consider a stochastic differential equation that is controlled by means of an additive finite-variation process. A singular stochastic controller, who is a minimizer, determines this finite-variation process, while a discretionary…

Probability · Mathematics 2015-01-20 Daniel Hernandez-Hernandez , Robert S. Simon , Mihail Zervos

The $N$-player quantum game is analyzed in the context of an Einstein-Podolsky-Rosen (EPR) experiment. In this setting, a player's strategies are not unitary transformations as in alternate quantum game-theoretic frameworks, but a classical…

Quantum Physics · Physics 2012-11-16 James M. Chappell , Azhar Iqbal , Derek Abbott

In this work, we study the distributed Nash equilibrium seeking problem for monotone generalized noncooperative games with set constraints and shared affine inequality constraints. A distributed regularized penalty method is proposed. The…

Optimization and Control · Mathematics 2021-09-28 Chao Sun , Guoqiang Hu

We study the complexity of computing stationary Nash equilibrium (NE) in n-player infinite-horizon general-sum stochastic games. We focus on the problem of computing NE in such stochastic games when each player is restricted to choosing a…

Computer Science and Game Theory · Computer Science 2022-11-30 Yujia Jin , Vidya Muthukumar , Aaron Sidford

We consider a finite-horizon, zero-sum game in which both players control a stochastic differential equation by invoking impulses. We derive a control randomization formulation of the game and use the existence of a value for the randomized…

Optimization and Control · Mathematics 2025-05-13 Magnus Perninge

In single-agent Markov decision processes, an agent can optimize its policy based on the interaction with environment. In multi-player Markov games (MGs), however, the interaction is non-stationary due to the behaviors of other players, so…

Computer Science and Game Theory · Computer Science 2021-10-19 Yuanheng Zhu , Dongbin Zhao , Mengchen Zhao , Dong Li

This paper investigates a fully distributed adaptive Nash equilibrium (NE) seeking algorithm for constrained noncooperative games with prescribed-time stability. On the one hand, prescribed-time stability for the proposed NE seeking…

Optimization and Control · Mathematics 2024-11-07 Sichen Qian