English
Related papers

Related papers: The turnpike theorems for Markov games

200 papers

We establish the turnpike property for linear quadratic control problems for which the control operator is admissible and may be unbounded, under quite general and natural assumptions. The turnpike property has been well studied for bounded…

Optimization and Control · Mathematics 2025-06-03 Hoai-Minh Nguyen , Emmanuel Trélat

We consider a zero-sum stochastic game for continuous-time Markov chain with countable state space and unbounded transition and pay-off rates. The additional feature of the game is that the controllers together with taking actions are also…

Optimization and Control · Mathematics 2020-09-01 Chandan Pal , Subhamay Saha

This work is concerned with the exponential turnpike property for optimal control problems of particle systems and their mean-field limit. Under the assumption of the strict dissipativity of the cost function, exponential estimates for both…

Optimization and Control · Mathematics 2025-09-10 Michael Herty , Yizhou Zhou

A new solution concept for two-player zero-sum matrix games with multi-dimensional payoff is introduced. It is based on extensions of vector orders in K-dimensional spaces to order relations in their power sets, so-called set relations, and…

Optimization and Control · Mathematics 2017-01-31 Andreas H. Hamel , Andreas Loehne

In this paper we describe an approach to resolve strategic games in which players can assume different types along the game. Our goal is to infer which type the opponent is adopting at each moment so that we can increase the player's odds.…

Computer Science and Game Theory · Computer Science 2014-04-02 Mario Benevides , Isaque Lima , Rafael Nader , Pedro Rougemont

We study minority games in efficient regime. By incorporating the utility function and aggregating agents with similar strategies we develop an effective mesoscale notion of state of the game. Using this approach, the game can be…

Adaptation and Self-Organizing Systems · Physics 2011-12-06 Karol Wawrzyniak , Wojciech Wislicki

Game-theoretic concepts have been extensively studied in economics to provide insight into competitive behaviour and strategic decision making. As computing systems increasingly involve concurrently acting autonomous agents, game-theoretic…

Formal Languages and Automata Theory · Computer Science 2022-07-01 Marta Kwiatkowska , Gethin Norman , David Parker , Gabriel Santos , Rui Yan

A sequence of spin-1/2 particles polarised in one of two possible directions is presented to an experimenter, who can wager in a double-or-nothing game on the outcomes of measurements in freely chosen polarisation directions. Wealth is…

Quantum Physics · Physics 2023-08-03 Bernhard K Meister , Henry C W Price

In this article, we establish exponential turnpike theorems for a class of nonlinear deterministic meanfield optimal control problems. We carry out our analysis simultaneously in the so-called Lagrangian and Eulerian frameworks. In the…

Optimization and Control · Mathematics 2026-05-05 Benoît Bonnet-Weill , Giovanni Colombo , Denis Shishmintsev , Emmanuel Trélat

We consider two-player games played over finite state spaces for an infinite number of rounds. At each state, the players simultaneously choose moves; the moves determine a successor state. It is often advantageous for players to choose…

Logic in Computer Science · Computer Science 2015-07-01 Luca de Alfaro , Rupak Majumdar , Vishwanath Raman , Mariëlle Stoelinga

Similar to the role of Markov decision processes in reinforcement learning, Stochastic Games (SGs) lay the foundation for the study of multi-agent reinforcement learning (MARL) and sequential agent interactions. In this paper, we derive…

Computer Science and Game Theory · Computer Science 2023-01-12 Xiaotie Deng , Ningyuan Li , David Mguni , Jun Wang , Yaodong Yang

We consider 2-player stochastic games with perfectly observed actions, and study the limit, as the discount factor goes to one, of the equilibrium payoffs set. In the usual setup where current states are observed by the players, we show…

Optimization and Control · Mathematics 2014-12-11 Jérôme Renault , Bruno Ziliotto

We study a two-player zero-sum stochastic differential game with asymmetric information where the payoff depends on a controlled continuous-time Markov chain X with finite state space which is only observed by player 1. This model was…

Optimization and Control · Mathematics 2018-02-26 Fabien Gensbittel

Game theory has grown into a major field over the past few decades, and poker has long served as one of its key case studies. Game-Theory-Optimal (GTO) provides strategies to avoid loss in poker, but pure GTO does not guarantee maximum…

Computer Science and Game Theory · Computer Science 2025-09-30 SeungHyun Yi , Seungjun Yi

We introduce the notion of universal graphs as a tool for constructing algorithms solving games of infinite duration such as parity games and mean payoff games. In the first part we develop the theory of universal graphs, with two goals:…

Formal Languages and Automata Theory · Computer Science 2023-06-22 Thomas Colcombet , Nathanaël Fijalkow , Paweł Gawrychowski , Pierre Ohlmann

Infinite games (in the form of Gale-Stewart games) are studied where a play is a sequence of natural numbers chosen by two players in alternation, the winning condition being a subset of the Baire space $\omega^\omega$. We consider such…

Computer Science and Game Theory · Computer Science 2023-06-22 Benedikt Brütsch , Wolfgang Thomas

This paper studies the finite-time horizon Markov games where the agents' dynamics are decoupled but the rewards can possibly be coupled across agents. The policy class is restricted to local policies where agents make decisions using their…

Computer Science and Game Theory · Computer Science 2023-04-11 Runyu Zhang , Yuyang Zhang , Rohit Konda , Bryce Ferguson , Jason Marden , Na Li

In this paper, we settle the sampling complexity of solving discounted two-player turn-based zero-sum stochastic games up to polylogarithmic factors. Given a stochastic game with discount factor $\gamma\in(0,1)$ we provide an algorithm that…

Machine Learning · Computer Science 2019-08-30 Aaron Sidford , Mengdi Wang , Lin F. Yang , Yinyu Ye

We consider the problem of two-player zero-sum games. This problem is formulated as a min-max Markov game in the literature. The solution of this game, which is the min-max payoff, starting from a given state is called the min-max value of…

Machine Learning · Computer Science 2022-03-21 Raghuram Bharadwaj Diddigi , Chandramouli Kamanchi , Shalabh Bhatnagar

This work is mainly concerned with the so-called limit theory for mean-field games. Adopting the weak formulation paradigm put forward by Carmona and Lacker, we consider a fully non-Markovian setting allowing for drift control and…

Probability · Mathematics 2023-12-25 Dylan Possamaï , Ludovic Tangpi