English
Related papers

Related papers: A forward algorithm for a class of Markov zero-sum…

200 papers

Zero sum games with risk-sensitive cost criterion are considered with underlying dynamics being given by controlled stochastic differential equations. Under the assumption of geometric stability on the dynamics , we completely characterize…

Optimization and Control · Mathematics 2018-01-04 Anup Biswas , Subhamay Saha

Reinforcement learning has been successful both empirically and theoretically in single-agent settings, but extending these results to multi-agent reinforcement learning in general-sum Markov games remains challenging. This paper studies…

Machine Learning · Computer Science 2026-04-07 Narim Jeong , Donghwan Lee

We first study an optimal stopping problem in which a player (an agent) uses a discrete stopping time in order to stop optimally a payoff process whose risk is evaluated by a (non-linear) $g$-expectation. We then consider a non-zero-sum…

Probability · Mathematics 2017-05-11 Miryana Grigorova , Marie-Claire Quenez

In stochastic dynamic environments, team Markov games have emerged as a versatile paradigm for studying sequential decision-making problems of fully cooperative multi-agent systems. However, the optimality of the derived policies is usually…

Optimization and Control · Mathematics 2022-05-03 Feng Huang , Ming Cao , Long Wang

We propose a new framework of Markov $\alpha$-potential games to study Markov games. We show that any Markov game with finite-state and finite-action is a Markov $\alpha$-potential game, and establish the existence of an associated…

Computer Science and Game Theory · Computer Science 2025-04-02 Xin Guo , Xinyu Li , Chinmay Maheshwari , Shankar Sastry , Manxi Wu

We introduce and analyze a natural game formulated as follows. In this one-person game, the player is given a random permutation $A=(a_1,\dots, a_n)$ of a multiset $M$ of $n$ reals that sum up to $0$, where each of the $n!$ permutation…

Discrete Mathematics · Computer Science 2024-11-21 Adrian Dumitrescu , Arsenii Sagdeev

Probabilistic timed automata are a suitable formalism to model systems with real-time, nondeterministic and probabilistic behaviour. We study two-player zero-sum games on such automata where the objective of the game is specified as the…

Logic in Computer Science · Computer Science 2016-04-18 Vojtěch Forejt , Marta Kwiatkowska , Gethin Norman , Ashutosh Trivedi

In this paper we study how to play (stochastic) games optimally using little space. We focus on repeated games with absorbing states, a type of two-player, zero-sum concurrent mean-payoff games. The prototypical example of these games is…

Computer Science and Game Theory · Computer Science 2016-04-27 Kristoffer Arnsfelt Hansen , Rasmus Ibsen-Jensen , Michal Koucký

We study the problem of repeated play in a zero-sum game in which the payoff matrix may change, in a possibly adversarial fashion, on each round; we call these Online Matrix Games. Finding the Nash Equilibrium (NE) of a two player zero-sum…

Machine Learning · Computer Science 2020-04-06 Adrian Rivera Cardoso , Jacob Abernethy , He Wang , Huan Xu

We study a new class of Markov games, \emph(multi-player) zero-sum Markov Games} with \emph{Networked separable interactions} (zero-sum NMGs), to model the local interaction structure in non-cooperative multi-agent sequential…

Computer Science and Game Theory · Computer Science 2025-07-15 Chanwoo Park , Kaiqing Zhang , Asuman Ozdaglar

Classical game-theoretic approaches for multi-agent systems in both the forward policy design problem and the inverse reward learning problem often make strong rationality assumptions: agents perfectly maximize expected utilities under…

Machine Learning · Computer Science 2021-03-23 Ran Tian , Liting Sun , Masayoshi Tomizuka

This paper develops a new deep learning algorithm to solve a class of finite-horizon mean-field games. The proposed hybrid algorithm uses Markov chain approximation method combined with a stochastic approximation-based iterative deep…

Optimization and Control · Mathematics 2024-12-12 Yu Zhang , Zhuo Jin , Jiaqin Wei , George Yin

This paper investigates properties of Blackwell $\epsilon$-optimal strategies in zero-sum stochastic games when the adversary is restricted to stationary strategies, motivated by applications to robust Markov decision processes. For a class…

Computer Science and Game Theory · Computer Science 2025-03-20 Julien Grand-Clément , Nicolas Vieille

Priced timed games (PTGs) are two-player zero-sum games played on the infinite graph of configurations of priced timed automata where two players take turns to choose transitions in order to optimize cost to reach target states. Bouyer et…

Computer Science and Game Theory · Computer Science 2020-02-18 Thomas Brihaye , Gilles Geeraerts , Shankara Narayanan Krishna , Lakshmi Manasa , Benjamin Monmege , Ashutosh Trivedi

We study Stackelberg equilibria in finitely repeated games, where the leader commits to a strategy that picks actions in each round and can be adaptive to the history of play (i.e. they commit to an algorithm). In particular, we study…

Computer Science and Game Theory · Computer Science 2024-03-08 Natalie Collina , Eshwar Ram Arunachaleswaran , Michael Kearns

In this paper, we consider two-player zero-sum matrix and stochastic games and develop learning dynamics that are payoff-based, convergent, rational, and symmetric between the two players. Specifically, the learning dynamics for matrix…

Machine Learning · Computer Science 2024-09-06 Zaiwei Chen , Kaiqing Zhang , Eric Mazumdar , Asuman Ozdaglar , Adam Wierman

We study the class of reach-avoid dynamic games in which multiple agents interact noncooperatively, and each wishes to satisfy a distinct target criterion while avoiding a failure criterion. Reach-avoid games are commonly used to express…

Systems and Control · Electrical Eng. & Systems 2022-03-03 Dennis R. Anthony , Duy P. Nguyen , David Fridovich-Keil , Jaime F. Fisac

The problem of constrained Markov decision process is considered. An agent aims to maximize the expected accumulated discounted reward subject to multiple constraints on its costs (the number of constraints is relatively small). A new dual…

Optimization and Control · Mathematics 2022-10-21 Egor Gladin , Maksim Lavrik-Karmazin , Karina Zainullina , Varvara Rudenko , Alexander Gasnikov , Martin Takáč

We construct a saddle point in a class of zero-sum games between a stopper and a singular-controller. The underlying dynamics is a one-dimensional, time-homogeneous, singularly controlled diffusion taking values either on $\mathbb{R}$ or on…

Optimization and Control · Mathematics 2024-10-28 Andrea Bovo , Tiziano De Angelis

This paper introduces an explicit algorithm for computing perfect public equilibrium (PPE) payoffs in repeated games with imperfect public monitoring, public randomization, and discounting. The method adapts the established framework by…

Theoretical Economics · Economics 2024-11-05 Jasmina Karabegovic