English
Related papers

Related papers: Reducing Stochastic Games to Semidefinite Program …

200 papers

We consider discrete time partially observable zero-sum stochastic game with average payoff criterion. We study the game using an equivalent completely observable game. We show that the game has a value and also we come up with a pair of…

Optimization and Control · Mathematics 2014-09-16 Subhamay Saha

The completely bounded trace and spectral norms, for finite-dimensional spaces, are known to be efficiently expressible by semidefinite programs (J. Watrous, Theory of Computing 5: 11, 2009). This paper presents two new, and arguably much…

Quantum Physics · Physics 2012-08-03 John Watrous

We study the computational complexity of approximating general constrained Markov decision processes. Our primary contribution is the design of a polynomial time $(0,\epsilon)$-additive bicriteria approximation algorithm for finding optimal…

Data Structures and Algorithms · Computer Science 2025-02-12 Jeremy McMahan

Mean-payoff games (MPGs) are infinite duration two-player zero-sum games played on weighted graphs. Under the hypothesis of perfect information, they admit memoryless optimal strategies for both players and can be solved in…

Logic in Computer Science · Computer Science 2015-04-14 Paul Hunter , Guillermo A. Pérez , Jean-François Raskin

In mean-payoff games, the objective of the protagonist is to ensure that the limit average of an infinite sequence of numeric weights is nonnegative. In energy games, the objective is to ensure that the running sum of weights is always…

Logic in Computer Science · Computer Science 2010-10-05 Krishnendu Chatterjee , Laurent Doyen , Thomas A. Henzinger , Jean-Francois Raskin

We present examples of equations arising in the theory of mean field games that can be reduced to a system in smaller dimensions. Such examples come up in certain applications, and they can be used as modeling tools to numerically…

Analysis of PDEs · Mathematics 2021-05-07 Jean-Michel Lasry , Pierre-Louis Lions , Benjamin Seeger

Many real-world problems modeled by stochastic games have huge state and/or action spaces, leading to the well-known curse of dimensionality. The complexity of the analysis of large-scale systems is dramatically reduced by exploiting mean…

Systems and Control · Computer Science 2015-03-19 H. Tembine

We extend anytime constraints to the Markov game setting and the corresponding solution concept of an anytime-constrained equilibrium (ACE). Then, we present a comprehensive theory of anytime-constrained equilibria that includes (1) a…

Machine Learning · Computer Science 2025-03-05 Jeremy McMahan

We consider the reachability problem for higher-order functional programs and study the relationship between reachability games (i.e., the reachability problem for programs with angelic and demonic nondeterminism) and may-reachability…

Logic in Computer Science · Computer Science 2024-09-16 Kazuyuki Asada , Hiroyuki Katsura , Naoki Kobayashi

We consider a deterministic mean field games problem in which a typical agent solves an optimal control problem where the dynamics is affine with respect to the control and the cost functional has a growth which is polynomial with respect…

Optimization and Control · Mathematics 2023-05-03 Justina Gianatti , Francisco J. Silva , Ahmad Zorkot

We discuss the application of random projections to conic programming: notably linear, second-order and semidefinite programs. We prove general approximation results on feasibility and optimality using the framework of formally real Jordan…

Optimization and Control · Mathematics 2021-01-13 Leo Liberti , Pierre-Louis Poirion , Ky Vu

Definable zero-sum stochastic games involve a finite number of states and action sets, reward and transition functions that are definable in an o-minimal structure. Prominent examples of such games are finite, semi-algebraic or globally…

Optimization and Control · Mathematics 2015-01-05 Jérôme Bolte , Stéphane Gaubert , Guillaume Vigeral

We give polynomial time algorithms for deciding almost-sure and limit-sure reachability in Branching Concurrent Stochastic Games (BCSGs). These are a class of infinite-state imperfect-information stochastic games that generalize both…

Computer Science and Game Theory · Computer Science 2019-04-25 Kousha Etessami , Emanuel Martinov , Alistair Stewart , Mihalis Yannakakis

We consider an assignment problem that has aspects of fair division as well as social choice. In particular, we investigate the problem of assigning a small subset from a set of indivisible items to multiple players so that the chosen…

Computer Science and Game Theory · Computer Science 2019-02-06 Warut Suksompong

Parity games play an important role in model checking and synthesis. In their paper, Calude et al. have shown that these games can be solved in quasi-polynomial time. We show that their algorithm can be implemented efficiently: we use their…

Logic in Computer Science · Computer Science 2018-01-30 John Fearnley , Sanjay Jain , Sven Schewe , Frank Stephan , Dominik Wojtczak

We study stochastic games with energy-parity objectives, which combine quantitative rewards with a qualitative $\omega$-regular condition: The maximizer aims to avoid running out of energy while simultaneously satisfying a parity condition.…

Computer Science and Game Theory · Computer Science 2021-01-19 Richard Mayr , Sven Schewe , Patrick Totzke , Dominik Wojtczak

We investigate the resolution of second-order, potential, and monotone mean field games with the generalized conditional gradient algorithm, an extension of the Frank-Wolfe algorithm. We show that the method is equivalent to the fictitious…

Optimization and Control · Mathematics 2023-08-22 Pierre Lavigne , Laurent Pfeiffer

Stochastic two-player games model systems with an environment that is both adversarial and stochastic. In this paper, we study the expected value of bounded quantitative prefix-independent objectives in the context of stochastic games. We…

Computer Science and Game Theory · Computer Science 2025-08-01 Laurent Doyen , Pranshu Gaba , Shibashis Guha

In many multiagent environments, a designer has some, but limited control over the game being played. In this paper, we formalize this by considering incompletely specified games, in which some entries of the payoff matrices can be chosen…

Computer Science and Game Theory · Computer Science 2021-04-30 Markus Brill , Rupert Freeman , Vincent Conitzer

Traditional solvable game theory and mean-field-type game theory (risk-aware games) predominantly focus on quadratic costs due to their analytical tractability. Nevertheless, they often fail to capture critical non-linearities inherent in…

Optimization and Control · Mathematics 2025-05-09 Julian Barreiro-Gomez , Tyrone E. Duncan , Bozenna Pasik-Duncan , Hamidou Tembine