English
Related papers

Related papers: Efficient exploration of zero-sum stochastic games

200 papers

Given subsets of uncertain values, we study the problem of identifying the subset of minimum total value (sum of the uncertain values) by querying as few values as possible. This set selection problem falls into the field of explorable…

Data Structures and Algorithms · Computer Science 2023-06-16 Nicole Megow , Jens Schlöter

Decentralized team problems where players have asymmetric information about the state of the underlying stochastic system have been actively studied, but \emph{games} between such teams are less understood. We consider a general model of…

Multiagent Systems · Computer Science 2021-09-29 Dhruva Kartik , Ashutosh Nayyar , Urbashi Mitra

We study online reinforcement learning in average-reward stochastic games (SGs). An SG models a two-player zero-sum game in a Markov environment, where state transitions and one-step payoffs are determined simultaneously by a learner and an…

Machine Learning · Computer Science 2017-12-05 Chen-Yu Wei , Yi-Te Hong , Chi-Jen Lu

We study a two-player, zero-sum, stochastic game with incomplete information on one side in which the players are allowed to play more and more frequently. The informed player observes the realization of a Markov chain on which the payoffs…

Optimization and Control · Mathematics 2013-07-15 Pierre Cardaliaguet , Catherine Rainer , Dinah Rosenberg , Nicolas Vieille

The optimal value computation for turned-based stochastic games with reachability objectives, also known as simple stochastic games, is one of the few problems in $NP \cap coNP$ which are not known to be in $P$. However, there are some…

Computational Complexity · Computer Science 2014-08-10 David Auger , Pierre COUCHENEY , Yann Strozecki

We propose a stochastic first-order algorithm to learn the rationality parameters of simultaneous and non-cooperative potential games, i.e., the parameters of the agents' optimization problems. Our technique combines (i.) an active-set step…

Optimization and Control · Mathematics 2023-07-31 Stefan Clarke , Gabriele Dragotto , Jaime Fernández Fisac , Bartolomeo Stellato

Games, in their mathematical sense, are everywhere (game industries, economics, defense, education, chemistry, biology, ...).Search algorithms in games are artificial intelligence methods for playing such games. Unfortunately, there is no…

Artificial Intelligence · Computer Science 2025-05-16 Quentin Cohen-Solal

Stochastic games are often used to model reactive processes. We consider the problem of synthesizing an optimal almost-sure winning strategy in a two-player (namely a system and its environment) turn-based stochastic game with both a…

Systems and Control · Computer Science 2015-11-03 Min Wen , Ufuk Topcu

A reinforcement learning agent tries to maximize its cumulative payoff by interacting in an unknown environment. It is important for the agent to explore suboptimal actions as well as to pick actions with highest known rewards. Yet, in…

Machine Learning · Computer Science 2019-01-23 Reazul Hasan Russel

We study a class of stochastic target games where one player tries to find a strategy such that the state process almost-surely reaches a given target, no matter which action is chosen by the opponent. Our main result is a geometric dynamic…

Probability · Mathematics 2015-02-03 Bruno Bouchard , Marcel Nutz

We consider zero-sum stochastic differential games with possibly path-dependent controlled state. Unlike the previous literature, we allow for weak solutions of the state equation so that the players' controls are automatically of feedback…

Probability · Mathematics 2018-08-14 Dylan Possamaï , Nizar Touzi , Jianfeng Zhang

This work lies in the fusion of experimental economics and data mining. It continues author's previous work on mining behaviour rules of human subjects from experimental data, where game-theoretic predictions partially fail to work.…

Computer Science and Game Theory · Computer Science 2012-11-13 Rustam Tagiew

Fighting Fantasy is a popular recreational fantasy gaming system worldwide. Combat in this system progresses through a stochastic game involving a series of rounds, each of which may be won or lost. Each round, a limited resource (`luck')…

Artificial Intelligence · Computer Science 2020-02-25 Iain G. Johnston

In this paper we study how to play (stochastic) games optimally using little space. We focus on repeated games with absorbing states, a type of two-player, zero-sum concurrent mean-payoff games. The prototypical example of these games is…

Computer Science and Game Theory · Computer Science 2016-04-27 Kristoffer Arnsfelt Hansen , Rasmus Ibsen-Jensen , Michal Koucký

We study decision-making with rational inattention in settings where agents have perception constraints. In such settings, inaccurate prior beliefs or models of others may lead to inattention blindness, where an agent is unaware of its…

Computer Science and Game Theory · Computer Science 2025-10-06 Mustafa O. Karabag , Jesse Milzman , Ufuk Topcu

Stochastic optimization is a widely used approach for optimization under uncertainty, where uncertain input parameters are modeled by random variables. Exact or approximation algorithms have been obtained for several fundamental problems in…

Machine Learning · Computer Science 2025-08-14 Arpit Agarwal , Rohan Ghuge , Viswanath Nagarajan , Zhengjia Zhuo

People can evaluate features of problems and their potential solutions well before we can effectively solve them. When considering a game we have never played, for instance, we might infer whether it is likely to be challenging, fair, or…

Computer Science and Game Theory · Computer Science 2025-02-10 Cedegao E. Zhang , Katherine M. Collins , Lionel Wong , Mauricio Barba , Adrian Weller , Joshua B. Tenenbaum

The principle that rational agents should maximize expected utility or choiceworthiness is intuitively plausible in many ordinary cases of decision-making under uncertainty. But it is less plausible in cases of extreme, low-probability risk…

Theoretical Economics · Economics 2020-08-11 Christian Tarsney

The human intrinsic desire to pursue knowledge, also known as curiosity, is considered essential in the process of skill acquisition. With the aid of artificial curiosity, we could equip current techniques for control, such as Reinforcement…

Machine Learning · Computer Science 2022-02-24 Pietro Mazzaglia , Ozan Catal , Tim Verbelen , Bart Dhoedt

Real-world applications require RL algorithms to act safely. During learning process, it is likely that the agent executes sub-optimal actions that may lead to unsafe/poor states of the system. Exploration is particularly brittle in…

Machine Learning · Statistics 2019-06-17 Elena Smirnova , Elvis Dohmatob , Jérémie Mary