English
Related papers

Related papers: Strategy Improvement, the Simplex Algorithm and Lo…

200 papers

Projected policy gradient under the simplex parameterization, policy gradient and natural policy gradient under the softmax parameterization, are fundamental algorithms in reinforcement learning. There have been a flurry of recent…

Optimization and Control · Mathematics 2024-04-12 Jiacai Liu , Wenye Li , Ke Wei

Graph games with {\omega}-regular winning conditions provide a mathematical framework to analyze a wide range of problems in the analysis of reactive systems and programs (such as the synthesis of reactive systems, program repair, and the…

Data Structures and Algorithms · Computer Science 2017-06-16 Krishnendu Chatterjee , Wolfgang Dvořák , Monika Henzinger , Veronika Loitzenbauer

This paper aims to solve the optimal strategy against a well-known adaptive algorithm, the Hedge algorithm, in a finitely repeated $2\times 2$ zero-sum game. In the literature, related theoretical results are very rare. To this end, we make…

Optimization and Control · Mathematics 2023-12-18 Xinxiang Guo , Yifen Mu

We construct a semi-Lagrangian scheme for first-order, time-dependent, and non-local Mean Field Games. The convergence of the scheme to a weak solution of the system is analyzed by exploiting a key monotonicity property. To solve the…

Numerical Analysis · Mathematics 2026-05-12 Elisabetta Carlini , Valentina Coscetti

In this paper, we propose a simple global optimisation algorithm inspired by Pareto's principle. This algorithm samples most of its solutions within prominent search domains and is equipped with a self-adaptive mechanism to control the…

Optimization and Control · Mathematics 2021-03-30 Mahmoud Shaqfa , Katrin Beyer

Algorithmic decisions made by machine learning models in high-stakes domains may have lasting impacts over time. However, naive applications of standard fairness criterion in static settings over temporal domains may lead to delayed and…

Machine Learning · Computer Science 2022-03-01 Jianfeng Chi , Jian Shen , Xinyi Dai , Weinan Zhang , Yuan Tian , Han Zhao

Stochastic games generalize Markov decision processes (MDPs) to a multiagent setting by allowing the state transitions to depend jointly on all player actions, and having rewards determined by multiplayer matrix games at each state. We…

Computer Science and Game Theory · Computer Science 2013-01-18 Michael Kearns , Yishay Mansour , Satinder Singh

Consider a very simple class of (finite) games: after an initial move by nature, each player makes one move. Moreover, the players have common interests: at each node, all the players get the same payoff. We show that the problem of…

Computer Science and Game Theory · Computer Science 2007-05-23 Francis Chu , Joseph Y. Halpern

This thesis presents some geometric insights into three different types of two player prediction games -- namely general learning task, prediction with expert advice, and online convex optimization. These games differ in the nature of the…

Machine Learning · Computer Science 2018-05-23 Parameswaran Kamalaruban

We study strategic games on weighted directed graphs, in which the payoff of a player is defined as the sum of the weights on the edges from players who chose the same strategy, augmented by a fixed non-negative integer bonus for picking a…

Computer Science and Game Theory · Computer Science 2021-03-15 Krzysztof R. Apt , Sunil Simon , Dominik Wojtczak

An important challenge in non-cooperative game theory is coordinating on a single (approximate) equilibrium from many possibilities - a challenge that becomes even more complex when players hold private information. Recommender mechanisms…

Computer Science and Game Theory · Computer Science 2025-05-30 Bengisu Guresti , Chongjie Zhang , Yevgeniy Vorobeychik

We consider two-player games played in real time on game structures with clocks where the objectives of players are described using parity conditions. The games are \emph{concurrent} in that at each turn, both players independently propose…

Logic in Computer Science · Computer Science 2019-03-14 Krishnendu Chatterjee , Thomas A. Henzinger , Vinayak S. Prabhu

We study a simple adaptive model in the framework of an N -player normal form game. The model consists of a repeated game where the players only know their own action space and their own payoff scored at each stage, not those of the other…

Computer Science and Game Theory · Computer Science 2017-06-12 Mario Bravo

Many real-world domains contain multiple agents behaving strategically with probabilistic transitions and uncertain (potentially infinite) duration. Such settings can be modeled as stochastic games. While algorithms have been developed for…

Computer Science and Game Theory · Computer Science 2020-06-25 Sam Ganzfried , Conner Laughlin , Charles Morefield

This paper studies how improved monitoring affects the limit equilibrium payoff set for stochastic games with imperfect public monitoring. We introduce a simple generalization of Blackwell garbling called weighted garbling in order to…

Theoretical Economics · Economics 2025-11-11 Daehyun Kim , Ichiro Obara

We introduce a modification of Perron's method, where semi-solutions are considered in a carefully defined asymptotic sense. With this definition, we can show, in a rather elementary way, that in a zero-sum game or a control problem (with…

Optimization and Control · Mathematics 2015-02-20 Mihai Sîrbu

We introduce and study incentive equilibria for multi-player meanpayoff games. Incentive equilibria generalise well-studied solution concepts such as Nash equilibria and leader equilibria (also known as Stackelberg equilibria). Recall that…

Computer Science and Game Theory · Computer Science 2015-11-03 Anshul Gupta , M. S. Krishna Deepak , Bharath Kumar Padarthi , Sven Schewe , Ashutosh Trivedi

Regret minimization is a general approach to online optimization which plays a crucial role in many algorithms for approximating Nash equilibria in two-player zero-sum games. The literature mainly focuses on solving individual games in…

Computer Science and Game Theory · Computer Science 2025-04-29 David Sychrovský , Martin Schmid , Michal Šustr , Michael Bowling

We give an algorithm for solving stochastic parity games with almost-sure winning conditions on lossy channel systems, for the case where the players are restricted to finite-memory strategies. First, we describe a general framework, where…

Computer Science and Game Theory · Computer Science 2013-06-14 Parosh Aziz Abdulla , Lorenzo Clemente , Richard Mayr , Sven Sandberg

We study decentralized learning in two-player zero-sum discounted Markov games where the goal is to design a policy optimization algorithm for either agent satisfying two properties. First, the player does not need to know the policy of the…

Computer Science and Game Theory · Computer Science 2023-03-07 Zhuoqing Song , Jason D. Lee , Zhuoran Yang