English
Related papers

Related papers: Reactive Synthesis Without Regret

200 papers

We extend the classic regret minimization framework for approximating equilibria in normal-form games by greedily weighing iterates based on regrets observed at runtime. Theoretically, our method retains all previous convergence rate…

Computer Science and Game Theory · Computer Science 2022-04-12 Hugh Zhang , Adam Lerer , Noam Brown

Using methods from the statistical mechanics of disordered systems we analyze the properties of bimatrix games with random payoffs in the limit where the number of pure strategies of each player tends to infinity. We analytically calculate…

Disordered Systems and Neural Networks · Physics 2009-10-31 Johannes Berg

We study two-player games played on the infinite graph of sentential forms induced by a context-free grammar (that comes with an ownership partitioning of the non-terminals). The winning condition is inclusion of the derived terminal word…

Logic in Computer Science · Computer Science 2016-11-02 Lukáš Holík , Roland Meyer , Sebastian Muskalla

We tackle the problem of learning equilibria in simulation-based games. In such games, the players' utility functions cannot be described analytically, as they are given through a black-box simulator that can be queried to obtain noisy…

Computer Science and Game Theory · Computer Science 2020-02-26 Alberto Marchesi , Francesco Trovò , Nicola Gatti

We investigate zero-sum turn-based two-player stochastic games in which the objective of one player is to maximize the amount of rewards obtained during a play, while the other aims at minimizing it. We focus on games in which the minimizer…

Logic in Computer Science · Computer Science 2022-05-20 Pablo F. Castro , Pedro R. D'Argenio , Luciano Putruele , Ramiro Demasi

We consider regret minimization in repeated games with a very large number of actions. Such games are inherent in the setting of AI Safety via Debate \cite{irving2018ai}, and more generally games whose actions are language-based. Existing…

Computer Science and Game Theory · Computer Science 2024-07-12 Xinyi Chen , Angelica Chen , Dean Foster , Elad Hazan

In a monogamy-of-entanglement (MoE) game, two players who do not communicate try to simultaneously guess a referee's measurement outcome on a shared quantum state they prepared. We study the prototypical example of a game where the referee…

Quantum Physics · Physics 2023-03-03 Anne Broadbent , Eric Culf

No-regret learning has been widely used to compute a Nash equilibrium in two-person zero-sum games. However, there is still a lack of regret analysis for network stochastic zero-sum games, where players competing in two subnetworks only…

Optimization and Control · Mathematics 2022-05-31 Shijie Huang , Jinlong Lei , Yiguang Hong

A natural goal in multiagent learning besides finding equilibria is to learn rationalizable behavior, where players learn to avoid iteratively dominated actions. However, even in the basic setting of multiplayer general-sum games, existing…

Machine Learning · Computer Science 2022-10-21 Yuanhao Wang , Dingwen Kong , Yu Bai , Chi Jin

No-regret self-play learning dynamics have become one of the premier ways to solve large-scale games in practice. Accelerating their convergence via improving the regret of the players over the naive $O(\sqrt{T})$ bound after $T$ rounds has…

Machine Learning · Computer Science 2025-02-26 Shinji Ito , Haipeng Luo , Taira Tsuchiya , Yue Wu

In the game-theoretic approach to controller synthesis, we model the interaction between a system to be controlled and its environment as a game between these entities, and we seek an appropriate (e.g., winning or optimal) strategy for the…

Logic in Computer Science · Computer Science 2025-09-05 Mickael Randour

Most of the literature on learning in games has focused on the restrictive setting where the underlying repeated game does not change over time. Much less is known about the convergence of no-regret learning algorithms in dynamic multiagent…

Machine Learning · Computer Science 2023-10-19 Ioannis Anagnostides , Ioannis Panageas , Gabriele Farina , Tuomas Sandholm

We provide, to the best of our knowledge, the first computational study of extensive-form adversarial team games. These games are sequential, zero-sum games in which a team of players, sharing the same utility function, faces an adversary.…

Artificial Intelligence · Computer Science 2017-11-21 Andrea Celli , Nicola Gatti

This paper presents a recursive reasoning formalism of Bayesian optimization (BO) to model the reasoning process in the interactions between boundedly rational, self-interested agents with unknown, complex, and costly-to-evaluate payoff…

Machine Learning · Computer Science 2020-07-01 Zhongxiang Dai , Yizhou Chen , Kian Hsiang Low , Patrick Jaillet , Teck-Hua Ho

We report on new stability conditions for evolutionary dynamics in the context of population games. We adhere to the prevailing framework consisting of many agents, grouped into populations, that interact noncooperatively by selecting…

Populations and Evolution · Quantitative Biology 2021-07-08 Semih Kara , Nuno C. Martins

We show that Optimistic Hedge -- a common variant of multiplicative-weights-updates with recency bias -- attains ${\rm poly}(\log T)$ regret in multi-player general-sum games. In particular, when every player of the game uses Optimistic…

Machine Learning · Computer Science 2023-01-26 Constantinos Daskalakis , Maxwell Fishelson , Noah Golowich

In this paper, we consider zero-sum repeated games in which the maximizer is restricted to strategies requiring no more than a limited amount of randomness. Particularly, we analyze the maxmin payoff of the maximizer in two models: the…

Information Theory · Computer Science 2018-10-11 Mehrdad Valizadeh , Amin Gohari

Traffic scenarios are inherently interactive. Multiple decision-makers predict the actions of others and choose strategies that maximize their rewards. We view these interactions from the perspective of game theory which introduces various…

Machine Learning · Computer Science 2020-04-28 Christian Muench , Frans A. Oliehoek , Dariu M. Gavrila

Infinitely repeated games can support cooperative outcomes that are not equilibria in the one-shot game. The idea is to make sure that any gains from deviating will be offset by retaliation in future rounds. However, this model of…

Computer Science and Game Theory · Computer Science 2024-06-04 Ratip Emin Berker , Vincent Conitzer

We consider the celebrated Blackwell Approachability Theorem for two-player games with vector payoffs. We show that Blackwell's result is equivalent, via efficient reductions, to the existence of "no-regret" algorithms for Online Linear…

Machine Learning · Computer Science 2010-11-10 Jacob Abernethy , Peter L. Bartlett , Elad Hazan