English
Related papers

Related papers: Approachability in unknown games: Online learning …

200 papers

Partial order reductions have been successfully applied to model checking of concurrent systems and practical applications of the technique show nontrivial reduction in the size of the explored state space. We present a theory of partial…

Logic in Computer Science · Computer Science 2023-06-22 Frederik Meyer Bønneland , Peter Gjøl Jensen , Kim Guldstrand Larsen , Marco Muñiz , Jiří Srba

We study the problem of guaranteeing low regret in repeated games against an opponent with unknown membership in one of several classes. We add the constraint that our algorithm is non-exploitable, in that the opponent lacks an incentive to…

Computer Science and Game Theory · Computer Science 2022-07-05 Anthony DiGiovanni , Ambuj Tewari

We study algorithms for online linear optimization in Hilbert spaces, focusing on the case where the player is unconstrained. We develop a novel characterization of a large class of minimax algorithms, recovering, and even improving,…

Machine Learning · Computer Science 2014-05-22 H. Brendan McMahan , Francesco Orabona

We consider imperfect information stochastic games where we require the players to use pure (i.e. non randomised) strategies. We consider reachability, safety, B\"uchi and co-B\"uchi objectives, and investigate the existence of…

Formal Languages and Automata Theory · Computer Science 2018-03-28 Arnaud Carayol , Christof Löding , Olivier Serre

Online learning is the process of answering a sequence of questions based on the correct answers to the previous questions. It is studied in many research areas such as game theory, information theory and machine learning. There are two…

Machine Learning · Computer Science 2019-03-27 Ankit Sharma , Late C. A. Murthy

In game-theoretic learning, several agents are simultaneously following their individual interests, so the environment is non-stationary from each player's perspective. In this context, the performance of a learning algorithm is often…

Computer Science and Game Theory · Computer Science 2021-10-19 Yu-Guan Hsieh , Kimon Antonakopoulos , Panayotis Mertikopoulos

Learning theory has largely focused on two main learning scenarios. The first is the classical statistical setting where instances are drawn i.i.d. from a fixed distribution and the second scenario is the online learning, completely…

Machine Learning · Statistics 2011-04-28 Alexander Rakhlin , Karthik Sridharan , Ambuj Tewari

This paper investigates a class of multi-player discrete games where each player aims to maximize its own utility function. Each player does not know the other players' action sets, their deployed actions or the structures of its own or the…

Optimization and Control · Mathematics 2017-12-05 Zhisheng Hu , Minghui Zhu , Ping Chen , Peng Liu

Follow-the-regularized-leader (FTRL) algorithms have become popular in the context of games, providing easy-to-implement methods for each agent, as well as theoretical guarantees that the strategies of all agents will converge to some…

Systems and Control · Electrical Eng. & Systems 2026-03-31 Heling Zhang , Siqi Du , Roy Dong

We consider a variant of the classical online linear optimization problem in which at every step, the online player receives a "hint" vector before choosing the action for that round. Rather surprisingly, it was shown that if the hint…

Machine Learning · Computer Science 2020-10-05 Aditya Bhaskara , Ashok Cutkosky , Ravi Kumar , Manish Purohit

We consider games played on the transition graph of concurrent programs running under the Total Store Order (TSO) weak memory model. Games are frequently used to model the interaction between a system and its environment, in this case…

Logic in Computer Science · Computer Science 2024-11-05 Stephan Spengler

We propose a reinforcement learning (RL) framework for multi-objective decision-making, where the agent seeks to optimize a vector of rewards rather than a single scalar value. The objective is to ensure that the time-averaged reward vector…

Systems and Control · Electrical Eng. & Systems 2025-11-18 Rahul Misra , Manuela L. Bujorianu , Rafał Wisniewski

We study the repeated principal-agent bandit game, where the principal indirectly interacts with the unknown environment by proposing incentives for the agent to play arms. Most existing work assumes the agent has full knowledge of the…

Machine Learning · Computer Science 2025-06-03 Junyan Liu , Lillian J. Ratliff

Consider the task of learning a hypothesis class $\mathcal{H}$ in the presence of an adversary that can replace up to an $\eta$ fraction of the examples in the training set with arbitrary adversarial examples. The adversary aims to fail the…

Machine Learning · Computer Science 2022-10-13 Steve Hanneke , Amin Karbasi , Mohammad Mahmoody , Idan Mehalel , Shay Moran

Strategic interactions between competitive entities are generally considered from the perspective of complete revelation of benefits achieved from those interactions, in the form of public payoff functions and/or beliefs, in the announced…

Computer Science and Game Theory · Computer Science 2020-02-12 Aditya Ahuja

Two-player games on graphs is central in many problems in formal verification and program analysis such as synthesis and verification of open systems. In this work we consider solving recursive game graphs (or pushdown game graphs) that can…

Logic in Computer Science · Computer Science 2016-05-17 Krishnendu Chatterjee , Yaron Velner

We study online learning settings in which experts act strategically to maximize their influence on the learning algorithm's predictions by potentially misreporting their beliefs about a sequence of binary events. Our goal is twofold.…

Machine Learning · Computer Science 2020-07-02 Rupert Freeman , David M. Pennock , Chara Podimata , Jennifer Wortman Vaughan

We initiate the study of online contracts, which integrate the game-theoretic considerations of economic contract theory, with the algorithmic and informational challenges of online algorithm design. Our starting point is the classic online…

Computer Science and Game Theory · Computer Science 2026-02-10 Elad Lavi , Hadas Shachnai , Inbal Talgam-Cohen

Classical reactive synthesis approaches aim to synthesize a reactive system that always satisfies a given specifications. These approaches often reduce to playing a two-player zero-sum game where the goal is to synthesize a winning…

Computer Science and Game Theory · Computer Science 2025-06-09 Karan Muvvala , Qi Heng Ho , Morteza Lahijanian

We present a causality-based algorithm for solving two-player reachability games represented by logical constraints. These games are a useful formalism to model a wide array of problems arising, e.g., in program synthesis. Our technique for…

Logic in Computer Science · Computer Science 2021-06-01 Christel Baier , Norine Coenen , Bernd Finkbeiner , Florian Funke , Simon Jantsch , Julian Siber