English
Related papers

Related papers: The IMP game: Learnability, approximability and ad…

200 papers

Imitation learning is an effective alternative approach to learn a policy when the reward function is sparse. In this paper, we consider a challenging setting where an agent and an expert use different actions from each other. We assume…

Machine Learning · Computer Science 2019-08-27 Konrad Zolna , Negar Rostamzadeh , Yoshua Bengio , Sungjin Ahn , Pedro O. Pinheiro

Machine learning relies on the assumption that unseen test instances of a classification problem follow the same distribution as observed training data. However, this principle can break down when machine learning is used to make important…

Machine Learning · Computer Science 2015-11-24 Moritz Hardt , Nimrod Megiddo , Christos Papadimitriou , Mary Wootters

We consider the problem of a learning agent who has to repeatedly play a general sum game against a strategic opponent who acts to maximize their own payoff by optimally responding against the learner's algorithm. The learning agent knows…

Computer Science and Game Theory · Computer Science 2025-02-21 Eshwar Ram Arunachaleswaran , Natalie Collina , Jon Schneider

Here we propose a general theoretical method for analyzing the risk bound in the presence of adversaries. Specifically, we try to fit the adversarial learning problem into the minimax framework. We first show that the original adversarial…

Machine Learning · Statistics 2019-01-25 Zhuozhuo Tu , Jingwei Zhang , Dacheng Tao

We study a game for recognising formal languages, in which two players with imperfect information need to coordinate on a common decision, given private input words correlated by a finite graph. The players have a joint objective to avoid…

Formal Languages and Automata Theory · Computer Science 2016-04-27 Dietmar Berwanger , Marie van den Bogaard

We investigate the repeated prisoner's dilemma game where both players alternately use reinforcement learning to obtain their optimal memory-one strategies. We theoretically solve the simultaneous Bellman optimality equations of…

Computer Science and Game Theory · Computer Science 2021-06-02 Yuki Usui , Masahiko Ueda

Imitation learning algorithms have been interpreted as variants of divergence minimization problems. The ability to compare occupancy measures between experts and learners is crucial in their effectiveness in learning from demonstrations.…

Machine Learning · Computer Science 2022-07-05 Georgios Papagiannis , Yunpeng Li

This paper examines the integration of computational complexity into game theoretic models. The example focused on is the Prisoner's Dilemma, repeated for a finite length of time. We show that a minimal bound on the players' computational…

Computer Science and Game Theory · Computer Science 2007-05-23 Yishay Mor , Jeffrey S. Rosenschein

Today's high-stakes adversarial interactions feature attackers who constantly breach the ever-improving security measures. Deception mitigates the defender's loss by misleading the attacker to make suboptimal decisions. In order to formally…

Artificial Intelligence · Computer Science 2020-06-11 Zheyuan Ryan Shi , Ariel D. Procaccia , Kevin S. Chan , Sridhar Venkatesan , Noam Ben-Asher , Nandi O. Leslie , Charles Kamhoua , Fei Fang

A common strategy in modern learning systems is to learn a representation that is useful for many tasks, a.k.a. representation learning. We study this strategy in the imitation learning setting for Markov decision processes (MDPs) where…

Machine Learning · Computer Science 2020-02-26 Sanjeev Arora , Simon S. Du , Sham Kakade , Yuping Luo , Nikunj Saunshi

We show that when a third party, the adversary, steps into the two-party setting (agent and operator) of safely interruptible reinforcement learning, a trade-off has to be made between the probability of following the optimal policy in the…

Machine Learning · Computer Science 2018-05-30 Henrik Aslund , El Mahdi El Mhamdi , Rachid Guerraoui , Alexandre Maurer

We study nondeterministic strategies in parity games with the aim of computing a most permissive winning strategy. Following earlier work, we measure permissiveness in terms of the average number/weight of transitions blocked by the…

Logic in Computer Science · Computer Science 2013-01-14 Patricia Bouyer , Nicolas Markey , Jörg Olschewski , Michael Ummels

Game semantics is a powerful method of semantic analysis for programming languages. It gives mathematically accurate models ("fully abstract") for a wide variety of programming languages. Game semantic models are combinatorial…

Programming Languages · Computer Science 2017-12-04 Dan R. Ghica , Khulood Alyahya

Coloring games are combinatorial games where the players alternate painting uncolored vertices of a graph one of $k > 0$ colors. Each different ruleset specifies that game's coloring constraints. This paper investigates six impartial…

Combinatorics · Mathematics 2012-02-28 Gabriel Beaulieu , Kyle Burke , Eric Duchêne

In the game of Matching Pennies, Alice and Bob each hold a penny, and at every tick of the clock they simultaneously display the head or the tail sides of their coins. If they both display the same side, then Alice wins Bob's penny; if they…

Computer Science and Game Theory · Computer Science 2018-02-05 Dusko Pavlovic , Peter-Michael Seidel , Muzamil Yahia

Information uncertainty is one of the major challenges facing applications of game theory. In the context of Stackelberg games, various approaches have been proposed to deal with the leader's incomplete knowledge about the follower's…

Computer Science and Game Theory · Computer Science 2019-05-21 Jiarui Gan , Haifeng Xu , Qingyu Guo , Long Tran-Thanh , Zinovi Rabinovich , Michael Wooldridge

Inductive logic programming (ILP) is a form of logical machine learning. The goal is to search a hypothesis space for a hypothesis that generalises training examples and background knowledge. We introduce an approach that 'shrinks' the…

Artificial Intelligence · Computer Science 2026-05-18 Andrew Cropper , Filipe Gouveia , David M. Cerna

Combinatorial games lead to several interesting, clean problems in algorithms and complexity theory, many of which remain open. The purpose of this paper is to provide an overview of the area to encourage further research. In particular, we…

Computational Complexity · Computer Science 2009-09-25 Erik D. Demaine , Robert A. Hearn

In this paper, we address the problem of a two-player linear quadratic differential game with incomplete information, a scenario commonly encountered in multi-agent control, human-robot interaction (HRI), and approximation methods for…

Systems and Control · Electrical Eng. & Systems 2025-04-25 Seyed Yousef Soltanian , Wenlong Zhang

Imitation sometimes achieves success in multi-agent situations even though it is very simple. In game theory, success of imitation has been characterized by unbeatability against other agents. Previous studies specified conditions under…

Physics and Society · Physics 2025-07-23 Masahiko Ueda