English
Related papers

Related papers: Reactive learning strategies for iterated games

200 papers

Strategy learning in game environments with multi-agent is a challenging problem. Since each agent's reward is determined by the joint strategy, a greedy learning strategy that aims to maximize its own reward may fall into a local optimum.…

Artificial Intelligence · Computer Science 2026-02-02 Xinyu Qiao , Yudong Hu , Congying Han , Weiyan Wu , Tiande Guo

Prior work has proposed a simple strategy for reinforcement learning (RL): label experience with the outcomes achieved in that experience, and then imitate the relabeled experience. These outcome-conditioned imitation learning methods are…

Machine Learning · Computer Science 2023-02-21 Benjamin Eysenbach , Soumith Udatha , Sergey Levine , Ruslan Salakhutdinov

Two-player games on graphs is central in many problems in formal verification and program analysis such as synthesis and verification of open systems. In this work we consider solving recursive game graphs (or pushdown game graphs) that can…

Logic in Computer Science · Computer Science 2016-05-17 Krishnendu Chatterjee , Yaron Velner

This paper introduces a reinforcement learning framework that enables controllable and diverse player behaviors without relying on human gameplay data. Existing approaches often require large-scale player trajectories, train separate models…

Machine Learning · Computer Science 2025-12-12 Atahan Cilan , Atay Özgövde

Machine learning systems have been widely used to make decisions about individuals who may behave strategically to receive favorable outcomes, e.g., they may genuinely improve the true labels or manipulate observable features directly to…

Artificial Intelligence · Computer Science 2024-10-30 Tian Xie , Zhiqun Zuo , Mohammad Mahdi Khalili , Xueru Zhang

This work proposes a procedure for designing algorithms for specific adaptive data collection tasks like active learning and pure-exploration multi-armed bandits. Unlike the design of traditional adaptive algorithms that rely on…

Machine Learning · Computer Science 2025-03-11 Jifan Zhang , Lalit Jain , Kevin Jamieson

We investigate the effect of reward shaping in improving the performance of reinforcement learning in the context of the real-time strategy, capture-the-flag game. The game is characterized by sparse rewards that are associated with…

Machine Learning · Computer Science 2023-11-29 John Kliem , Prithviraj Dasgupta

We study \emph{partial-information} two-player turn-based games on graphs with omega-regular objectives, when the partial-information player has \emph{limited memory}. Such games are a natural formalization for reactive synthesis when the…

Formal Languages and Automata Theory · Computer Science 2020-02-19 Dhananjay Raju , Rüdiger Ehlers , Ufuk Topcu

We study adaptive learning in a typical p-player game. The payoffs of the games are randomly generated and then held fixed. The strategies of the players evolve through time as the players learn. The trajectories in the strategy space…

Economics · Quantitative Finance 2018-04-09 James B. T. Sanders , J. Doyne Farmer , Tobias Galla

We study a multi-agent decision problem in population games, where agents select from multiple available strategies and continually revise their selections based on the payoffs associated with these strategies. Unlike conventional…

Multiagent Systems · Computer Science 2024-09-17 Shinkyu Park

We study the problem of designing autonomous agents that can learn to cooperate effectively with a potentially suboptimal partner while having no access to the joint reward function. This problem is modeled as a cooperative episodic…

Machine Learning · Computer Science 2022-06-14 Thomas Kleine Buening , Anne-Marie George , Christos Dimitrakakis

Predicting and modeling human behavior and finding trends within human decision-making processes is a major problem of social science. Rock Paper Scissors (RPS) is the fundamental strategic question in many game theory problems and…

Computer Science and Game Theory · Computer Science 2020-11-24 Lei Wang , Wenbin Huang , Yuanpeng Li , Julian Evans , Sailing He

In this paper, we introduce the notion of replicable policies in the context of stochastic bandits, one of the canonical problems in interactive learning. A policy in the bandit environment is called replicable if it pulls, with high…

Machine Learning · Computer Science 2023-02-16 Hossein Esfandiari , Alkis Kalavasis , Amin Karbasi , Andreas Krause , Vahab Mirrokni , Grigoris Velegkas

In common-interest stochastic games all players receive an identical payoff. Players participating in such games must learn to coordinate with each other in order to receive the highest-possible value. A number of reinforcement learning…

Artificial Intelligence · Computer Science 2011-06-28 R. I. Brafman , M. Tennenholtz

This paper extends the reinforcement learning ideas into the multi-agents system, which is far more complicated than the previously studied single-agent system. We studied two different multi-agents systems. One is the fully-connected…

Artificial Intelligence · Computer Science 2015-05-18 Zhipeng Wang , Mingbo Cai

We consider a version of the ultimatum game which simultaneously combines reactive and Darwinian aspects with offers in [0,1]. By reactive aspects, we consider the effects that lead the player to change their offer given the previous…

Physics and Society · Physics 2019-10-02 Roberto da Silva , Pablo Valverde , Luis C. Lamb

The Iterated Prisoner's Dilemma (IPD) is a well studied framework for understanding direct reciprocity and cooperation in pairwise encounters. However, measuring the morality of various IPD strategies is still largely lacking. Here, we…

Physics and Society · Physics 2023-02-28 Grant Molnar , Caroline Hammond , Feng Fu

Continual learning is a promising machine learning paradigm to learn new tasks while retaining previously learned knowledge over streaming training data. Till now, rehearsal-based methods, keeping a small part of data from old tasks as a…

Machine Learning · Computer Science 2023-08-04 Quanziang Wang , Renzhen Wang , Yuexiang Li , Dong Wei , Kai Ma , Yefeng Zheng , Deyu Meng

Adversarial self-play in two-player games has delivered impressive results when used with reinforcement learning algorithms that combine deep neural networks and tree search. Algorithms like AlphaZero and Expert Iteration learn tabula-rasa,…

Evolutionary game dynamics on networks typically consider the competition among simple strategies such as cooperation and defection in the Prisoner's Dilemma and summarize the effect of population structure as network reciprocity. However,…

Physics and Society · Physics 2024-05-31 Zijie Chen , Yuxin Geng , Xingru Chen , Feng Fu