English
Related papers

Related papers: StratFormer: Adaptive Opponent Modeling and Exploi…

200 papers

Opponent modeling is necessary in multi-agent settings where secondary agents with competing goals also adapt their strategies, yet it remains challenging because strategies interact with each other and change. Most previous work focuses on…

Machine Learning · Computer Science 2016-09-20 He He , Jordan Boyd-Graber , Kevin Kwok , Hal Daumé

In this paper we present results and analyses of a class of games in which heterogeneous agents are rewarded for being in a minority group. Each agent possesses a number of fixed strategies each of which are predictors of the next minority…

adap-org · Physics 2007-05-23 Radu Manuca , Yi Li , Rick Riolo , Robert Savit

Learning algorithms are often used to make decisions in sequential decision-making environments. In multi-agent settings, the decisions of each agent can affect the utilities/losses of the other agents. Therefore, if an agent is good at…

Computer Science and Game Theory · Computer Science 2024-07-09 Angelos Assos , Yuval Dagan , Constantinos Daskalakis

We consider learning to play multiplayer imperfect-information games with simultaneous moves and large state-action spaces. Previous attempts to tackle such challenging games have largely focused on model-free learning methods, often…

Artificial Intelligence · Computer Science 2020-12-23 Rinu Boney , Alexander Ilin , Juho Kannala , Jarno Seppänen

Generative model-based imitation learning methods have recently achieved strong results in learning high-complexity motor skills from human demonstrations. However, imitation learning of interactive policies that coordinate with humans in…

Robotics · Computer Science 2025-11-18 Max M. Sun , Todd Murphey

We consider the problem of learning by demonstration from agents acting in unknown stochastic Markov environments or games. Our aim is to estimate agent preferences in order to construct improved policies for the same task that the agents…

Machine Learning · Computer Science 2014-08-12 Aristide Tossou , Christos Dimitrakakis

We consider the problem of learning by demonstration from agents acting in unknown stochastic Markov environments or games. Our aim is to estimate agent preferences in order to construct improved policies for the same task that the agents…

Machine Learning · Statistics 2013-07-16 Aristide C. Y. Tossou , Christos Dimitrakakis

A model of strategy formulation is used to study how an adaptive attacker learns to overcome a moving target cyber defense. The attacker-defender interaction is modeled as a game in which a defender deploys a temporal platform migration…

Cryptography and Security · Computer Science 2014-08-19 M. L. Winterrose , K. M. Carter , N. Wagner , W. W. Streilein

Adversarial examples, crafted by adding perturbations imperceptible to humans, can deceive neural networks. Recent studies identify the adversarial transferability across various models, \textit{i.e.}, the cross-model attack ability of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Rongyi Zhu , Zeliang Zhang , Susan Liang , Zhuo Liu , Chenliang Xu

Recent advances in video generation have spurred the development of world models capable of simulating 3D-consistent environments and interactions with static objects. However, a significant limitation remains in their ability to model…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Anmol Agarwal , Pranay Meshram , Sumer Singh , Saurav Suman , Andrew Lapp , Shahbuland Matiana , Louis Castricato , Spencer Frazier

While Large Language Models (LLMs) excel in certain reasoning tasks, they struggle in multi-agent games where the final outcome depends on the joint strategies of all agents. In multi-agent games, the non-stationarity of other agents brings…

Artificial Intelligence · Computer Science 2026-05-26 Yidong He , Yutao Lai , Pengxu Yang , Jiarui Gan , Jiexin Wang , Yi Cai , Mengchen Zhao

In multi-agent settings with mixed incentives, methods developed for zero-sum games have been shown to lead to detrimental outcomes. To address this issue, opponent shaping (OS) methods explicitly learn to influence the learning dynamics of…

Artificial Intelligence · Computer Science 2024-02-13 Akbir Khan , Timon Willi , Newton Kwan , Andrea Tacchetti , Chris Lu , Edward Grefenstette , Tim Rocktäschel , Jakob Foerster

We introduce a two-player model of reinforcement learning with memory. Past actions of an iterated game are stored in a memory and used to determine player's next action. To examine the behaviour of the model some approximate methods are…

Statistical Mechanics · Physics 2009-11-13 Adam Lipowski , Krzysztof Gontarek , Marcel Ausloos

This paper addresses a mathematically tractable model of the Prisoner's Dilemma using the framework of active inference. In this work, we design pairs of Bayesian agents that are tracking the joint game state of their and their opponent's…

Physics and Society · Physics 2023-08-31 Daphne Demekas , Conor Heins , Brennan Klein

We train an agent to compete in the game of Gardner minichess, a downsized variation of chess played on a 5x5 board. We motivated and applied a SOTA actor-critic method Proximal Policy Optimization with Generalized Advantage Estimation. Our…

Machine Learning · Computer Science 2021-12-28 Michael Sun , Robert Tan

Iterated coopetitive games capture the situation when one must efficiently balance between cooperation and competition with the other agents over time in order to win the game (e.g., to become the player with highest total utility).…

Computer Science and Game Theory · Computer Science 2022-03-11 Shivakumar Mahesh , Nicholas Bishop , Le Cong Dinh , Long Tran-Thanh

Bargaining can be used to resolve mixed-motive games in multi-agent systems. Although there is an abundance of negotiation strategies implemented in automated negotiating agents, most agents are based on single fixed strategies, while it is…

Multiagent Systems · Computer Science 2022-12-21 Bram M. Renting , Holger H. Hoos , Catholijn M. Jonker

In Stackelberg security games when information about the attacker's payoffs is uncertain, algorithms have been proposed to learn the optimal defender commitment by interacting with the attacker and observing their best responses. In this…

Computer Science and Game Theory · Computer Science 2019-11-01 Jiarui Gan , Qingyu Guo , Long Tran-Thanh , Bo An , Michael Wooldridge

Advancements in reinforcement learning have led to the development of sophisticated models capable of learning complex decision-making tasks. However, efficiently integrating world models with decision transformers remains a challenge. In…

Understanding the evolution of human social systems requires flexible formalisms for the emergence of institutions. Although game theory is normally used to model interactions individually, larger spaces of games can be helpful for modeling…

Physics and Society · Physics 2021-08-12 Seth Frey , Curtis Atkisson