English
Related papers

Related papers: Non-myopic learning in repeated stochastic games

200 papers

We study the problem of training a principal in a multi-agent general-sum game using reinforcement learning (RL). Learning a robust principal policy requires anticipating the worst possible strategic responses of other agents, which is…

Machine Learning · Computer Science 2022-12-21 Eric Zhao , Alexander R. Trott , Caiming Xiong , Stephan Zheng

In multi-agent reinforcement learning, the behaviors that agents learn in a single Markov Game (MG) are typically confined to the given agent number. Every single MG induced by varying the population may possess distinct optimal joint…

Machine Learning · Computer Science 2023-06-06 Shenao Zhang , Li Shen , Lei Han , Li Shen

We introduce a two-player model of reinforcement learning with memory. Past actions of an iterated game are stored in a memory and used to determine player's next action. To examine the behaviour of the model some approximate methods are…

Statistical Mechanics · Physics 2009-11-13 Adam Lipowski , Krzysztof Gontarek , Marcel Ausloos

Standard multi-agent reinforcement learning (MARL) algorithms are vulnerable to sim-to-real gaps. To address this, distributionally robust Markov games (RMGs) have been proposed to enhance robustness in MARL by optimizing the worst-case…

Machine Learning · Computer Science 2025-02-03 Laixi Shi , Jingchu Gai , Eric Mazumdar , Yuejie Chi , Adam Wierman

Meta-learning seeks to build algorithms that rapidly learn how to solve new learning problems based on previous experience. In this paper we investigate meta-learning in the setting of stochastic linear bandit tasks. We assume that the…

Machine Learning · Computer Science 2022-05-31 Leonardo Cella , Karim Lounici , Massimiliano Pontil

An important challenge in non-cooperative game theory is coordinating on a single (approximate) equilibrium from many possibilities - a challenge that becomes even more complex when players hold private information. Recommender mechanisms…

Computer Science and Game Theory · Computer Science 2025-05-30 Bengisu Guresti , Chongjie Zhang , Yevgeniy Vorobeychik

We study the limiting behavior of the mixed strategies that result from optimal no-regret learning strategies in a repeated game setting where the stage game is any 2 by 2 competitive game. We consider optimal no-regret algorithms that are…

Computer Science and Game Theory · Computer Science 2022-03-03 Vidya Muthukumar , Soham Phade , Anant Sahai

Competitive games involving thousands or even millions of players are prevalent in real-world contexts, such as transportation, communications, and computer networks. However, learning in these large-scale multi-agent environments presents…

Optimization and Control · Mathematics 2025-02-04 Batuhan Yardim , Semih Cayci , Niao He

A popular computer puzzle, the game of Minesweeper requires its human players to have a mix of both luck and strategy to succeed. Analyzing these aspects more formally, in our research we assessed the feasibility of a novel methodology…

Machine Learning · Computer Science 2021-06-21 Igor Q. Lordeiro , Diego B. Haddad , Douglas O. Cardoso

In this paper we study the online learning problem involving rested and restless multiarmed bandits with multiple plays. The system consists of a single player/user and a set of K finite-state discrete-time Markov chains (arms) with unknown…

Optimization and Control · Mathematics 2015-03-25 Cem Tekin , Mingyan Liu

Recent advances in multiagent learning have seen the introduction ofa family of algorithms that revolve around the population-based trainingmethod PSRO, showing convergence to Nash, correlated and coarse corre-lated equilibria. Notably,…

Computer Science and Game Theory · Computer Science 2022-08-30 Paul Muller , Mark Rowland , Romuald Elie , Georgios Piliouras , Julien Perolat , Mathieu Lauriere , Raphael Marinier , Olivier Pietquin , Karl Tuyls

Social learning is learning through the observation of or interaction with other individuals; it is critical in the understanding of the collective behaviors of humans in social physics. We study the learning process of agents in a restless…

Physics and Society · Physics 2020-12-01 Kazuaki Nakayama , Ryuzo Nakamura , Masato Hisakado , Shintaro Mori

Reinforcement learning (RL) so far has limited real-world applications. One key challenge is that typical RL algorithms heavily rely on a reset mechanism to sample proper initial states; these reset mechanisms, in practice, are expensive to…

Machine Learning · Computer Science 2023-07-25 Hoai-An Nguyen , Ching-An Cheng

We consider the problem of learning to exploit learning algorithms through repeated interactions in games. Specifically, we focus on the case of repeated two player, finite-action games, in which an optimizer aims to steer a no-regret…

Computer Science and Game Theory · Computer Science 2025-05-29 Yizhou Zhang , Yi-An Ma , Eric Mazumdar

In this paper, we consider the problem of optimization and learning for constrained and multi-objective Markov decision processes, for both discounted rewards and expected average rewards. We formulate the problems as zero-sum games where…

Optimization and Control · Mathematics 2021-03-05 Ather Gattami , Qinbo Bai , Vaneet Agarwal

Although reinforcement learning (RL) is considered the gold standard for policy design, it may not always provide a robust solution in various scenarios. This can result in severe performance degradation when the environment is exposed to…

Machine Learning · Computer Science 2023-06-14 Juncheng Dong , Hao-Lun Hsu , Qitong Gao , Vahid Tarokh , Miroslav Pajic

Within the context of video games the notion of perfectly rational agents can be undesirable as it leads to uninteresting situations, where humans face tough adversarial decision makers. Current frameworks for stochastic games and…

Artificial Intelligence · Computer Science 2019-01-09 Jordi Grau-Moya , Felix Leibfried , Haitham Bou-Ammar

Playing repeated matrix games (RMG) while maximizing the cumulative returns is a basic method to evaluate multi-agent learning (MAL) algorithms. Previous work has shown that $UCB$, $M3$, $S$ or $Exp3$ algorithms have good behaviours on…

Machine Learning · Computer Science 2018-11-02 Bruno Bouzy , Marc Métivier , Damien Pellier

We present a new combined \textit{mean field control game} (MFCG) problem which can be interpreted as a competitive game between collaborating groups and its solution as a Nash equilibrium between groups. Players coordinate their strategies…

Optimization and Control · Mathematics 2023-02-16 Andrea Angiuli , Nils Detering , Jean-Pierre Fouque , Mathieu Lauriere , Jimin Lin

Training agents in multi-agent competitive games presents significant challenges due to their intricate nature. These challenges are exacerbated by dynamics influenced not only by the environment but also by opponents' strategies. Existing…

Machine Learning · Computer Science 2023-08-22 The Viet Bui , Tien Mai , Thanh Hong Nguyen