English
Related papers

Related papers: Non-myopic learning in repeated stochastic games

200 papers

Learning in a multi-agent system is challenging because agents are simultaneously learning and the environment is not stationary, undermining convergence guarantees. To address this challenge, this paper presents a new gradient-based…

Multiagent Systems · Computer Science 2019-03-08 Xinliang Song , Tonghan Wang , Chongjie Zhang

Last-iterate convergence of learning dynamics in games has attracted significant recent attention. In two-player zero-sum games with bandit feedback, where only the loss of the selected action pair is observed, Fiegel et al. (2025) show a…

Machine Learning · Computer Science 2026-05-12 Soumita Hait , Ping Li , Haipeng Luo , Mengxiao Zhang

To achieve general intelligence, agents must learn how to interact with others in a shared environment: this is the challenge of multiagent reinforcement learning (MARL). The simplest form is independent reinforcement learning (InRL), where…

Artificial Intelligence · Computer Science 2017-11-08 Marc Lanctot , Vinicius Zambaldi , Audrunas Gruslys , Angeliki Lazaridou , Karl Tuyls , Julien Perolat , David Silver , Thore Graepel

In clinical practice, a segmentation network is often required to continually learn on a sequential data stream from multiple sites rather than a consolidated set, due to the storage cost and privacy restriction. However, during the…

Image and Video Processing · Electrical Eng. & Systems 2022-06-28 Jingyang Zhang , Peng Xue , Ran Gu , Yuning Gu , Mianxin Liu , Yongsheng Pan , Zhiming Cui , Jiawei Huang , Lei Ma , Dinggang Shen

This paper addresses the problem of learning a Nash equilibrium in $\gamma$-discounted multiplayer general-sum Markov Games (MG). A key component of this model is the possibility for the players to either collaborate or team apart to…

Computer Science and Game Theory · Computer Science 2017-03-07 Julien Pérolat , Florian Strub , Bilal Piot , Olivier Pietquin

While various multi-agent reinforcement learning methods have been proposed in cooperative settings, few works investigate how self-interested learning agents achieve mutual coordination in decentralized general-sum games and generalize…

Multiagent Systems · Computer Science 2023-01-05 Ziyi Liu , Xian Guo , Yongchun Fang

We study a class of stochastic dynamic games that exhibit strategic complementarities between players; formally, in the games we consider, the payoff of a player has increasing differences between her own state and the empirical…

Computer Science and Game Theory · Computer Science 2010-12-13 Sachin Adlakha , Ramesh Johari

We present a new approach to solving games with a countably or uncountably infinite number of players. Such games are often used to model multiagent systems with a large number of agents. The latter are frequently encountered in economics,…

Computer Science and Game Theory · Computer Science 2025-01-17 Carlos Martin , Tuomas Sandholm

The key challenge in multiagent learning is learning a best response to the behaviour of other agents, which may be non-stationary: if the other agents adapt their strategy as well, the learning target moves. Disparate streams of research…

Multiagent Systems · Computer Science 2019-03-13 Pablo Hernandez-Leal , Michael Kaisers , Tim Baarslag , Enrique Munoz de Cote

Two-player games such as board games have long been used as traditional benchmarks for reinforcement learning. This work revisits a policy optimization method with reverse Kullback-Leibler regularization and entropy regularization and…

Machine Learning · Computer Science 2026-05-22 Kazuki Ota , Takayuki Osa , Motoki Omura , Tatsuya Harada

We study the problem of federated stochastic multi-arm contextual bandits with unknown contexts, in which M agents are faced with different bandits and collaborate to learn. The communication model consists of a central server and the…

Machine Learning · Computer Science 2024-01-31 Jiabin Lin , Shana Moothedath

Game theory's prescriptive power typically relies on full rationality and/or self-play interactions. In contrast, this work sets aside these fundamental premises and focuses instead on heterogeneous autonomous interactions between two or…

Computer Science and Game Theory · Computer Science 2012-03-19 Enrique Munoz de Cote , Archie C. Chapman , Adam M. Sykulski , Nicholas R. Jennings

Decision making in modern large-scale and complex systems such as communication networks, smart electricity grids, and cyber-physical systems motivate novel game-theoretic approaches. This paper investigates big strategic (non-cooperative)…

Computer Science and Game Theory · Computer Science 2016-09-22 Tansu Alpcan , Benjamin I. P. Rubinstein , Christopher Leckie

We study learning in a dynamically evolving environment modeled as a Markov game between a learner and a strategic opponent that can adapt to the learner's strategies. While most existing works in Markov games focus on external regret as…

Machine Learning · Computer Science 2024-12-11 Thanh Nguyen-Tang , Raman Arora

In this work the properties of multi choice minority games are studied by means of extensive computational simulations. We have considered several ways of rewarding the strategies of the players and compared the resulting behaviours of the…

Disordered Systems and Neural Networks · Physics 2008-11-23 J. Menche , J. R. L. de Almeida

In this paper we consider the problem of learning the optimal policy for uncontrolled restless bandit problems. In an uncontrolled restless bandit problem, there is a finite set of arms, each of which when pulled yields a positive reward.…

Optimization and Control · Mathematics 2015-01-30 Cem Tekin , Mingyan Liu

Massively parallel GPU simulation environments have accelerated reinforcement learning (RL) research by enabling fast data collection for on-policy RL algorithms like Proximal Policy Optimization (PPO). To maximize throughput, it is common…

Machine Learning · Computer Science 2025-11-27 Sid Bharthulwar , Stone Tao , Hao Su

The Mean-Field approximation is a tractable approach for studying large population dynamics. However, its assumption on homogeneity and universal connections among all agents limits its applicability in many real-world scenarios.…

Computer Science and Game Theory · Computer Science 2023-10-26 Peihan Huo , Oscar Peralta , Junyu Guo , Qiaomin Xie , Andreea Minca

We study collaborative learning in multi-agent Bayesian bandit problems, where strategic agents collectively solve the same bandit instance. While multiple agents can accelerate learning by sharing information, strategic agents might prefer…

Machine Learning · Computer Science 2026-05-14 Idan Barnea , Ofir Schlisselberg , Yishay Mansour

This paper studies a dynamic discrete-time queuing model where at every period players get a new job and must send all their jobs to a queue that has a limited capacity. Players have an incentive to send their jobs as late as possible;…

Computer Science and Game Theory · Computer Science 2023-02-08 Lucas Baudin , Marco Scarsini , Xavier Venel