English
Related papers

Related papers: Rethinking Formal Models of Partially Observable M…

200 papers

Many real-world decision problems involve the interaction of multiple self-interested agents with limited sensing ability. The partially observable stochastic game (POSG) provides a mathematical framework for modeling these problems,…

Computer Science and Game Theory · Computer Science 2024-10-30 Tyler Becker , Zachary Sunberg

Stochastic games are a well established model for multi-agent sequential decision making under uncertainty. In practical applications, though, agents often have only partial observability of their environment. Furthermore, agents…

Computer Science and Game Theory · Computer Science 2024-07-02 Rui Yan , Gabriel Santos , Gethin Norman , David Parker , Marta Kwiatkowska

Partially Observable Stochastic Games (POSGs) are the most general and common model of games used in Multi-Agent Reinforcement Learning (MARL). We argue that the POSG model is conceptually ill suited to software MARL environments, and offer…

Machine Learning · Computer Science 2022-06-01 J K Terry , Nathaniel Grammel , Benjamin Black , Ananth Hari , Caroline Horsch , Luis Santos

We argue that the extensive-form game (EFG) model isn't powerful enough to express all important aspects of imperfect information games, such as those related to decomposition and online game solving. We present a principled attempt to fix…

Computer Science and Game Theory · Computer Science 2019-06-17 Vojtěch Kovařík , Viliam Lisý

We study provable multi-agent reinforcement learning (RL) in the general framework of partially observable stochastic games (POSGs). To circumvent the known hardness results and the use of computationally intractable oracles, we advocate…

Machine Learning · Computer Science 2026-03-16 Xiangyu Liu , Kaiqing Zhang

This paper considers the challenging tasks of Multi-Agent Reinforcement Learning (MARL) under partial observability, where each agent only sees her own individual observations and actions that reveal incomplete information about the…

Machine Learning · Computer Science 2022-10-18 Qinghua Liu , Csaba Szepesvári , Chi Jin

We introduce the partially observable history process (POHP) formalism for reinforcement learning. POHP centers around the actions and observations of a single agent and abstracts away the presence of other players without reducing them to…

Artificial Intelligence · Computer Science 2022-02-25 Dustin Morrill , Amy R. Greenwald , Michael Bowling

Recently, deep multi-agent reinforcement learning (MARL) has gained significant popularity due to its success in various cooperative multi-agent tasks. However, exploration still remains a challenging problem in MARL due to the partial…

Machine Learning · Computer Science 2024-01-17 Yonghyeon Jo , Sunwoo Lee , Junghyuk Yeom , Seungyul Han

The multiple-target self-organizing pursuit (SOP) problem has wide applications and has been considered a challenging self-organization game for distributed systems, in which intelligent agents cooperatively pursue multiple dynamic targets…

Multiagent Systems · Computer Science 2023-09-27 Lijun Sun , Yu-Cheng Chang , Chao Lyu , Ye Shi , Yuhui Shi , Chin-Teng Lin

Efficient information dissemination is crucial for supporting critical operations across domains like disaster response, autonomous vehicles, and sensor networks. This paper introduces a Multi-Agent Reinforcement Learning (MARL) approach as…

Machine Learning · Computer Science 2024-02-22 Raffaele Galliera , Kristen Brent Venable , Matteo Bassani , Niranjan Suri

This work leverages adaptive social learning to estimate partially observable global states in multi-agent reinforcement learning (MARL) problems. Unlike existing methods, the proposed approach enables the concurrent operation of social…

Multiagent Systems · Computer Science 2025-08-11 Ainur Zhaikhan , Malek Khammassi , Ali H. Sayed

Many security and other real-world situations are dynamic in nature and can be modelled as strictly competitive (or zero-sum) dynamic games. In these domains, agents perform actions to affect the environment and receive observations --…

Computer Science and Game Theory · Computer Science 2020-10-23 Karel Horák , Branislav Bošanský , Vojtěch Kovařík , Christopher Kiekintveld

Stochastic games are a popular framework for studying multi-agent reinforcement learning (MARL). Recent advances in MARL have focused primarily on games with finitely many states. In this work, we study multi-agent learning in stochastic…

Machine Learning · Computer Science 2024-03-28 Awni Altabaa , Bora Yongacoglu , Serdar Yüksel

A central problem in the theory of multi-agent reinforcement learning (MARL) is to understand what structural conditions and algorithmic principles lead to sample-efficient learning guarantees, and how these considerations change as we move…

Machine Learning · Computer Science 2023-05-02 Dylan J. Foster , Dean P. Foster , Noah Golowich , Alexander Rakhlin

This work studies non-cooperative Multi-Agent Reinforcement Learning (MARL) where multiple agents interact in the same environment and whose goal is to maximize the individual returns. Challenges arise when scaling up the number of agents…

Artificial Intelligence · Computer Science 2023-04-14 Talal Algumaei , Ruben Solozabal , Reda Alami , Hakim Hacid , Merouane Debbah , Martin Takac

Multi-agent planning and reinforcement learning can be challenging when agents cannot see the state of the world or communicate with each other due to communication costs, latency, or noise. Partially Observable Stochastic Games (POSGs)…

Multiagent Systems · Computer Science 2024-12-20 Rafael F. Cunha , Jacopo Castellini , Johan Peralez , Jilles S. Dibangoye

Game-theoretic agents must make plans that optimally gather information about their opponents. These problems are modeled by partially observable stochastic games (POSGs), but planning in fully continuous POSGs is intractable without heavy…

Computer Science and Game Theory · Computer Science 2025-06-03 Mel Krusniak , Hang Xu , Parker Palermo , Forrest Laine

We study Nash equilibrium learning in partially observable Markov games (POMGs), a multi-agent reinforcement learning framework in which agents cannot fully observe the underlying state. Prior work in this setting relies on centralization…

Computer Science and Game Theory · Computer Science 2026-05-08 Philip Jordan , Maryam Kamgarpour

We formulate the problem of defogging as state estimation and future state prediction from previous, partial observations in the context of real-time strategy games. We propose to employ encoder-decoder neural networks for this task, and…

Machine Learning · Computer Science 2018-12-04 Gabriel Synnaeve , Zeming Lin , Jonas Gehring , Dan Gant , Vegard Mella , Vasil Khalidov , Nicolas Carion , Nicolas Usunier

The intent of this research is to generate a set of non-dominated policies from which one of two agents (the leader) can select a most preferred policy to control a dynamic system that is also affected by the control decisions of the other…

Optimization and Control · Mathematics 2014-04-18 Yanling Chang , Alan L. Erera , Chelsea C. White
‹ Prev 1 2 3 10 Next ›