English
Related papers

Related papers: Learning Decentralized Partially Observable Mean F…

200 papers

Decentralized Multi-Agent Reinforcement Learning (Dec-MARL) has emerged as a pivotal approach for addressing complex tasks in dynamic environments. Existing Multi-Agent Reinforcement Learning (MARL) methodologies typically assume a shared…

Multiagent Systems · Computer Science 2025-01-28 Hung Du , Srikanth Thudumu , Hy Nguyen , Rajesh Vasa , Kon Mouzakis

This work studies non-cooperative Multi-Agent Reinforcement Learning (MARL) where multiple agents interact in the same environment and whose goal is to maximize the individual returns. Challenges arise when scaling up the number of agents…

Artificial Intelligence · Computer Science 2023-04-14 Talal Algumaei , Ruben Solozabal , Reda Alami , Hakim Hacid , Merouane Debbah , Martin Takac

Multi-Agent Reinforcement Learning (MARL) has emerged as a powerfulparadigm for cooperative decision-making in connected autonomous vehicles(CAVs); however, existing approaches often fail to guarantee stability, optimality,and…

General Mathematics · Mathematics 2025-11-25 Mazyar Taghavi , Javad Vahidi

Multi-agent path finding in formation has many potential real-world applications like mobile warehouse robots. However, previous multi-agent path finding (MAPF) methods hardly take formation into consideration. Furthermore, they are usually…

Robotics · Computer Science 2020-11-05 Shanqi Liu , Licheng Wen , Jinhao Cui , Xuemeng Yang , Junjie Cao , Yong Liu

We investigate reinforcement learning in the setting of Markov decision processes for a large number of exchangeable agents interacting in a mean field manner. Applications include, for example, the control of a large number of robots…

Optimization and Control · Mathematics 2025-04-30 René Carmona , Mathieu Laurière , Zongjun Tan

This work leverages adaptive social learning to estimate partially observable global states in multi-agent reinforcement learning (MARL) problems. Unlike existing methods, the proposed approach enables the concurrent operation of social…

Multiagent Systems · Computer Science 2025-08-11 Ainur Zhaikhan , Malek Khammassi , Ali H. Sayed

This paper presents a data-driven approach for multi-robot coordination in partially-observable domains based on Decentralized Partially Observable Markov Decision Processes (Dec-POMDPs) and macro-actions (MAs). Dec-POMDPs provide a general…

Multiagent Systems · Computer Science 2017-08-21 Miao Liu , Kavinayan Sivakumar , Shayegan Omidshafiei , Christopher Amato , Jonathan P. How

Decentralized multi-agent reinforcement learning (MARL) algorithms have become popular in the literature since it allows heterogeneous agents to have their own reward functions as opposed to canonical multi-agent Markov Decision Process…

Machine Learning · Computer Science 2023-06-19 Soumajyoti Sarkar

This paper develops a Decentralized Multi-Agent Reinforcement Learning (Dec-MARL) method to solve the SoC balancing problem in the distributed energy storage system (DESS). First, the SoC balancing problem is formulated into a finite Markov…

Artificial Intelligence · Computer Science 2023-08-30 Zheng Xiong , Biao Luo , Bing-Chuan Wang , Xiaodong Xu , Xiaodong Liu , Tingwen Huang

Flocking control is essential for multi-robot systems in diverse applications, yet achieving efficient flocking in congested environments poses challenges regarding computation burdens, performance optimality, and motion safety. This paper…

Robotics · Computer Science 2025-02-06 Dengyu Zhang , Chenghao , Feng Xue , Qingrui Zhang

In recent years, reinforcement learning and its multi-agent analogue have achieved great success in solving various complex control problems. However, multi-agent reinforcement learning remains challenging both in its theoretical analysis…

Robotics · Computer Science 2023-02-10 Kai Cui , Mengguang Li , Christian Fabian , Heinz Koeppl

Traffic signal control (TSC) is a challenging problem within intelligent transportation systems and has been tackled using multi-agent reinforcement learning (MARL). While centralized approaches are often infeasible for large-scale TSC…

Multiagent Systems · Computer Science 2023-10-05 Rohit Bokade , Xiaoning Jin , Christopher Amato

Model Predictive Control (MPC) is attracting tremendous attention in the autonomous driving task as a powerful control technique. The success of an MPC controller strongly depends on an accurate internal dynamics model. However, the static…

Machine Learning · Computer Science 2023-04-28 Yuan Zhang , Joschka Boedecker , Chuxuan Li , Guyue Zhou

Monitoring human activity in indoor environments is important for applications such as facility management, safety assessment, and space utilization analysis. While mobile robot teams offer the potential to actively improve observation…

Multi-Agent Reinforcement Learning (MARL) has emerged as a foundational approach for addressing diverse, intelligent control tasks in various scenarios like the Internet of Vehicles, Internet of Things, and Unmanned Aerial Vehicles.…

Multiagent Systems · Computer Science 2024-10-15 Xiaoxue Yu , Rongpeng Li , Chengchao Liang , Zhifeng Zhao

The focus of this paper is on solving multi-robot planning problems in continuous spaces with partial observability. Decentralized partially observable Markov decision processes (Dec-POMDPs) are general models for multi-robot coordination…

Multiagent Systems · Computer Science 2015-02-24 Shayegan Omidshafiei , Ali-akbar Agha-mohammadi , Christopher Amato , Jonathan P. How

Effective operation and seamless cooperation of robotic systems are a fundamental component of next-generation technologies and applications. In contexts such as disaster response, swarm operations require coordinated behavior and mobility…

Multiagent Systems · Computer Science 2024-04-03 Raffaele Galliera , Thies Möhlenhof , Alessandro Amato , Daniel Duran , Kristen Brent Venable , Niranjan Suri

We study the problem of learning multi-task, multi-agent policies for cooperative, temporal objectives, under centralized training, decentralized execution. In this setting, using automata to represent tasks enables the decomposition of…

Multiagent Systems · Computer Science 2025-11-05 Beyazit Yalcinkaya , Marcell Vazquez-Chanlatte , Ameesh Shah , Hanna Krasowski , Sanjit A. Seshia

In this paper, we propose several approaches to learn the optimal population-dependent controls in order to solve mean field control problems (MFC). Such policies enable us to solve MFC problems with forms of common noises at a level of…

Optimization and Control · Mathematics 2023-11-21 Gokce Dayanikli , Mathieu Lauriere , Jiacheng Zhang

We present a Reinforcement Learning (RL) algorithm to solve infinite horizon asymptotic Mean Field Game (MFG) and Mean Field Control (MFC) problems. Our approach can be described as a unified two-timescale Mean Field Q-learning: The…

Optimization and Control · Mathematics 2021-06-01 Andrea Angiuli , Jean-Pierre Fouque , Mathieu Laurière