English
Related papers

Related papers: Diffusing to Coordinate: Efficient Online Multi-Ag…

200 papers

The objective of meta-learning is to exploit the knowledge obtained from observed tasks to improve adaptation to unseen tasks. As such, meta-learners are able to generalize better when they are trained with a larger number of observed tasks…

Machine Learning · Computer Science 2022-10-11 Mert Kayaalp , Stefan Vlaski , Ali H. Sayed

We extend trust region policy optimization (TRPO) to multi-agent reinforcement learning (MARL) problems. We show that the policy update of TRPO can be transformed into a distributed consensus optimization problem for multi-agent cases. By…

Artificial Intelligence · Computer Science 2023-08-08 Hepeng Li , Haibo He

This paper studies a distributed policy gradient in collaborative multi-agent reinforcement learning (MARL), where agents over a communication network aim to find the optimal policy to maximize the average of all agents' local returns. Due…

Multiagent Systems · Computer Science 2022-12-06 Xiaoxiao Zhao , Jinlong Lei , Li Li , Jie Chen

Existing distributed cooperative multi-agent reinforcement learning (MARL) frameworks usually assume undirected coordination graphs and communication graphs while estimating a global reward via consensus algorithms for policy evaluation.…

Multiagent Systems · Computer Science 2022-01-14 Gangshan Jing , He Bai , Jemin George , Aranya Chakrabortty , Piyush. K. Sharma

Diffusion models have recently emerged as expressive policy representations for online reinforcement learning (RL). However, their iterative generative processes introduce substantial training and inference overhead. To overcome this…

Machine Learning · Computer Science 2026-04-17 Xiaoyi Dong , Xi Sheryl Zhang , Jian Cheng

Multi-Agent Reinforcement Learning (MARL) has gained significant traction for solving complex real-world tasks, but the inherent stochasticity and uncertainty in these environments pose substantial challenges to efficient and robust policy…

Machine Learning · Computer Science 2025-01-22 Somnath Hazra , Pallab Dasgupta , Soumyajit Dey

Offline multi-agent reinforcement learning (MARL) addresses key limitations of online MARL, such as safety concerns, expensive data collection, extended training intervals, and high signaling overhead caused by online interactions with the…

Multiagent Systems · Computer Science 2025-01-23 Eslam Eldeeb , Hirley Alves

Multi-Agent Reinforcement Learning (MARL) has become a classic paradigm to solve diverse, intelligent control tasks like autonomous driving in Internet of Vehicles (IoV). However, the widely assumed existence of a central node to implement…

Multiagent Systems · Computer Science 2023-08-09 Xiaoxue Yu , Rongpeng Li , Fei Wang , Chenghui Peng , Chengchao Liang , Zhifeng Zhao , Honggang Zhang

Recent research has highlighted the powerful capabilities of imitation learning in robotics. Leveraging generative models, particularly diffusion models, these approaches offer notable advantages such as strong multi-task generalization,…

Robotics · Computer Science 2025-09-15 Xinyao Qin , Xiaoteng Ma , Yang Qi , Qihan Liu , Chuanyi Xue , Ning Gui , Qinyu Dong , Jun Yang , Bin Liang

Diffusion-based planning has achieved strong results in single-agent offline reinforcement learning, yet scaling to many-agent systems remains intractable due to the curse of dimensionality in the joint trajectory space. We introduce…

Machine Learning · Computer Science 2026-05-29 Wenhao Li , Xiangfeng Wang , Bo Jin

Decentralized Multi-Agent Reinforcement Learning (MARL) methods allow for learning scalable multi-agent policies, but suffer from partial observability and induced non-stationarity. These challenges can be addressed by introducing…

Machine Learning · Computer Science 2025-08-01 Tommaso Marzi , Cesare Alippi , Andrea Cini

Diffusion models have shown strong competitiveness in offline reinforcement learning tasks by formulating decision-making as sequential generation. However, the practicality of these methods is limited due to the lengthy inference processes…

Machine Learning · Computer Science 2024-07-24 Renming Huang , Yunqiang Pei , Guoqing Wang , Yangming Zhang , Yang Yang , Peng Wang , Hengtao Shen

Advances in multi-agent reinforcement learning (MARL) enable sequential decision making for a range of exciting multi-agent applications such as cooperative AI and autonomous driving. Explaining agent decisions is crucial for improving…

Artificial Intelligence · Computer Science 2022-05-24 Kayla Boggess , Sarit Kraus , Lu Feng

Recent developments in offline reinforcement learning have uncovered the immense potential of diffusion modeling, which excels at representing heterogeneous behavior policies. However, sampling from diffusion policies is considerably slow…

Machine Learning · Computer Science 2024-03-18 Huayu Chen , Cheng Lu , Zhengyi Wang , Hang Su , Jun Zhu

With wireless devices increasingly forming a unified smart network for seamless, user-friendly operations, random access (RA) medium access control (MAC) design is considered a key solution for handling unpredictable data traffic from…

Networking and Internet Architecture · Computer Science 2025-08-12 Myeung Suk Oh , Zhiyao Zhang , FNU Hairi , Alvaro Velasquez , Jia Liu

Multi-Agent Reinforcement Learning (MARL) algorithms are widely adopted in tackling complex tasks that require collaboration and competition among agents in dynamic Multi-Agent Systems (MAS). However, learning such tasks from scratch is…

Artificial Intelligence · Computer Science 2024-02-14 Ayesha Siddika Nipu , Siming Liu , Anthony Harris

In this paper, we propose a distributed zeroth-order policy optimization method for Multi-Agent Reinforcement Learning (MARL). Existing MARL algorithms often assume that every agent can observe the states and actions of all the other agents…

Machine Learning · Computer Science 2023-06-21 Yan Zhang , Michael M. Zavlanos

Deep reinforcement learning has recently emerged as a promising feedback control strategy for complex dynamical systems governed by partial differential equations (PDEs). When dealing with distributed, high-dimensional problems in state and…

Machine Learning · Computer Science 2025-09-23 Nicolò Botteghi , Matteo Tomasetto , Urban Fasel , Francesco Braghin , Andrea Manzoni

Many advances in cooperative multi-agent reinforcement learning (MARL) are based on two common design principles: value decomposition and parameter sharing. A typical MARL algorithm of this fashion decomposes a centralized Q-function into…

Artificial Intelligence · Computer Science 2022-08-09 Wei Fu , Chao Yu , Zelai Xu , Jiaqi Yang , Yi Wu

Learning cooperative multi-agent policies directly from high-dimensional, multimodal sensory inputs like pixels and audio (from pixels) is notoriously sample-inefficient. Model-free Multi-Agent Reinforcement Learning (MARL) algorithms…

Multiagent Systems · Computer Science 2025-11-12 Sureyya Akin , Kavita Srivastava , Prateek B. Kapoor , Pradeep G. Sethi , Sunita Q. Patel , Rahu Srivastava