English
Related papers

Related papers: Taming Multi-Agent Reinforcement Learning with Est…

200 papers

In recent years, multi-agent reinforcement learning (MARL) has presented impressive performance in various applications. However, physical limitations, budget restrictions, and many other factors usually impose \textit{constraints} on a…

Machine Learning · Computer Science 2021-11-11 Zhaoxing Yang , Rong Ding , Haiming Jin , Yifei Wei , Haoyi You , Guiyun Fan , Xiaoying Gan , Xinbing Wang

Centralized Training for Decentralized Execution, where agents are trained offline using centralized information but execute in a decentralized manner online, has gained popularity in the multi-agent reinforcement learning community. In…

Machine Learning · Computer Science 2021-12-06 Xueguang Lyu , Yuchen Xiao , Brett Daley , Christopher Amato

A common challenge in reinforcement learning is how to convert the agent's interactions with an environment into fast and robust learning. For instance, earlier work makes use of domain knowledge to improve existing reinforcement learning…

Machine Learning · Computer Science 2020-04-01 Yannis Flet-Berliac , Philippe Preux

Cooperative problems under continuous control have always been the focus of multi-agent reinforcement learning. Existing algorithms suffer from the problem of uneven learning degree with the increase of the number of agents. In this paper,…

Multiagent Systems · Computer Science 2021-07-05 Kai Liu , Yuyang Zhao , Gang Wang , Bei Peng

Constrained multiagent reinforcement learning (C-MARL) is gaining importance as MARL algorithms find new applications in real-world systems ranging from energy systems to drone swarms. Most C-MARL algorithms use a primal-dual approach to…

Systems and Control · Electrical Eng. & Systems 2023-04-28 Daniel Tabas , Ahmed S. Zamzam , Baosen Zhang

A unique challenge in Multi-Agent Reinforcement Learning (MARL) is the curse of multiagency, where the description length of the game as well as the complexity of many existing learning algorithms scale exponentially with the number of…

Machine Learning · Computer Science 2023-03-03 Yuanhao Wang , Qinghua Liu , Yu Bai , Chi Jin

Multi-Agent Reinforcement Learning (MARL) approaches have emerged as popular solutions to address the general challenges of cooperation in multi-agent environments, where the success of achieving shared or individual goals critically…

Multiagent Systems · Computer Science 2024-12-31 Reza Azadeh

Information theoretic sensor management approaches are an ideal solution to state estimation problems when considering the optimal control of multi-agent systems, however they are too computationally intensive for large state spaces,…

Multiagent Systems · Computer Science 2021-02-02 William A. Dawson , Ruben Glatt , Edward Rusu , Braden C. Soper , Ryan A. Goldhahn

Regret analysis is challenging in Multi-Agent Reinforcement Learning (MARL) primarily due to the dynamical environments and the decentralized information among agents. We attempt to solve this challenge in the context of decentralized…

Machine Learning · Computer Science 2020-01-29 Seyed Mohammad Asghari , Yi Ouyang , Ashutosh Nayyar

Agentic Reinforcement Learning (ARL) trains large language models to interleave reasoning with external tool execution to solve complex tasks. Most existing ARL methods train a single set of parameters to support both reasoning and tool-use…

Artificial Intelligence · Computer Science 2026-05-29 Yu Li , Mingyang Yi , Xiuyu Li , Ju Fan , Fuxin Jiang , Binbin Chen , Peng Li , Jie Song , Tieying Zhang

Entropy regularization is a popular method in reinforcement learning (RL). Although it has many advantages, it alters the RL objective of the original Markov Decision Process (MDP). Though divergence regularization has been proposed to…

Machine Learning · Computer Science 2022-06-22 Kefan Su , Zongqing Lu

Cooperative multi-agent reinforcement learning (MARL) approaches tackle the challenge of finding effective multi-agent cooperation strategies for accomplishing individual or shared objectives in multi-agent teams. In real-world scenarios,…

Robotics · Computer Science 2023-10-20 Yasin Findik , Paul Robinette , Kshitij Jerath , S. Reza Ahmadzadeh

This paper presents the network load balancing problem, a challenging real-world task for multi-agent reinforcement learning (MARL) methods. Traditional heuristic solutions like Weighted-Cost Multi-Path (WCMP) and Local Shortest Queue (LSQ)…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-23 Zhiyuan Yao , Zihan Ding , Thomas Clausen

Recent renewed interest in multi-agent reinforcement learning (MARL) has generated an impressive array of techniques that leverage deep reinforcement learning, primarily actor-critic architectures, and can be applied to a limited range of…

Machine Learning · Computer Science 2021-06-21 Keyang He , Prashant Doshi , Bikramjit Banerjee

Multi-agent reinforcement learning (MARL) is a widely used Artificial Intelligence (AI) technique. However, current studies and applications need to address its scalability, non-stationarity, and trustworthiness. This paper aims to review…

Artificial Intelligence · Computer Science 2024-06-07 Ziyuan Zhou , Guanjun Liu , Ying Tang

The field of cooperative multi-agent reinforcement learning (MARL) has seen widespread use in addressing complex coordination tasks. While value decomposition methods in MARL have been popular, they have limitations in solving tasks with…

Multiagent Systems · Computer Science 2023-07-06 Shanqi Liu , Weiwei Liu , Wenzhou Chen , Guanzhong Tian , Yong Liu

An often neglected issue in multi-agent reinforcement learning (MARL) is the potential presence of unreliable agents in the environment whose deviations from expected behavior can prevent a system from accomplishing its intended tasks. In…

Multiagent Systems · Computer Science 2024-05-31 Ho Long Fung , Victor-Alexandru Darvariu , Stephen Hailes , Mirco Musolesi

Recent multi-agent actor-critic methods have utilized centralized training with decentralized execution to address the non-stationarity of co-adapting agents. This training paradigm constrains learning to the centralized phase such that…

Multiagent Systems · Computer Science 2019-10-09 Kevin Corder , Manuel M. Vindiola , Keith Decker

Experience replay is crucial for off-policy reinforcement learning (RL) methods. By remembering and reusing the experiences from past different policies, experience replay significantly improves the training efficiency and stability of RL…

Machine Learning · Computer Science 2023-03-01 Yongsheng Mei , Hanhan Zhou , Tian Lan , Guru Venkataramani , Peng Wei

Establishing sound experimental standards and rigour is important in any growing field of research. Deep Multi-Agent Reinforcement Learning (MARL) is one such nascent field. Although exciting progress has been made, MARL has recently come…

Artificial Intelligence · Computer Science 2024-01-29 Siddarth Singh , Omayma Mahjoub , Ruan de Kock , Wiem Khlifi , Abidine Vall , Kale-ab Tessera , Arnu Pretorius