English
Related papers

Related papers: Promoting Coordination through Policy Regularizati…

200 papers

Multi-agent reinforcement learning in mixed-motive settings presents a fundamental challenge: agents must balance individual interests with collective goals, which are neither fully aligned nor strictly opposed. To address this, reward…

Multiagent Systems · Computer Science 2025-08-26 Woojun Kim , Katia Sycara

There is a growing interest in Multi-Agent Reinforcement Learning (MARL) as the first steps towards building general intelligent agents that learn to make low and high-level decisions in non-stationary complex environments in the presence…

Artificial Intelligence · Computer Science 2020-01-01 Marco Jerome Gasparrini , Ricard Solé , Martí Sánchez-Fibla

Collective human knowledge has clearly benefited from the fact that innovations by individuals are taught to others through communication. Similar to human social groups, agents in distributed learning systems would likely benefit from…

Preference-based Reinforcement Learning (PbRL) has made significant strides in single-agent settings, but has not been studied for multi-agent frameworks. On the other hand, modeling cooperation between multiple agents, specifically,…

Artificial Intelligence · Computer Science 2024-09-26 Siddhant Bhambri , Mudit Verma , Upasana Biswas , Anil Murthy , Subbarao Kambhampati

Due to the complex interactions between agents, learning multi-agent control policy often requires a prohibited amount of data. This paper aims to enable multi-agent systems to effectively utilize past memories to adapt to novel…

Robotics · Computer Science 2025-01-28 So Kuroki , Mai Nishimura , Tadashi Kozuno

We enable reinforcement learning agents to learn successful behavior policies by utilizing relevant pre-existing teacher policies. The teacher policies are introduced as objectives, in addition to the task objective, in a multi-objective…

Machine Learning · Computer Science 2023-08-31 Shruti Mishra , Ankit Anand , Jordan Hoffmann , Nicolas Heess , Martin Riedmiller , Abbas Abdolmaleki , Doina Precup

Multi agent strategies in mixed cooperative-competitive environments can be hard to craft by hand because each agent needs to coordinate with its teammates while competing with its opponents. Learning based algorithms are appealing but many…

Artificial Intelligence · Computer Science 2020-07-08 Ankur Deka , Katia Sycara

Training a multi-agent reinforcement learning (MARL) algorithm is more challenging than training a single-agent reinforcement learning algorithm, because the result of a multi-agent task strongly depends on the complex interactions among…

Machine Learning · Computer Science 2021-01-19 Heechang Ryu , Hayong Shin , Jinkyoo Park

In this effort, we consider the impact of regularization on the diversity of actions taken by policies generated from reinforcement learning agents trained using a policy gradient. Policy gradient agents are prone to entropy collapse, which…

Machine Learning · Computer Science 2023-10-10 Andrew Starnes , Anton Dereventsov , Clayton Webster

Even though Google Research Football (GRF) was initially benchmarked and studied as a single-agent environment in its original paper, recent years have witnessed an increasing focus on its multi-agent nature by researchers utilizing it as a…

Multiagent Systems · Computer Science 2023-09-25 Yan Song , He Jiang , Haifeng Zhang , Zheng Tian , Weinan Zhang , Jun Wang

Cooperative multi-agent reinforcement learning is a powerful tool to solve many real-world cooperative tasks, but restrictions of real-world applications may require training the agents in a fully decentralized manner. Due to the lack of…

Multiagent Systems · Computer Science 2024-01-11 Jiechuan Jiang , Kefan Su , Zongqing Lu

Cooperation is fundamental in Multi-Agent Systems (MAS) and Multi-Agent Reinforcement Learning (MARL), often requiring agents to balance individual gains with collective rewards. In this regard, this paper aims to investigate strategies to…

Computer Science and Game Theory · Computer Science 2024-05-06 Vaigarai Sathi , Sabahat Shaik , Jaswanth Nidamanuri

We address two major challenges of implicit coordination in multi-agent deep reinforcement learning: non-stationarity and exponential growth of state-action space, by combining Deep-Q Networks for policy learning with Nash equilibrium for…

Multiagent Systems · Computer Science 2020-12-17 Griffin Adams , Sarguna Janani Padmanabhan , Shivang Shekhar

Information sharing is key in building team cognition and enables coordination and cooperation. High-performing human teams also benefit from acting strategically with hierarchical levels of iterated communication and rationalizability,…

Multiagent Systems · Computer Science 2022-06-28 Sachin Konan , Esmaeil Seraj , Matthew Gombolay

Many real-world scenarios involve a team of agents that have to coordinate their policies to achieve a shared goal. Previous studies mainly focus on decentralized control to maximize a common reward and barely consider the coordination…

Multiagent Systems · Computer Science 2022-01-19 Jingqing Ruan , Yali Du , Xuantang Xiong , Dengpeng Xing , Xiyun Li , Linghui Meng , Haifeng Zhang , Jun Wang , Bo Xu

The real world is awash with multi-agent problems that require collective action by self-interested agents, from the routing of packets across a computer network to the management of irrigation systems. Such systems have local incentives…

Multiagent Systems · Computer Science 2021-02-16 Michiel A. Bakker , Richard Everett , Laura Weidinger , Iason Gabriel , William S. Isaac , Joel Z. Leibo , Edward Hughes

Deep Reinforcement Learning has made significant progress in multi-agent systems in recent years. In this review article, we have focused on presenting recent approaches on Multi-Agent Reinforcement Learning (MARL) algorithms. In…

Machine Learning · Computer Science 2021-05-03 Afshin OroojlooyJadid , Davood Hajinezhad

Deep Reinforcement Learning (Deep RL) has been receiving increasingly more attention thanks to its encouraging performance on a variety of control tasks. Yet, conventional regularization techniques in training neural networks (e.g., $L_2$…

Machine Learning · Computer Science 2021-11-30 Zhuang Liu , Xuanlin Li , Bingyi Kang , Trevor Darrell

We consider the task of building strong but human-like policies in multi-agent decision-making problems, given examples of human behavior. Imitation learning is effective at predicting human actions but may not match the strength of expert…

Multiagent Systems · Computer Science 2022-02-18 Athul Paul Jacob , David J. Wu , Gabriele Farina , Adam Lerer , Hengyuan Hu , Anton Bakhtin , Jacob Andreas , Noam Brown

In multi-agent problems requiring a high degree of cooperation, success often depends on the ability of the agents to adapt to each other's behavior. A natural solution concept in such settings is the Stackelberg equilibrium, in which the…

Machine Learning · Computer Science 2024-06-14 Robert Loftin , Mustafa Mert Çelikok , Herke van Hoof , Samuel Kaski , Frans A. Oliehoek