English
Related papers

Related papers: Zero Shot Coordination for Sparse Reward Tasks wit…

200 papers

Zero-shot coordination problem in multi-agent reinforcement learning (MARL), which requires agents to adapt to unseen agents, has attracted increasing attention. Traditional approaches often rely on the Self-Play (SP) framework to generate…

Multiagent Systems · Computer Science 2024-11-05 Weifan Long , Wen Wen , Peng Zhai , Lihua Zhang

Solving tasks with sparse rewards is one of the most important challenges in reinforcement learning. In the single-agent setting, this challenge is addressed by introducing intrinsic rewards that motivate agents to explore unseen regions of…

Machine Learning · Computer Science 2021-05-25 Shariq Iqbal , Fei Sha

Securing coordination between AI agent and teammates (human players or AI agents) in contexts involving unfamiliar humans continues to pose a significant challenge in Zero-Shot Coordination. The issue of cooperative incompatibility becomes…

Artificial Intelligence · Computer Science 2024-03-01 Yang Li , Shao Zhang , Jichen Sun , Wenhao Zhang , Yali Du , Ying Wen , Xinbing Wang , Wei Pan

Cooperative Multi-agent Reinforcement Learning (MARL) is crucial for cooperative decentralized decision learning in many domains such as search and rescue, drone surveillance, package delivery and fire fighting problems. In these domains, a…

Machine Learning · Computer Science 2020-01-23 Rajiv Ranjan Kumar , Pradeep Varakantham

Many cooperative multiagent reinforcement learning environments provide agents with a sparse team-based reward, as well as a dense agent-specific reward that incentivizes learning basic skills. Training policies solely on the team-based…

Machine Learning · Computer Science 2020-10-13 Shauharda Khadka , Somdeb Majumdar , Santiago Miret , Stephen McAleer , Kagan Tumer

Zero-shot coordination (ZSC) is a popular setting for studying the ability of reinforcement learning (RL) agents to coordinate with novel partners. Prior ZSC formulations assume the $\textit{problem setting}$ is common knowledge: each agent…

Machine Learning · Computer Science 2024-11-08 Usman Anwar , Ashish Pandian , Jia Wan , David Krueger , Jakob Foerster

Multi-agent reinforcement learning (MARL) has become effective in tackling discrete cooperative game scenarios. However, MARL has yet to penetrate settings beyond those modelled by team and zero-sum games, confining it to a small subset of…

Multiagent Systems · Computer Science 2021-06-16 David Mguni , Yutong Wu , Yali Du , Yaodong Yang , Ziyi Wang , Minne Li , Ying Wen , Joel Jennings , Jun Wang

In cooperative multi-agent reinforcement learning (MARL), how to design a suitable reward signal to accelerate learning and stabilize convergence is a critical problem. The global reward signal assigns the same global reward to all agents…

Artificial Intelligence · Computer Science 2020-03-10 Hangyu Mao , Zhibo Gong , Zhen Xiao

Zero-shot classification (ZSC) is the task of learning predictors for classes not seen during training. Although the different methods in the literature are evaluated using the same class splits, little is known about their stability under…

Machine Learning · Computer Science 2021-03-03 Matías Molina , Jorge Sánchez

In many coordination problems, independently reasoning humans are able to discover mutually compatible policies. In contrast, independently trained self-play policies are often mutually incompatible. Zero-shot coordination (ZSC) has…

Artificial Intelligence · Computer Science 2023-07-14 Johannes Treutlein , Michael Dennis , Caspar Oesterheld , Jakob Foerster

Multi-agent reinforcement learning involves multiple agents interacting with each other and a shared environment to complete tasks. When rewards provided by the environment are sparse, agents may not receive immediate feedback on the…

Machine Learning · Computer Science 2021-03-31 Baicen Xiao , Bhaskar Ramasubramanian , Radha Poovendran

In real-world environments, autonomous agents rely on their egocentric observations. They must learn adaptive strategies to interact with others who possess mixed motivations, discernible only through visible cues. Several Multi-Agent…

Multiagent Systems · Computer Science 2023-12-15 Violet Xiang , Logan Cross , Jan-Philipp Fränken , Nick Haber

Learning to collaborate has witnessed significant progress in multi-agent reinforcement learning (MARL). However, promoting coordination among agents and enhancing exploration capabilities remain challenges. In multi-agent environments,…

Artificial Intelligence · Computer Science 2023-12-18 Xiao Du , Yutong Ye , Pengyu Zhang , Yaning Yang , Mingsong Chen , Ting Wang

Training agents that can coordinate zero-shot with humans is a key mission in multi-agent reinforcement learning (MARL). Current algorithms focus on training simulated human partner policies which are then used to train a Cooperator agent.…

Machine Learning · Computer Science 2024-11-22 Yancheng Liang , Daphne Chen , Abhishek Gupta , Simon S. Du , Natasha Jaques

Zero-shot coordination (ZSC) is a significant challenge in multi-agent collaboration, aiming to develop agents that can coordinate with unseen partners they have not encountered before. Recent cutting-edge ZSC methods have primarily focused…

Robotics · Computer Science 2024-10-02 Yang Li , Dengyu Zhang , Junfan Chen , Ying Wen , Qingrui Zhang , Shaoshuai Mou , Wei Pan

We present the task of "Social Rearrangement", consisting of cooperative everyday tasks like setting up the dinner table, tidying a house or unpacking groceries in a simulated multi-agent environment. In Social Rearrangement, two robots…

Machine Learning · Computer Science 2023-06-02 Andrew Szot , Unnat Jain , Dhruv Batra , Zsolt Kira , Ruta Desai , Akshara Rai

Reinforcement learning (RL) relies heavily on exploration to learn from its environment and maximize observed rewards. Therefore, it is essential to design a reward function that guarantees optimal learning from the received experience.…

Artificial Intelligence · Computer Science 2022-06-20 Ingy ElSayed-Aly , Lu Feng

Reward shaping (RS) is a powerful method in reinforcement learning (RL) for overcoming the problem of sparse or uninformative rewards. However, RS typically relies on manually engineered shaping-reward functions whose construction is…

Discovering successful coordinated behaviors is a central challenge in Multi-Agent Reinforcement Learning (MARL) since it requires exploring a joint action space that grows exponentially with the number of agents. In this paper, we propose…

Machine Learning · Computer Science 2021-10-14 Ammar Fayad , Majd Ibrahim

Sparse and delayed rewards pose a challenge to single agent reinforcement learning. This challenge is amplified in multi-agent reinforcement learning (MARL) where credit assignment of these rewards needs to happen not only across time, but…

Machine Learning · Computer Science 2022-11-01 Jennifer She , Jayesh K. Gupta , Mykel J. Kochenderfer