中文
相关论文

相关论文: Zero Shot Coordination for Sparse Reward Tasks wit…

200 篇论文

Zero-shot coordination problem in multi-agent reinforcement learning (MARL), which requires agents to adapt to unseen agents, has attracted increasing attention. Traditional approaches often rely on the Self-Play (SP) framework to generate…

多智能体系统 · 计算机科学 2024-11-05 Weifan Long , Wen Wen , Peng Zhai , Lihua Zhang

Solving tasks with sparse rewards is one of the most important challenges in reinforcement learning. In the single-agent setting, this challenge is addressed by introducing intrinsic rewards that motivate agents to explore unseen regions of…

机器学习 · 计算机科学 2021-05-25 Shariq Iqbal , Fei Sha

Securing coordination between AI agent and teammates (human players or AI agents) in contexts involving unfamiliar humans continues to pose a significant challenge in Zero-Shot Coordination. The issue of cooperative incompatibility becomes…

人工智能 · 计算机科学 2024-03-01 Yang Li , Shao Zhang , Jichen Sun , Wenhao Zhang , Yali Du , Ying Wen , Xinbing Wang , Wei Pan

Cooperative Multi-agent Reinforcement Learning (MARL) is crucial for cooperative decentralized decision learning in many domains such as search and rescue, drone surveillance, package delivery and fire fighting problems. In these domains, a…

机器学习 · 计算机科学 2020-01-23 Rajiv Ranjan Kumar , Pradeep Varakantham

Many cooperative multiagent reinforcement learning environments provide agents with a sparse team-based reward, as well as a dense agent-specific reward that incentivizes learning basic skills. Training policies solely on the team-based…

机器学习 · 计算机科学 2020-10-13 Shauharda Khadka , Somdeb Majumdar , Santiago Miret , Stephen McAleer , Kagan Tumer

Zero-shot coordination (ZSC) is a popular setting for studying the ability of reinforcement learning (RL) agents to coordinate with novel partners. Prior ZSC formulations assume the $\textit{problem setting}$ is common knowledge: each agent…

机器学习 · 计算机科学 2024-11-08 Usman Anwar , Ashish Pandian , Jia Wan , David Krueger , Jakob Foerster

Multi-agent reinforcement learning (MARL) has become effective in tackling discrete cooperative game scenarios. However, MARL has yet to penetrate settings beyond those modelled by team and zero-sum games, confining it to a small subset of…

多智能体系统 · 计算机科学 2021-06-16 David Mguni , Yutong Wu , Yali Du , Yaodong Yang , Ziyi Wang , Minne Li , Ying Wen , Joel Jennings , Jun Wang

In cooperative multi-agent reinforcement learning (MARL), how to design a suitable reward signal to accelerate learning and stabilize convergence is a critical problem. The global reward signal assigns the same global reward to all agents…

人工智能 · 计算机科学 2020-03-10 Hangyu Mao , Zhibo Gong , Zhen Xiao

Zero-shot classification (ZSC) is the task of learning predictors for classes not seen during training. Although the different methods in the literature are evaluated using the same class splits, little is known about their stability under…

机器学习 · 计算机科学 2021-03-03 Matías Molina , Jorge Sánchez

In many coordination problems, independently reasoning humans are able to discover mutually compatible policies. In contrast, independently trained self-play policies are often mutually incompatible. Zero-shot coordination (ZSC) has…

人工智能 · 计算机科学 2023-07-14 Johannes Treutlein , Michael Dennis , Caspar Oesterheld , Jakob Foerster

Multi-agent reinforcement learning involves multiple agents interacting with each other and a shared environment to complete tasks. When rewards provided by the environment are sparse, agents may not receive immediate feedback on the…

机器学习 · 计算机科学 2021-03-31 Baicen Xiao , Bhaskar Ramasubramanian , Radha Poovendran

In real-world environments, autonomous agents rely on their egocentric observations. They must learn adaptive strategies to interact with others who possess mixed motivations, discernible only through visible cues. Several Multi-Agent…

多智能体系统 · 计算机科学 2023-12-15 Violet Xiang , Logan Cross , Jan-Philipp Fränken , Nick Haber

Learning to collaborate has witnessed significant progress in multi-agent reinforcement learning (MARL). However, promoting coordination among agents and enhancing exploration capabilities remain challenges. In multi-agent environments,…

人工智能 · 计算机科学 2023-12-18 Xiao Du , Yutong Ye , Pengyu Zhang , Yaning Yang , Mingsong Chen , Ting Wang

Training agents that can coordinate zero-shot with humans is a key mission in multi-agent reinforcement learning (MARL). Current algorithms focus on training simulated human partner policies which are then used to train a Cooperator agent.…

机器学习 · 计算机科学 2024-11-22 Yancheng Liang , Daphne Chen , Abhishek Gupta , Simon S. Du , Natasha Jaques

Zero-shot coordination (ZSC) is a significant challenge in multi-agent collaboration, aiming to develop agents that can coordinate with unseen partners they have not encountered before. Recent cutting-edge ZSC methods have primarily focused…

机器人学 · 计算机科学 2024-10-02 Yang Li , Dengyu Zhang , Junfan Chen , Ying Wen , Qingrui Zhang , Shaoshuai Mou , Wei Pan

We present the task of "Social Rearrangement", consisting of cooperative everyday tasks like setting up the dinner table, tidying a house or unpacking groceries in a simulated multi-agent environment. In Social Rearrangement, two robots…

机器学习 · 计算机科学 2023-06-02 Andrew Szot , Unnat Jain , Dhruv Batra , Zsolt Kira , Ruta Desai , Akshara Rai

Reinforcement learning (RL) relies heavily on exploration to learn from its environment and maximize observed rewards. Therefore, it is essential to design a reward function that guarantees optimal learning from the received experience.…

人工智能 · 计算机科学 2022-06-20 Ingy ElSayed-Aly , Lu Feng

Reward shaping (RS) is a powerful method in reinforcement learning (RL) for overcoming the problem of sparse or uninformative rewards. However, RS typically relies on manually engineered shaping-reward functions whose construction is…

Discovering successful coordinated behaviors is a central challenge in Multi-Agent Reinforcement Learning (MARL) since it requires exploring a joint action space that grows exponentially with the number of agents. In this paper, we propose…

机器学习 · 计算机科学 2021-10-14 Ammar Fayad , Majd Ibrahim

Sparse and delayed rewards pose a challenge to single agent reinforcement learning. This challenge is amplified in multi-agent reinforcement learning (MARL) where credit assignment of these rewards needs to happen not only across time, but…

机器学习 · 计算机科学 2022-11-01 Jennifer She , Jayesh K. Gupta , Mykel J. Kochenderfer