English
Related papers

Related papers: Zero Shot Coordination for Sparse Reward Tasks wit…

200 papers

Multi-agent reinforcement learning (MARL) has shown wide applicability in collaborative systems such as autonomous driving and smart cities for its ability of learning through interaction. With the recent development of drone networks,…

Networking and Internet Architecture · Computer Science 2026-05-26 Changling Li , Ying Li

Large transformer models, trained on diverse datasets, have demonstrated impressive few-shot performance on previously unseen tasks without requiring parameter updates. This capability has also been explored in Reinforcement Learning (RL),…

Multiagent Systems · Computer Science 2026-04-02 Tao Jiang , Zichuan Lin , Lihe Li , Yi-Chen Li , Cong Guan , Lei Yuan , Zongzhang Zhang , Yang Yu , Deheng Ye

Multi-agent reinforcement learning (MARL) has shown recent success in increasingly complex fixed-team zero-sum environments. However, the real world is not zero-sum nor does it have fixed teams; humans face numerous social dilemmas and must…

Machine Learning · Computer Science 2020-11-12 Bowen Baker

In Emergent Communication (EC) agents learn to communicate with one another, but the protocols that they develop are specialised to their training community. This observation led to research into Zero-Shot Coordination (ZSC) for learning…

Machine Learning · Computer Science 2024-02-27 Dylan Cope , Peter McBurney

Zero-Shot Classification (ZSC) equips the learned model with the ability to recognize the visual instances from the novel classes via constructing the interactions between the visual and the semantic modalities. In contrast to the…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Zhong Ji , Xuejie Yu , Yunlong Yu , Yanwei Pang , Zhongfei Zhang

Integrating Large Language Models (LLMs) with external tools via multi-agent systems offers a promising new paradigm for decomposing and solving complex problems. However, training these systems remains notoriously difficult due to the…

Artificial Intelligence · Computer Science 2026-02-10 Yanming Li , Xuelin Zhang , WenJie Lu , Ziye Tang , Maodong Wu , Haotian Luo , Tongtong Wu , Zijie Peng , Hongze Mi , Yibo Feng , Naiqiang Tan , Chao Huang , Hong Chen , Li Shen

We introduce Self-supervised Online Reward Shaping (SORS), which aims to improve the sample efficiency of any RL algorithm in sparse-reward environments by automatically densifying rewards. The proposed framework alternates between…

Machine Learning · Computer Science 2021-07-27 Farzan Memarian , Wonjoon Goo , Rudolf Lioutikov , Scott Niekum , Ufuk Topcu

The difficulty of appropriately assigning credit is particularly heightened in cooperative MARL with sparse reward, due to the concurrent time and structural scales involved. Automatic subgoal generation (ASG) has recently emerged as a…

Machine Learning · Computer Science 2023-10-03 Wenhao Li , Dan Qiao , Baoxiang Wang , Xiangfeng Wang , Bo Jin , Hongyuan Zha

Value-based methods of multi-agent reinforcement learning (MARL), especially the value decomposition methods, have been demonstrated on a range of challenging cooperative tasks. However, current methods pay little attention to the…

Machine Learning · Computer Science 2021-02-12 Xiaoteng Ma , Yiqin Yang , Chenghao Li , Yiwen Lu , Qianchuan Zhao , Yang Jun

Learning robotic manipulation tasks using reinforcement learning with sparse rewards is currently impractical due to the outrageous data requirements. Many practical tasks require manipulation of multiple objects, and the complexity of such…

Robotics · Computer Science 2019-12-24 Richard Li , Allan Jabri , Trevor Darrell , Pulkit Agrawal

Offline multi-agent reinforcement learning (MARL) aims to learn effective multi-agent policies from pre-collected datasets, which is an important step toward the deployment of multi-agent systems in real-world applications. However, in…

Machine Learning · Computer Science 2023-03-02 Qi Tian , Kun Kuang , Furui Liu , Baoxiang Wang

Inferring reward functions from demonstrations is a key challenge in reinforcement learning (RL), particularly in multi-agent RL (MARL), where large joint state-action spaces and complex inter-agent interactions complicate the task. While…

Machine Learning · Computer Science 2025-02-03 The Viet Bui , Tien Mai , Hong Thanh Nguyen

The study of zero-shot generalisation (ZSG) in deep Reinforcement Learning (RL) aims to produce RL algorithms whose policies generalise well to novel unseen situations at deployment time, avoiding overfitting to their training environments.…

Machine Learning · Computer Science 2023-01-20 Robert Kirk , Amy Zhang , Edward Grefenstette , Tim Rocktäschel

The complexity of multiagent reinforcement learning (MARL) in multiagent systems increases exponentially with respect to the agent number. This scalability issue prevents MARL from being applied in large-scale multiagent systems. However,…

Multiagent Systems · Computer Science 2020-03-05 Chuangchuang Sun , Macheng Shen , Jonathan P. How

Designing effective reward functions remains a central challenge in reinforcement learning, especially in multi-objective environments. In this work, we propose Multi-Objective Reward Shaping with Exploration (MORSE), a general framework…

Machine Learning · Computer Science 2025-12-18 Yuqing Xie , Jiayu Chen , Wenhao Tang , Ya Zhang , Chao Yu , Yu Wang

We introduce a curriculum learning algorithm, Variational Automatic Curriculum Learning (VACL), for solving challenging goal-conditioned cooperative multi-agent reinforcement learning problems. We motivate our paradigm through a variational…

Machine Learning · Computer Science 2023-12-12 Jiayu Chen , Yuanxin Zhang , Yuanfan Xu , Huimin Ma , Huazhong Yang , Jiaming Song , Yu Wang , Yi Wu

We study the problem of cooperative multi-agent reinforcement learning with a single joint reward signal. This class of learning problems is difficult because of the often large combined action and observation spaces. In the fully…

Reinforcement learning has significant applications for multi-agent systems, especially in unknown dynamic environments. However, most multi-agent reinforcement learning (MARL) algorithms suffer from such problems as exponential computation…

Multiagent Systems · Computer Science 2016-04-01 Luowei Zhou , Pei Yang , Chunlin Chen , Yang Gao

The necessity for cooperation among intelligent machines has popularised cooperative multi-agent reinforcement learning (MARL) in AI research. However, many research endeavours heavily rely on parameter sharing among agents, which confines…

Machine Learning · Computer Science 2023-12-29 Yifan Zhong , Jakub Grudzien Kuba , Xidong Feng , Siyi Hu , Jiaming Ji , Yaodong Yang

Cooperative multi-agent reinforcement learning (MARL) aims to develop agents that can collaborate effectively. However, most cooperative MARL methods overfit training agents, making learned policies not generalize well to unseen…

Artificial Intelligence · Computer Science 2025-01-13 Kanefumi Matsuyama , Kefan Su , Jiangxing Wang , Deheng Ye , Zongqing Lu