English
Related papers

Related papers: Learning Generalizable Skills from Offline Multi-T…

200 papers

Demonstration-guided reinforcement learning (RL) is a promising approach for learning complex behaviors by leveraging both reward feedback and a set of target task demonstrations. Prior approaches for demonstration-guided RL treat every new…

Machine Learning · Computer Science 2021-07-22 Karl Pertsch , Youngwoon Lee , Yue Wu , Joseph J. Lim

In multi-agent reinforcement learning (MARL), the centralized training with decentralized execution (CTDE) framework has gained widespread adoption due to its strong performance. However, the further development of CTDE faces two key…

Multiagent Systems · Computer Science 2024-12-25 Lunjun Liu , Weilai Jiang , Yaonan Wang

Long-horizon tasks, usually characterized by complex subtask dependencies, present a significant challenge in manipulation planning. Skill chaining is a practical approach to solving unseen tasks by combining learned skill priors. However,…

Robotics · Computer Science 2024-01-09 Utkarsh A. Mishra , Shangjie Xue , Yongxin Chen , Danfei Xu

Role-based learning is a promising approach to improving the performance of Multi-Agent Reinforcement Learning (MARL). Nevertheless, without manual assistance, current role-based methods cannot guarantee stably discovering a set of roles to…

Artificial Intelligence · Computer Science 2023-04-04 Xianghua Zeng , Hao Peng , Angsheng Li

Cooperative MARL often assumes frequent access to global information in a data buffer, such as team rewards or other agents' actions, which is typically unrealistic in decentralized MARL systems due to high communication costs. When…

Machine Learning · Computer Science 2026-01-21 Nuoya Xiong , Aarti Singh

Sometimes we benefit from actions that others have taken even when we are unaware that they took those actions. For example, if your neighbor chooses not to take a parking spot in front of your house when you are not there, you can benefit,…

Machine Learning · Computer Science 2026-04-10 Dane Malenfant , Blake A. Richards

Large Language Model-based multi-agent systems (MAS) have shown remarkable progress in solving complex tasks through collaborative reasoning and inter-agent critique. However, existing approaches typically treat each task in isolation,…

Computation and Language · Computer Science 2025-05-30 Yilong Li , Chen Qian , Yu Xia , Ruijie Shi , Yufan Dang , Zihao Xie , Ziming You , Weize Chen , Cheng Yang , Weichuan Liu , Ye Tian , Xuantang Xiong , Lei Han , Zhiyuan Liu , Maosong Sun

Conventionally, model-based reinforcement learning (MBRL) aims to learn a global model for the dynamics of the environment. A good model can potentially enable planning algorithms to generate a large variety of behaviors and solve diverse…

Machine Learning · Computer Science 2020-02-18 Archit Sharma , Shixiang Gu , Sergey Levine , Vikash Kumar , Karol Hausman

Multiagent reinforcement learning algorithms (MARL) have been demonstrated on complex tasks that require the coordination of a team of multiple agents to complete. Existing works have focused on sharing information between agents via…

Machine Learning · Computer Science 2019-03-18 Samir Wadhwania , Dong-Ki Kim , Shayegan Omidshafiei , Jonathan P. How

Cooperative multi-agent reinforcement learning (MARL) has made substantial strides in addressing the distributed decision-making challenges. However, as multi-agent systems grow in complexity, gaining a comprehensive understanding of their…

Artificial Intelligence · Computer Science 2023-12-15 Wiem Khlifi , Siddarth Singh , Omayma Mahjoub , Ruan de Kock , Abidine Vall , Rihab Gorsane , Arnu Pretorius

Generalizable object manipulation skills are critical for intelligent and multi-functional robots to work in real-world complex scenes. Despite the recent progress in reinforcement learning, it is still very challenging to learn a…

Robotics · Computer Science 2022-09-14 Hao Shen , Weikang Wan , He Wang

Hierarchical reinforcement learning (RL) can accelerate long-horizon decision-making by temporally abstracting a policy into multiple levels. Promising results in sparse reward environments have been seen with skills, i.e. sequences of…

Machine Learning · Computer Science 2024-07-15 Ce Hao , Catherine Weaver , Chen Tang , Kenta Kawamoto , Masayoshi Tomizuka , Wei Zhan

Multi-agent reinforcement learning (MARL) algorithms often struggle to find strategies close to Pareto optimal Nash Equilibrium, owing largely to the lack of efficient exploration. The problem is exacerbated in sparse-reward settings,…

Machine Learning · Computer Science 2024-05-03 Zhicheng Zhang , Yancheng Liang , Yi Wu , Fei Fang

Teams of people coordinate to perform complex tasks by forming abstract mental models of world and agent dynamics. The use of abstract models contrasts with much recent work in robot learning that uses a high-fidelity simulator and…

Robotics · Computer Science 2025-03-10 Adam Labiosa , Josiah P. Hanna

In cooperative Multi-Agent Reinforcement Learning (MARL), efficient exploration is crucial for optimizing the performance of joint policy. However, existing methods often update joint policies via independent agent exploration, without…

Machine Learning · Computer Science 2025-11-18 Zejiao Liu , Junqi Tu , Yitian Hong , Luolin Xiong , Yaochu Jin , Yang Tang , Fangfei Li

We posit a new mechanism for cooperation in multi-agent reinforcement learning (MARL) based upon any nonlinear function of the team's long-term state-action occupancy measure, i.e., a \emph{general utility}. This subsumes the cumulative…

Machine Learning · Statistics 2021-06-25 Junyu Zhang , Amrit Singh Bedi , Mengdi Wang , Alec Koppel

Hierarchical Reinforcement Learning (HRL) promises to solve long-horizon Reinforcement Learning (RL) tasks more efficiently than non-hierarchical counterparts by discovering and reusing temporally-extended skills. However, obtaining skills…

Artificial Intelligence · Computer Science 2026-05-27 Sarthak Dayal , Abhinav Peri , Carl Qi , Claas Voelcker , Alexander Levine , Caleb Chuck , Amy Zhang

Effective coordination is crucial to solve multi-agent collaborative (MAC) problems. While centralized reinforcement learning methods can optimally solve small MAC instances, they do not scale to large problems and they fail to generalize…

Machine Learning · Computer Science 2019-10-22 Nicolas Carion , Gabriel Synnaeve , Alessandro Lazaric , Nicolas Usunier

Multi-agent self-organizing systems (MASOS) exhibit key characteristics including scalability, adaptability, flexibility, and robustness, which have contributed to their extensive application across various fields. However, the…

Multiagent Systems · Computer Science 2025-08-14 Gang Chen , Guoxin Wang , Anton van Beek , Zhenjun Ming , Yan Yan

In this paper, we study the cooperative Multi-Agent Reinforcement Learning (MARL) problems using Reward Machines (RMs) to specify the reward functions such that the prior knowledge of high-level events in a task can be leveraged to…

Artificial Intelligence · Computer Science 2024-03-13 Xuejing Zheng , Chao Yu