English
Related papers

Related papers: Skill Discovery of Coordination in Multi-agent Rei…

200 papers

Deep reinforcement learning algorithms have recently been used to train multiple interacting agents in a centralised manner whilst keeping their execution decentralised. When the agents can only acquire partial observations and are faced…

Machine Learning · Computer Science 2020-01-27 Emanuele Pesce , Giovanni Montana

A hallmark of intelligent agents is the ability to learn reusable skills purely from unsupervised interaction with the environment. However, existing unsupervised skill discovery methods often learn entangled skills where one skill variable…

Machine Learning · Computer Science 2024-10-16 Jiaheng Hu , Zizhao Wang , Peter Stone , Roberto Martín-Martín

Current reinforcement learning (RL) in robotics often experiences difficulty in generalizing to new downstream tasks due to the innate task-specific training paradigm. To alleviate it, unsupervised RL, a framework that pre-trains the agent…

Robotics · Computer Science 2022-10-13 Daesol Cho , Jigang Kim , H. Jin Kim

Multi-agent reinforcement learning (MARL) has achieved significant progress in large-scale traffic control, autonomous vehicles, and robotics. Drawing inspiration from biological systems where roles naturally emerge to enable coordination,…

Multiagent Systems · Computer Science 2026-05-01 Harsh Goel , Mohammad Omama , Behdad Chalaki , Vaishnav Tadiparthi , Ehsan Moradi Pari , Sandeep Chinchali

Conventionally, model-based reinforcement learning (MBRL) aims to learn a global model for the dynamics of the environment. A good model can potentially enable planning algorithms to generate a large variety of behaviors and solve diverse…

Machine Learning · Computer Science 2020-02-18 Archit Sharma , Shixiang Gu , Sergey Levine , Vikash Kumar , Karol Hausman

The learning efficiency and generalization ability of an intelligent agent can be greatly improved by utilizing a useful set of skills. However, the design of robot skills can often be intractable in real-world applications due to the…

Robotics · Computer Science 2021-06-29 Kuan Fang , Yuke Zhu , Silvio Savarese , Li Fei-Fei

Large transformer models, trained on diverse datasets, have demonstrated impressive few-shot performance on previously unseen tasks without requiring parameter updates. This capability has also been explored in Reinforcement Learning (RL),…

Multiagent Systems · Computer Science 2026-04-02 Tao Jiang , Zichuan Lin , Lihe Li , Yi-Chen Li , Cong Guan , Lei Yuan , Zongzhang Zhang , Yang Yu , Deheng Ye

Unsupervised skill discovery in reinforcement learning (RL) aims to learn diverse behaviors without relying on external rewards. However, current methods often overlook the periodic nature of learned skills, focusing instead on increasing…

Machine Learning · Computer Science 2025-12-01 Jonghae Park , Daesol Cho , Jusuk Lee , Dongseok Shim , Inkyu Jang , H. Jin Kim

Unsupervised Reinforcement Learning (RL) aims to discover diverse behaviors that can accelerate the learning of downstream tasks. Previous methods typically focus on entropy-based exploration or empowerment-driven skill learning. However,…

Machine Learning · Computer Science 2025-06-18 Ting Xiao , Jiakun Zheng , Rushuai Yang , Kang Xu , Qiaosheng Zhang , Peng Liu , Chenjia Bai

We consider the problem of robust multi-agent reinforcement learning (MARL) for cooperative communication and coordination tasks. MARL agents, mainly those trained in a centralized way, can be brittle because they can adopt policies that…

Multiagent Systems · Computer Science 2020-12-16 T. van der Heiden , C. Salge , E. Gavves , H. van Hoof

Skill discovery methods enable agents to learn diverse emergent behaviors without explicit rewards. To make learned skills useful for unknown downstream tasks, obtaining a semantically diverse repertoire of skills is essential. While some…

Computation and Language · Computer Science 2025-03-04 Seungeun Rho , Laura Smith , Tianyu Li , Sergey Levine , Xue Bin Peng , Sehoon Ha

Self-supervised skill learning aims to acquire useful behaviors that leverage the underlying dynamics of the environment. Latent variable models, based on mutual information maximization, have been successful in this task but still struggle…

Machine Learning · Computer Science 2024-03-22 David Emukpere , Bingbing Wu , Julien Perez , Jean-Michel Renders

One of the key capabilities of intelligent agents is the ability to discover useful skills without external supervision. However, the current unsupervised skill discovery methods are often limited to acquiring simple, easy-to-learn skills…

Robotics · Computer Science 2023-06-06 Seohong Park , Kimin Lee , Youngwoon Lee , Pieter Abbeel

Recently, deep multi-agent reinforcement learning (MARL) has shown the promise to solve complex cooperative tasks. Its success is partly because of parameter sharing among agents. However, such sharing may lead agents to behave similarly…

Machine Learning · Computer Science 2021-11-02 Chenghao Li , Tonghan Wang , Chengjie Wu , Qianchuan Zhao , Jun Yang , Chongjie Zhang

Reinforcement learning necessitates meticulous reward shaping by specialists to elicit target behaviors, while imitation learning relies on costly task-specific data. In contrast, unsupervised skill discovery can potentially reduce these…

Robotics · Computer Science 2026-02-11 Ruopeng Cui , Yifei Bi , Haojie Luo , Wei Li

Robust coordination skills enable agents to operate cohesively in shared environments, together towards a common goal and, ideally, individually without hindering each other's progress. To this end, this paper presents Coordinated QMIX…

Machine Learning · Computer Science 2024-12-25 Giovanni Minelli , Mirco Musolesi

Exploration in decentralized cooperative multi-agent reinforcement learning faces two challenges. One is that the novelty of global states is unavailable, while the novelty of local observations is biased. The other is how agents can…

Multiagent Systems · Computer Science 2024-08-13 Haobin Jiang , Ziluo Ding , Zongqing Lu

With recent advances in Large Language Models (LLMs), Agentic AI has become phenomenal in real-world applications, moving toward multiple LLM-based agents to perceive, learn, reason, and act collaboratively. These LLM-based Multi-Agent…

Artificial Intelligence · Computer Science 2025-01-14 Khanh-Tung Tran , Dung Dao , Minh-Duong Nguyen , Quoc-Viet Pham , Barry O'Sullivan , Hoang D. Nguyen

Language-conditioned robotic skills make it possible to apply the high-level reasoning of Large Language Models (LLMs) to low-level robotic control. A remaining challenge is to acquire a diverse set of fundamental skills. Existing…

Robotics · Computer Science 2024-08-19 Xufeng Zhao , Cornelius Weber , Stefan Wermter

We consider a multi-agent reinforcement learning problem where each agent seeks to maximize a shared reward while interacting with other agents, and they may or may not be able to communicate. Typically the agents do not have access to…

Multiagent Systems · Computer Science 2021-04-26 Alex Tong Lin , Mark J. Debord , Katia Estabridis , Gary Hewer , Guido Montufar , Stanley Osher