English
Related papers

Related papers: Disentangled Unsupervised Skill Discovery for Effi…

200 papers

Unsupervised Skill Discovery (USD) aims to autonomously learn a diverse set of skills without relying on extrinsic rewards. One of the most common USD approaches is to maximize the Mutual Information (MI) between skill latent variables and…

Machine Learning · Computer Science 2026-02-03 Seyed Mohammad Hadi Hosseini , Mahdieh Soleymani Baghshah

Unsupervised skill discovery carries the promise that an intelligent agent can learn reusable skills through autonomous, reward-free environment interaction. Existing unsupervised skill discovery methods learn skills by encouraging…

Machine Learning · Computer Science 2024-10-25 Zizhao Wang , Jiaheng Hu , Caleb Chuck , Stephen Chen , Roberto Martín-Martín , Amy Zhang , Scott Niekum , Peter Stone

Biological intelligence can learn to solve many diverse tasks in a data efficient manner by re-using basic knowledge and skills from one task to another. Furthermore, many of such skills are acquired without explicit supervision in an…

We study the problem of unsupervised skill discovery, whose goal is to learn a set of diverse and useful skills with no external reward. There have been a number of skill discovery methods based on maximizing the mutual information (MI)…

Machine Learning · Computer Science 2022-02-09 Seohong Park , Jongwook Choi , Jaekyeom Kim , Honglak Lee , Gunhee Kim

Skills are essential for unlocking higher levels of problem solving. A common approach to discovering these skills is to learn ones that reliably reach different states, thus empowering the agent to control its environment. However,…

Machine Learning · Computer Science 2025-10-07 Jonathan Colaço Carr , Qinyi Sun , Cameron Allen

Unsupervised skill discovery drives intelligent agents to explore the unknown environment without task-specific reward signal, and the agents acquire various skills which may be useful when the agents adapt to new tasks. In this paper, we…

Multiagent Systems · Computer Science 2020-06-09 Shuncheng He , Jianzhun Shao , Xiangyang Ji

Unsupervised Reinforcement Learning (RL) aims to discover diverse behaviors that can accelerate the learning of downstream tasks. Previous methods typically focus on entropy-based exploration or empowerment-driven skill learning. However,…

Machine Learning · Computer Science 2025-06-18 Ting Xiao , Jiakun Zheng , Rushuai Yang , Kang Xu , Qiaosheng Zhang , Peng Liu , Chenjia Bai

In reinforcement learning, unsupervised skill discovery aims to learn diverse skills without extrinsic rewards. Previous methods discover skills by maximizing the mutual information (MI) between states and skills. However, such an MI…

Machine Learning · Computer Science 2023-05-09 Rushuai Yang , Chenjia Bai , Hongyi Guo , Siyuan Li , Bin Zhao , Zhen Wang , Peng Liu , Xuelong Li

Conventionally, model-based reinforcement learning (MBRL) aims to learn a global model for the dynamics of the environment. A good model can potentially enable planning algorithms to generate a large variety of behaviors and solve diverse…

Machine Learning · Computer Science 2020-02-18 Archit Sharma , Shixiang Gu , Sergey Levine , Vikash Kumar , Karol Hausman

This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible. Unsupervised skill discovery seeks to acquire different useful skills…

Machine Learning · Computer Science 2025-02-25 Xin Liu , Yaran Chen , Dongbin Zhao

How can a reinforcement learning (RL) agent prepare to solve downstream tasks if those tasks are not known a priori? One approach is unsupervised skill discovery, a class of algorithms that learn a set of policies without access to a reward…

Machine Learning · Computer Science 2021-10-07 Benjamin Eysenbach , Ruslan Salakhutdinov , Sergey Levine

One of the key capabilities of intelligent agents is the ability to discover useful skills without external supervision. However, the current unsupervised skill discovery methods are often limited to acquiring simple, easy-to-learn skills…

Robotics · Computer Science 2023-06-06 Seohong Park , Kimin Lee , Youngwoon Lee , Pieter Abbeel

Learning meaningful behaviors in the absence of reward is a difficult problem in reinforcement learning. A desirable and challenging unsupervised objective is to learn a set of diverse skills that provide a thorough coverage of the state…

Machine Learning · Computer Science 2022-05-03 Pierre-Alexandre Kamienny , Jean Tarbouriech , Sylvain Lamprier , Alessandro Lazaric , Ludovic Denoyer

We consider the problem of unsupervised skill segmentation and hierarchical structure discovery in reinforcement learning. While recent approaches have sought to segment trajectories into reusable skills or options, most rely on action…

Machine Learning · Computer Science 2026-05-29 Damion Harvey , Geraud Nangue Tasse , Benjamin Rosman , Branden Ingram , Steven James

Unsupervised Skill Discovery (USD) allows agents to autonomously learn diverse behaviors without task-specific rewards. While recent USD methods have shown promise, their application to real-world robotics remains underexplored. In this…

Robotics · Computer Science 2025-09-01 Rafael Cathomen , Mayank Mittal , Marin Vlastelica , Marco Hutter

In meta-learning and its downstream tasks, many methods rely on implicit adaptation to task variations, where multiple factors are mixed together in a single entangled representation. This makes it difficult to interpret which factors drive…

Robotics · Computer Science 2025-09-03 Seonsoo Kim , Jun-Gill Kang , Taehong Kim , Seongil Hong

We propose a novel framework for multi-task reinforcement learning (MTRL). Using a variational inference formulation, we learn policies that generalize across both changing dynamics and goals. The resulting policies are parametrized by…

Machine Learning · Computer Science 2019-06-24 Janith C. Petangoda , Sergio Pascual-Diaz , Vincent Adam , Peter Vrancx , Jordi Grau-Moya

Unsupervised skill discovery in Reinforcement Learning aims to mimic humans' ability to autonomously discover diverse behaviors. However, existing methods are often unconstrained, making it difficult to find useful skills, especially in…

Machine Learning · Computer Science 2025-01-30 Maxence Hussonnois , Thommen George Karimpanal , Santu Rana

Most deep reinforcement learning algorithms are data inefficient in complex and rich environments, limiting their applicability to many scenarios. One direction for improving data efficiency is multitask learning with shared neural network…

Unsupervised Reinforcement Learning (RL) provides a promising paradigm for learning useful behaviors via reward-free per-training. Existing methods for unsupervised RL mainly conduct empowerment-driven skill discovery or entropy-based…

Machine Learning · Computer Science 2024-05-28 Chenjia Bai , Rushuai Yang , Qiaosheng Zhang , Kang Xu , Yi Chen , Ting Xiao , Xuelong Li
‹ Prev 1 2 3 10 Next ›