English
Related papers

Related papers: Controllability-Aware Unsupervised Skill Discovery

200 papers

Unsupervised skill discovery in Reinforcement Learning aims to mimic humans' ability to autonomously discover diverse behaviors. However, existing methods are often unconstrained, making it difficult to find useful skills, especially in…

Machine Learning · Computer Science 2025-01-30 Maxence Hussonnois , Thommen George Karimpanal , Santu Rana

We introduce Contrastive Intrinsic Control (CIC), an algorithm for unsupervised skill discovery that maximizes the mutual information between state-transitions and latent skill vectors. CIC utilizes contrastive learning between…

Machine Learning · Computer Science 2022-03-31 Michael Laskin , Hao Liu , Xue Bin Peng , Denis Yarats , Aravind Rajeswaran , Pieter Abbeel

Unsupervised skill discovery aims to acquire behavior primitives that improve exploration and accelerate downstream task learning. However, existing approaches often ignore the geometric symmetries of physical environments, leading to…

Robotics · Computer Science 2026-01-21 Junwoo Chang , Joseph Park , Roberto Horowitz , Jongmin Lee , Jongeun Choi

Autonomous skill discovery aims to enable robots to acquire diverse behaviors without explicit supervision. Learning such behaviors directly on physical hardware remains challenging due to safety and data efficiency constraints. Existing…

Robotics · Computer Science 2025-08-29 Luca Grillotti , Lisa Coiffard , Oscar Pang , Maxence Faldor , Antoine Cully

Learning meaningful behaviors in the absence of reward is a difficult problem in reinforcement learning. A desirable and challenging unsupervised objective is to learn a set of diverse skills that provide a thorough coverage of the state…

Machine Learning · Computer Science 2022-05-03 Pierre-Alexandre Kamienny , Jean Tarbouriech , Sylvain Lamprier , Alessandro Lazaric , Ludovic Denoyer

In the field of unsupervised skill discovery (USD), a major challenge is limited exploration, primarily due to substantial penalties when skills deviate from their initial trajectories. To enhance exploration, recent methodologies employ…

Machine Learning · Computer Science 2023-11-02 Hyunseung Kim , Byungkun Lee , Hojoon Lee , Dongyoon Hwang , Sejik Park , Kyushik Min , Jaegul Choo

Unsupervised Reinforcement Learning (RL) aims to discover diverse behaviors that can accelerate the learning of downstream tasks. Previous methods typically focus on entropy-based exploration or empowerment-driven skill learning. However,…

Machine Learning · Computer Science 2025-06-18 Ting Xiao , Jiakun Zheng , Rushuai Yang , Kang Xu , Qiaosheng Zhang , Peng Liu , Chenjia Bai

How can a reinforcement learning (RL) agent prepare to solve downstream tasks if those tasks are not known a priori? One approach is unsupervised skill discovery, a class of algorithms that learn a set of policies without access to a reward…

Machine Learning · Computer Science 2021-10-07 Benjamin Eysenbach , Ruslan Salakhutdinov , Sergey Levine

The expanding applications of legged robots require their mastery of versatile motion skills. Correspondingly, researchers must address the challenge of integrating multiple diverse motion skills into controllers. While existing…

Robotics · Computer Science 2024-08-07 Honghao Liao , Zhiheng Li , Ziyu Meng , Ran Song , Yibin Li , Wei Zhang

Learning a diverse set of skills by interacting with an environment without any external supervision is an important challenge. In particular, obtaining a goal-conditioned agent that can reach any given state is useful in many applications.…

Machine Learning · Computer Science 2022-06-24 Lina Mezghani , Sainbayar Sukhbaatar , Piotr Bojanowski , Karteek Alahari

Language-conditioned robot behavior plays a vital role in executing complex tasks by associating human commands or instructions with perception and actions. The ability to compose long-horizon tasks based on unconstrained language…

Robotics · Computer Science 2024-02-28 Zhaoxun Ju , Chao Yang , Hongbo Wang , Yu Qiao , Fuchun Sun

Learning diverse skills is one of the main challenges in robotics. To this end, imitation learning approaches have achieved impressive results. These methods require explicitly labeled datasets or assume consistent skill execution to enable…

Robotics · Computer Science 2023-02-14 Chenhao Li , Sebastian Blaes , Pavel Kolev , Marin Vlastelica , Jonas Frey , Georg Martius

Self-supervised skill learning aims to acquire useful behaviors that leverage the underlying dynamics of the environment. Latent variable models, based on mutual information maximization, have been successful in this task but still struggle…

Machine Learning · Computer Science 2024-03-22 David Emukpere , Bingbing Wu , Julien Perez , Jean-Michel Renders

Unsupervised skill learning aims to learn a rich repertoire of behaviors without external supervision, providing artificial agents with the ability to control and influence the environment. However, without appropriate knowledge and…

Artificial Intelligence · Computer Science 2024-01-22 Pietro Mazzaglia , Tim Verbelen , Bart Dhoedt , Alexandre Lacoste , Sai Rajeswar

Unsupervised reinforcement learning aims to acquire skills without prior goal representations, where an agent automatically explores an open-ended environment to represent goals and learn the goal-conditioned policy. However, this procedure…

Machine Learning · Computer Science 2021-10-27 Jinxin Liu , Hao Shen , Donglin Wang , Yachen Kang , Qiangxing Tian

Learning to control an environment without hand-crafted rewards or expert data remains challenging and is at the frontier of reinforcement learning research. We present an unsupervised learning algorithm to train agents to achieve…

Machine Learning · Computer Science 2018-11-29 David Warde-Farley , Tom Van de Wiele , Tejas Kulkarni , Catalin Ionescu , Steven Hansen , Volodymyr Mnih

To increase autonomy in reinforcement learning, agents need to learn useful behaviours without reliance on manually designed reward functions. To that end, skill discovery methods have been used to learn the intrinsic options available to…

Artificial Intelligence · Computer Science 2021-08-05 Even Klemsdal , Sverre Herland , Abdulmajid Murad

Knowledge discovery is key to understand and interpret a dataset, as well as to find the underlying relationships between its components. Unsupervised Cognition is a novel unsupervised learning algorithm that focus on modelling the learned…

Machine Learning · Computer Science 2025-01-29 Alfredo Ibias , Hector Antona , Guillem Ramirez-Miranda , Enric Guinovart

Unsupervised Reinforcement Learning (RL) provides a promising paradigm for learning useful behaviors via reward-free per-training. Existing methods for unsupervised RL mainly conduct empowerment-driven skill discovery or entropy-based…

Machine Learning · Computer Science 2024-05-28 Chenjia Bai , Rushuai Yang , Qiaosheng Zhang , Kang Xu , Yi Chen , Ting Xiao , Xuelong Li

Language-conditioned robotic skills make it possible to apply the high-level reasoning of Large Language Models (LLMs) to low-level robotic control. A remaining challenge is to acquire a diverse set of fundamental skills. Existing…

Robotics · Computer Science 2024-08-19 Xufeng Zhao , Cornelius Weber , Stefan Wermter