English
Related papers

Related papers: Lipschitz-constrained Unsupervised Skill Discovery

200 papers

This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible. Unsupervised skill discovery seeks to acquire different useful skills…

Machine Learning · Computer Science 2025-02-25 Xin Liu , Yaran Chen , Dongbin Zhao

In reinforcement learning, unsupervised skill discovery aims to learn diverse skills without extrinsic rewards. Previous methods discover skills by maximizing the mutual information (MI) between states and skills. However, such an MI…

Machine Learning · Computer Science 2023-05-09 Rushuai Yang , Chenjia Bai , Hongyi Guo , Siyuan Li , Bin Zhao , Zhen Wang , Peng Liu , Xuelong Li

Unsupervised skill discovery carries the promise that an intelligent agent can learn reusable skills through autonomous, reward-free environment interaction. Existing unsupervised skill discovery methods learn skills by encouraging…

Machine Learning · Computer Science 2024-10-25 Zizhao Wang , Jiaheng Hu , Caleb Chuck , Stephen Chen , Roberto Martín-Martín , Amy Zhang , Scott Niekum , Peter Stone

Skill discovery methods enable agents to learn diverse emergent behaviors without explicit rewards. To make learned skills useful for unknown downstream tasks, obtaining a semantically diverse repertoire of skills is essential. While some…

Computation and Language · Computer Science 2025-03-04 Seungeun Rho , Laura Smith , Tianyu Li , Sergey Levine , Xue Bin Peng , Sehoon Ha

Unsupervised skill discovery in reinforcement learning (RL) aims to learn diverse behaviors without relying on external rewards. However, current methods often overlook the periodic nature of learned skills, focusing instead on increasing…

Machine Learning · Computer Science 2025-12-01 Jonghae Park , Daesol Cho , Jusuk Lee , Dongseok Shim , Inkyu Jang , H. Jin Kim

One of the key capabilities of intelligent agents is the ability to discover useful skills without external supervision. However, the current unsupervised skill discovery methods are often limited to acquiring simple, easy-to-learn skills…

Robotics · Computer Science 2023-06-06 Seohong Park , Kimin Lee , Youngwoon Lee , Pieter Abbeel

Unsupervised skill discovery drives intelligent agents to explore the unknown environment without task-specific reward signal, and the agents acquire various skills which may be useful when the agents adapt to new tasks. In this paper, we…

Multiagent Systems · Computer Science 2020-06-09 Shuncheng He , Jianzhun Shao , Xiangyang Ji

Unsupervised Reinforcement Learning (RL) aims to discover diverse behaviors that can accelerate the learning of downstream tasks. Previous methods typically focus on entropy-based exploration or empowerment-driven skill learning. However,…

Machine Learning · Computer Science 2025-06-18 Ting Xiao , Jiakun Zheng , Rushuai Yang , Kang Xu , Qiaosheng Zhang , Peng Liu , Chenjia Bai

Unsupervised Skill Discovery (USD) aims to autonomously learn a diverse set of skills without relying on extrinsic rewards. One of the most common USD approaches is to maximize the Mutual Information (MI) between skill latent variables and…

Machine Learning · Computer Science 2026-02-03 Seyed Mohammad Hadi Hosseini , Mahdieh Soleymani Baghshah

Representation learning and unsupervised skill discovery can allow robots to acquire diverse and reusable behaviors without the need for task-specific rewards. In this work, we use unsupervised reinforcement learning to learn a latent…

Skills are essential for unlocking higher levels of problem solving. A common approach to discovering these skills is to learn ones that reliably reach different states, thus empowering the agent to control its environment. However,…

Machine Learning · Computer Science 2025-10-07 Jonathan Colaço Carr , Qinyi Sun , Cameron Allen

Unsupervised skill discovery aims to acquire behavior primitives that improve exploration and accelerate downstream task learning. However, existing approaches often ignore the geometric symmetries of physical environments, leading to…

Robotics · Computer Science 2026-01-21 Junwoo Chang , Joseph Park , Roberto Horowitz , Jongmin Lee , Jongeun Choi

The learning efficiency and generalization ability of an intelligent agent can be greatly improved by utilizing a useful set of skills. However, the design of robot skills can often be intractable in real-world applications due to the…

Robotics · Computer Science 2021-06-29 Kuan Fang , Yuke Zhu , Silvio Savarese , Li Fei-Fei

How can a reinforcement learning (RL) agent prepare to solve downstream tasks if those tasks are not known a priori? One approach is unsupervised skill discovery, a class of algorithms that learn a set of policies without access to a reward…

Machine Learning · Computer Science 2021-10-07 Benjamin Eysenbach , Ruslan Salakhutdinov , Sergey Levine

Self-supervised skill learning aims to acquire useful behaviors that leverage the underlying dynamics of the environment. Latent variable models, based on mutual information maximization, have been successful in this task but still struggle…

Machine Learning · Computer Science 2024-03-22 David Emukpere , Bingbing Wu , Julien Perez , Jean-Michel Renders

Learning meaningful behaviors in the absence of reward is a difficult problem in reinforcement learning. A desirable and challenging unsupervised objective is to learn a set of diverse skills that provide a thorough coverage of the state…

Machine Learning · Computer Science 2022-05-03 Pierre-Alexandre Kamienny , Jean Tarbouriech , Sylvain Lamprier , Alessandro Lazaric , Ludovic Denoyer

Unsupervised skill discovery aims to learn diverse and distinguishable behaviors in open-ended reinforcement learning. For existing methods, they focus on improving diversity through pure exploration, mutual information optimization, and…

Machine Learning · Computer Science 2025-06-27 He Zhang , Ming Zhou , Shaopeng Zhai , Ying Sun , Hui Xiong

A hallmark of intelligent agents is the ability to learn reusable skills purely from unsupervised interaction with the environment. However, existing unsupervised skill discovery methods often learn entangled skills where one skill variable…

Machine Learning · Computer Science 2024-10-16 Jiaheng Hu , Zizhao Wang , Peter Stone , Roberto Martín-Martín

Pre-training Reinforcement Learning agents in a task-agnostic manner has shown promising results. However, previous works still struggle in learning and discovering meaningful skills in high-dimensional state-spaces, such as pixel-spaces.…

Artificial Intelligence · Computer Science 2021-07-20 Juan José Nieto , Roger Creus , Xavier Giro-i-Nieto

Recently, methods for learning diverse skills to generate various behaviors without external rewards have been actively studied as a form of unsupervised reinforcement learning. However, most of the existing methods learn a finite number of…

Machine Learning · Computer Science 2023-05-26 Takahisa Imagawa , Takuya Hiraoka , Yoshimasa Tsuruoka
‹ Prev 1 2 3 10 Next ›