English
Related papers

Related papers: Periodic Skill Discovery

200 papers

Learning skills that interact with objects is of major importance for robotic manipulation. These skills can indeed serve as an efficient prior for solving various manipulation tasks. We propose a novel Skill Learning approach that…

Robotics · Computer Science 2024-10-08 Paul Jansonnie , Bingbing Wu , Julien Perez , Jan Peters

Reinforcement learning (RL) algorithms allow artificial agents to improve their selection of actions to increase rewarding experiences in their environments. Temporal Difference (TD) Learning -- a model-free RL method -- is a leading…

Machine Learning · Computer Science 2019-09-05 Jacob Rafati , David C. Noelle

Multi-agent collaboration, especially in human-AI teaming, requires agents that can adapt to novel partners with diverse and dynamic behaviors. Conventional Deep Hierarchical Reinforcement Learning (DHRL) methods focus on agent-centric…

Artificial Intelligence · Computer Science 2026-05-26 Adnan Ahmad , Bahareh Nakisa , Mohammad Naim Rastgoo

Conventionally, model-based reinforcement learning (MBRL) aims to learn a global model for the dynamics of the environment. A good model can potentially enable planning algorithms to generate a large variety of behaviors and solve diverse…

Machine Learning · Computer Science 2020-02-18 Archit Sharma , Shixiang Gu , Sergey Levine , Vikash Kumar , Karol Hausman

Unsupervised learning methods have recently shown their competitiveness against supervised training. Typically, these methods use a single objective to train the entire network. But one distinct advantage of unsupervised over supervised…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Zefan Li , Chenxi Liu , Alan Yuille , Bingbing Ni , Wenjun Zhang , Wen Gao

Reinforcement learning necessitates meticulous reward shaping by specialists to elicit target behaviors, while imitation learning relies on costly task-specific data. In contrast, unsupervised skill discovery can potentially reduce these…

Robotics · Computer Science 2026-02-11 Ruopeng Cui , Yifei Bi , Haojie Luo , Wei Li

Deep reinforcement learning has demonstrated remarkable achievements across diverse domains such as video games, robotic control, autonomous driving, and drug discovery. Common methodologies in partially-observable domains largely lean on…

Machine Learning · Computer Science 2024-02-15 Michael Lanier , Ying Xu , Nathan Jacobs , Chongjie Zhang , Yevgeniy Vorobeychik

Reinforcement learning requires manual specification of a reward function to learn a task. While in principle this reward function only needs to specify the task goal, in practice reinforcement learning can be very time-consuming or even…

Machine Learning · Computer Science 2020-02-17 Kristian Hartikainen , Xinyang Geng , Tuomas Haarnoja , Sergey Levine

To increase autonomy in reinforcement learning, agents need to learn useful behaviours without reliance on manually designed reward functions. To that end, skill discovery methods have been used to learn the intrinsic options available to…

Artificial Intelligence · Computer Science 2021-08-05 Even Klemsdal , Sverre Herland , Abdulmajid Murad

Key challenges for the deployment of reinforcement learning (RL) agents in the real world are the discovery, representation and reuse of skills in the absence of a reward function. To this end, we propose a novel approach to learn a…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Oier Mees , Markus Merklinger , Gabriel Kalweit , Wolfram Burgard

Unsupervised skill discovery aims to learn diverse and distinguishable behaviors in open-ended reinforcement learning. For existing methods, they focus on improving diversity through pure exploration, mutual information optimization, and…

Machine Learning · Computer Science 2025-06-27 He Zhang , Ming Zhou , Shaopeng Zhai , Ying Sun , Hui Xiong

The objective of lifelong reinforcement learning (RL) is to optimize agents which can continuously adapt and interact in changing environments. However, current RL approaches fail drastically when environments are non-stationary and…

Machine Learning · Computer Science 2021-06-17 Kevin Lu , Aditya Grover , Pieter Abbeel , Igor Mordatch

In the context of safe exploration, Reinforcement Learning (RL) has long grappled with the challenges of balancing the tradeoff between maximizing rewards and minimizing safety violations, particularly in complex environments with…

Machine Learning · Computer Science 2023-12-13 Simon Sinong Zhan , Yixuan Wang , Qingyuan Wu , Ruochen Jiao , Chao Huang , Qi Zhu

Unsupervised skill discovery in reinforcement learning aims to intrinsically motivate agents to discover diverse and useful behaviours. However, unconstrained approaches can produce unsafe, unethical, or misaligned behaviours. To mitigate…

Machine Learning · Computer Science 2026-04-28 Maxence Hussonnois , Thommen George Karimpanal , Santu Rana

Unsupervised Skill Discovery (USD) aims to autonomously learn a diverse set of skills without relying on extrinsic rewards. One of the most common USD approaches is to maximize the Mutual Information (MI) between skill latent variables and…

Machine Learning · Computer Science 2026-02-03 Seyed Mohammad Hadi Hosseini , Mahdieh Soleymani Baghshah

Scaling unsupervised skill discovery algorithms to high-DoF agents remains challenging. As dimensionality increases, the exploration space grows exponentially, while the manifold of meaningful skills remains limited. Therefore, semantic…

Machine Learning · Computer Science 2026-03-03 Seungeun Rho , Aaron Trinh , Danfei Xu , Sehoon Ha

Personal robots assisting humans must perform complex manipulation tasks that are typically difficult to specify in traditional motion planning pipelines, where multiple objectives must be met and the high-level context be taken into…

Robotics · Computer Science 2019-03-21 Hejia Zhang , Eric Heiden , Stefanos Nikolaidis , Joseph J. Lim , Gaurav S. Sukhatme

Mastering robotic manipulation skills through reinforcement learning (RL) typically requires the design of shaped reward functions. Recent developments in this area have demonstrated that using sparse rewards, i.e. rewarding the agent only…

Machine Learning · Computer Science 2021-11-12 Ozsel Kilinc , Giovanni Montana

Deep Reinforcement Learning (RL) has emerged as a powerful paradigm for training neural policies to solve complex control tasks. However, these policies tend to be overfit to the exact specifications of the task and environment they were…

Neural and Evolutionary Computing · Computer Science 2023-09-11 Felix Chalumeau , Raphael Boige , Bryan Lim , Valentin Macé , Maxime Allard , Arthur Flajolet , Antoine Cully , Thomas Pierrot

With the rise of deep reinforcement learning (RL) methods, many complex robotic manipulation tasks are being solved. However, harnessing the full power of deep learning requires large datasets. Online-RL does not suit itself readily into…

Robotics · Computer Science 2024-11-20 Sudhir Pratap Yadav , Rajendra Nagar , Suril V. Shah