中文
相关论文

相关论文: Unsupervised Hierarchical Skill Discovery

200 篇论文

Humans can leverage hierarchical structures to split a task into sub-tasks and solve problems efficiently. Both imitation and reinforcement learning or a combination of them with hierarchical structures have been proven to be an efficient…

机器人学 · 计算机科学 2020-12-15 Yaru Niu , Yijun Gu

Deep reinforcement learning has achieved many impressive results in recent years. However, tasks with sparse rewards or long horizons continue to pose significant challenges. To tackle these important problems, we propose a general…

人工智能 · 计算机科学 2017-04-12 Carlos Florensa , Yan Duan , Pieter Abbeel

In principle, meta-reinforcement learning algorithms leverage experience across many tasks to learn fast reinforcement learning (RL) strategies that transfer to similar tasks. However, current meta-RL approaches rely on manually-defined…

人工智能 · 计算机科学 2019-12-10 Allan Jabri , Kyle Hsu , Ben Eysenbach , Abhishek Gupta , Sergey Levine , Chelsea Finn

While existing hierarchical text classification (HTC) methods attempt to capture label hierarchies for model training, they either make local decisions regarding each label or completely ignore the hierarchy information during inference. To…

信息检索 · 计算机科学 2020-06-19 Yuning Mao , Jingjing Tian , Jiawei Han , Xiang Ren

Reward-free, unsupervised discovery of skills is an attractive alternative to the bottleneck of hand-designing rewards in environments where task supervision is scarce or expensive. However, current skill pre-training methods, like many RL…

机器学习 · 计算机科学 2022-03-22 Nur Muhammad Shafiullah , Lerrel Pinto

Hierarchical reinforcement learning has demonstrated significant success at solving difficult reinforcement learning (RL) tasks. Previous works have motivated the use of hierarchy by appealing to a number of intuitive benefits, including…

机器学习 · 计算机科学 2020-01-01 Ofir Nachum , Haoran Tang , Xingyu Lu , Shixiang Gu , Honglak Lee , Sergey Levine

Hierarchical Reinforcement Learning (HRL) is a promising approach to solving long-horizon problems with sparse and delayed rewards. Many existing HRL algorithms either use pre-trained low-level skills that are unadaptable, or require…

机器学习 · 计算机科学 2019-10-11 Siyuan Li , Rui Wang , Minxue Tang , Chongjie Zhang

Sparse-reward domains are challenging for reinforcement learning algorithms since significant exploration is needed before encountering reward for the first time. Hierarchical reinforcement learning can facilitate exploration by reducing…

机器学习 · 计算机科学 2020-11-13 Lorenzo Steccanella , Simone Totaro , Damien Allonsius , Anders Jonsson

Decision-making in complex, continuous multi-task environments is often hindered by the difficulty of obtaining accurate models for planning and the inefficiency of learning purely from trial and error. While precise environment dynamics…

机器学习 · 计算机科学 2025-03-20 Jeff Jewett , Sandhya Saisubramanian

We present an algorithm for skill discovery from expert demonstrations. The algorithm first utilizes Large Language Models (LLMs) to propose an initial segmentation of the trajectories. Following that, a hierarchical variational inference…

Semi-supervised learning approaches have emerged as an active area of research to combat the challenge of obtaining large amounts of annotated data. Towards the goal of improving the performance of semi-supervised learning methods, we…

计算机视觉与模式识别 · 计算机科学 2021-12-22 Ashima Garg , Shaurya Bagga , Yashvardhan Singh , Saket Anand

Unsupervised skill discovery aims to learn diverse and distinguishable behaviors in open-ended reinforcement learning. For existing methods, they focus on improving diversity through pure exploration, mutual information optimization, and…

机器学习 · 计算机科学 2025-06-27 He Zhang , Ming Zhou , Shaopeng Zhai , Ying Sun , Hui Xiong

For robotic vehicles to navigate robustly and safely in unseen environments, it is crucial to decide the most suitable navigation policy. However, most existing deep reinforcement learning based navigation policies are trained with a…

机器人学 · 计算机科学 2023-10-31 Kyowoon Lee , Seongun Kim , Jaesik Choi

This paper introduces an automated skill acquisition framework in reinforcement learning which involves identifying a hierarchical description of the given task in terms of abstract states and extended actions between abstract states.…

机器学习 · 计算机科学 2020-09-23 Aravind Srinivas , Ramnandan Krishnamurthy , Peeyush Kumar , Balaraman Ravindran

We study building multi-task agents in open-world environments. Without human demonstrations, learning to accomplish long-horizon tasks in a large open-world environment with reinforcement learning (RL) is extremely inefficient. To tackle…

机器学习 · 计算机科学 2023-12-05 Haoqi Yuan , Chi Zhang , Hongcheng Wang , Feiyang Xie , Penglin Cai , Hao Dong , Zongqing Lu

Existing Masked Image Modeling methods apply fixed mask patterns to guide the self-supervised training. As those mask patterns resort to different criteria to depict image contents, sticking to a fixed pattern leads to a limited vision cues…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Zhanzhou Feng , Shiliang Zhang

Deploying deep neural networks for risk-sensitive tasks necessitates an uncertainty estimation mechanism. This paper introduces hierarchical selective classification, extending selective classification to a hierarchical setting. Our…

机器学习 · 计算机科学 2025-01-07 Shani Goren , Ido Galil , Ran El-Yaniv

This paper proposes a classification framework aimed at identifying correlations between job ad requirements and transversal skill sets, with a focus on predicting the necessary skills for individual job descriptions using a deep learning…

机器学习 · 计算机科学 2024-03-12 Florin Leon , Marius Gavrilescu , Sabina-Adriana Floria , Alina-Adriana Minea

Reinforcement learning (RL), while often powerful, can suffer from slow learning speeds, particularly in high dimensional spaces. The autonomous decomposition of tasks and use of hierarchical methods hold the potential to significantly…

人工智能 · 计算机科学 2017-09-18 Behzad Ghazanfari , Matthew E. Taylor

The empirical success of deep learning is often attributed to deep networks' ability to exploit hierarchical structure in data, constructing increasingly complex features across layers. Yet despite substantial progress in deep learning…

机器学习 · 计算机科学 2026-01-28 Yunwei Ren , Yatin Dandi , Florent Krzakala , Jason D. Lee