English
Related papers

Related papers: Hierarchical Planning Through Goal-Conditioned Off…

200 papers

Offline safe reinforcement learning (RL) has emerged as a promising approach for learning safe behaviors without engaging in risky online interactions with the environment. Most existing methods in offline safe RL rely on cost constraints…

Machine Learning · Computer Science 2025-04-22 Ze Gong , Akshat Kumar , Pradeep Varakantham

Conventional reinforcement learning (RL) needs an environment to collect fresh data, which is impractical when online interactions are costly. Offline RL provides an alternative solution by directly learning from the previously collected…

Machine Learning · Computer Science 2023-03-15 Han Zheng , Xufang Luo , Pengfei Wei , Xuan Song , Dongsheng Li , Jing Jiang

In this work, we propose a deep reinforcement learning (DRL) based reactive planner to solve large-scale Lidar-based autonomous robot exploration problems in 2D action space. Our DRL-based planner allows the agent to reactively plan its…

Robotics · Computer Science 2024-03-19 Yuhong Cao , Rui Zhao , Yizhuo Wang , Bairan Xiang , Guillaume Sartoretti

Developing agents that can execute multiple skills by learning from pre-collected datasets is an important problem in robotics, where online interaction with the environment is extremely time-consuming. Moreover, manually designing reward…

In safe offline reinforcement learning (RL), the objective is to develop a policy that maximizes cumulative rewards while strictly adhering to safety constraints, utilizing only offline data. Traditional methods often face difficulties in…

Machine Learning · Computer Science 2026-02-11 Prajwal Koirala , Zhanhong Jiang , Soumik Sarkar , Cody Fleming

Despite advances in hierarchical reinforcement learning, its applications to path planning in autonomous driving on highways are challenging. One reason is that conventional hierarchical reinforcement learning approaches are not amenable to…

Machine Learning · Computer Science 2021-11-11 Jaehyun Kim , Jaeseung Jeong

Offline learning is a key part of making reinforcement learning (RL) useable in real systems. Offline RL looks at scenarios where there is data from a system's operation, but no direct access to the system when learning a policy. Recent…

Machine Learning · Computer Science 2021-03-18 Arthur Argenson , Gabriel Dulac-Arnold

The combination of exponentially large action spaces, stochastic dynamics, and long-horizon decision-making under limited resources makes Sequential Stochastic Combinatorial Optimization (SSCO) particularly challenging for reinforcement…

Machine Learning · Computer Science 2026-05-19 Vivienne Huiling Wang , Tinghuai Wang , Joni Pajarinen

A large variety of real-world Reinforcement Learning (RL) tasks is characterized by a complex and heterogeneous structure that makes end-to-end (or flat) approaches hardly applicable or even infeasible. Hierarchical Reinforcement Learning…

Machine Learning · Computer Science 2023-05-12 Gianluca Drappo , Alberto Maria Metelli , Marcello Restelli

Reinforcement learning has been successful in many tasks ranging from robotic control, games, energy management etc. In complex real world environments with sparse rewards and long task horizons, sample efficiency is still a major…

Artificial Intelligence · Computer Science 2021-10-12 Bharat Prakash , Nicholas Waytowich , Tim Oates , Tinoosh Mohsenin

Safe navigation is essential for autonomous systems operating in hazardous environments. Traditional planning methods excel at long-horizon tasks but rely on a predefined graph with fixed distance metrics. In contrast, safe Reinforcement…

Robotics · Computer Science 2025-09-12 Meng Feng , Viraj Parimi , Brian Williams

Goal-conditioned hierarchical reinforcement learning (HRL) is a promising approach for scaling up reinforcement learning (RL) techniques. However, it often suffers from training inefficiency as the action space of the high-level, i.e., the…

Machine Learning · Computer Science 2021-03-19 Tianren Zhang , Shangqi Guo , Tian Tan , Xiaolin Hu , Feng Chen

In reinforcement learning, pre-trained low-level skills have the potential to greatly facilitate exploration. However, prior knowledge of the downstream task is required to strike the right balance between generality (fine-grained control)…

Machine Learning · Computer Science 2021-10-22 Jonas Gehring , Gabriel Synnaeve , Andreas Krause , Nicolas Usunier

We introduce an offline reinforcement learning (RL) algorithm that explicitly clones a behavior policy to constrain value learning. In offline RL, it is often important to prevent a policy from selecting unobserved actions, since the…

Machine Learning · Computer Science 2022-06-03 Wonjoon Goo , Scott Niekum

Reinforcement Learning (RL)-based motion planning has recently shown the potential to outperform traditional approaches from autonomous navigation to robot manipulation. In this work, we focus on a motion planning task for an evasive target…

Robotics · Computer Science 2025-05-12 Zixuan Wu , Sean Ye , Manisha Natarajan , Matthew C. Gombolay

Goal representation affects the performance of Hierarchical Reinforcement Learning (HRL) algorithms by decomposing the complex learning problem into easier subtasks. Recent studies show that representations that preserve temporally abstract…

Machine Learning · Computer Science 2024-12-24 Mehdi Zadem , Sergio Mover , Sao Mai Nguyen

Offline-to-online reinforcement learning (RL) leverages both pre-trained offline policies and online policies trained for downstream tasks, aiming to improve data efficiency and accelerate performance enhancement. An existing approach,…

Machine Learning · Computer Science 2024-11-01 JaeYoon Kim , Junyu Xuan , Christy Liang , Farookh Hussain

Open-domain dialog generation is a challenging problem; maximum likelihood training can lead to repetitive outputs, models have difficulty tracking long-term conversational goals, and training on standard movie or online datasets may lead…

Machine Learning · Computer Science 2020-01-03 Abdelrhman Saleh , Natasha Jaques , Asma Ghandeharioun , Judy Hanwen Shen , Rosalind Picard

Reinforcement Learning (RL) has made promising progress in planning and decision-making for Autonomous Vehicles (AVs) in simple driving scenarios. However, existing RL algorithms for AVs fail to learn critical driving skills in complex…

Robotics · Computer Science 2023-06-29 Xinyang Lu , Flint Xiaofeng Fan , Tianying Wang

Hierarchical reinforcement learning (HRL) addresses complex long-horizon tasks by skillfully decomposing them into subgoals. Therefore, the effectiveness of HRL is greatly influenced by subgoal reachability. Typical HRL methods only…

Machine Learning · Computer Science 2024-06-27 Yu Luo , Fuchun Sun , Tianying Ji , Xianyuan Zhan