English
Related papers

Related papers: DHP: Discrete Hierarchical Planning for Hierarchic…

200 papers

Decision-making in complex, continuous multi-task environments is often hindered by the difficulty of obtaining accurate models for planning and the inefficiency of learning purely from trial and error. While precise environment dynamics…

Machine Learning · Computer Science 2025-03-20 Jeff Jewett , Sandhya Saisubramanian

Deep reinforcement learning (DRL) has gained great success by learning directly from high-dimensional sensory inputs, yet is notorious for the lack of interpretability. Interpretability of the subtasks is critical in hierarchical…

Artificial Intelligence · Computer Science 2019-03-01 Daoming Lyu , Fangkai Yang , Bo Liu , Steven Gustafson

Penetration testing the organised attack of a computer system in order to test existing defences has been used extensively to evaluate network security. This is a time consuming process and requires in-depth knowledge for the establishment…

Artificial Intelligence · Computer Science 2021-09-15 Khuong Tran , Ashlesha Akella , Maxwell Standen , Junae Kim , David Bowman , Toby Richer , Chin-Teng Lin

Hierarchical Reinforcement Learning (HRL) has held longstanding promise to advance reinforcement learning. Yet, it has remained a considerable challenge to develop practical algorithms that exhibit some of these promises. To improve our…

Machine Learning · Computer Science 2022-03-08 Joery A. de Vries , Thomas M. Moerland , Aske Plaat

Large language model (LLM)-based agents have demonstrated remarkable capabilities in decision-making tasks, but struggle significantly with complex, long-horizon planning scenarios. This arises from their lack of macroscopic guidance,…

Computation and Language · Computer Science 2025-08-27 Ziyue Li , Yuan Chang , Gaihong Yu , Xiaoqiu Le

Large language models often struggle with complex long-horizon analytical tasks over unstructured tables, which typically feature hierarchical and bidirectional headers and non-canonical layouts. We formalize this challenge as Deep Tabular…

Artificial Intelligence · Computer Science 2026-03-13 Junnan Dong , Chuang Zhou , Zheng Yuan , Yifei Yu , Qiufeng Wang , Yinghui Li , Siyu An , Di Yin , Xing Sun , Feiyue Huang

Route planning is important in transportation. Existing works focus on finding the shortest path solution or using metrics such as safety and energy consumption to determine the planning. It is noted that most of these studies rely on prior…

Machine Learning · Computer Science 2020-11-06 Yuanzhe Geng , Erwu Liu , Rui Wang , Yiming Liu

With the growth of Renewable Energy (RE) generation, the operation of power grids has become increasingly complex. One solution could be automated grid operation, where Deep Reinforcement Learning (DRL) has repeatedly shown significant…

Machine Learning · Computer Science 2024-09-18 Malte Lehna , Clara Holzhüter , Sven Tomforde , Christoph Scholz

Object packing by autonomous robots is an im-portant challenge in warehouses and logistics industry. Most conventional data-driven packing planning approaches focus on regular cuboid packing, which are usually heuristic and limit the…

Robotics · Computer Science 2022-11-18 Sichao Huang , Ziwei Wang , Jie Zhou , Jiwen Lu

Hierarchical reinforcement learning (HRL) incorporates temporal abstraction into reinforcement learning (RL) by explicitly taking advantage of hierarchical structure. Modern HRL typically designs a hierarchical agent composed of a…

Machine Learning · Computer Science 2024-01-24 Sang-Hyun Lee , Yoonjae Jung , Seung-Woo Seo

Recently, large reasoning models have demonstrated strong mathematical and coding abilities, and deep search leverages their reasoning capabilities in challenging information retrieval tasks. Existing deep search works are generally limited…

Information Retrieval · Computer Science 2025-08-12 Jiejun Tan , Zhicheng Dou , Yan Yu , Jiehan Cheng , Qiang Ju , Jian Xie , Ji-Rong Wen

Developing agents capable of exploring, planning and learning in complex open-ended environments is a grand challenge in artificial intelligence (AI). Hierarchical reinforcement learning (HRL) offers a promising solution to this challenge…

Artificial Intelligence · Computer Science 2025-06-18 Martin Klissarov , Akhil Bagaria , Ziyan Luo , George Konidaris , Doina Precup , Marlos C. Machado

Metaheuristic search methods have proven to be essential tools for tackling complex optimization challenges, but their full potential is often constrained by conventional algorithmic frameworks. In this paper, we introduce a novel approach…

Artificial Intelligence · Computer Science 2024-10-23 Abdel-Rahman Hedar , Alaa E. Abdel-Hakim , Wael Deabes , Youseef Alotaibi , Kheir Eddine Bouazza

Despite of achieving great success in real-world applications, Deep Reinforcement Learning (DRL) is still suffering from three critical issues, i.e., data efficiency, lack of the interpretability and transferability. Recent research shows…

Artificial Intelligence · Computer Science 2023-07-10 Hankz Hankui Zhuo , Shuting Deng , Mu Jin , Zhihao Ma , Kebing Jin , Chen Chen , Chao Yu

Effective agent exploration remains a core challenge in reinforcement learning (RL) for complex discrete state-space environments, particularly under partial observability. This paper presents a decoupled hierarchical RL framework…

Machine Learning · Computer Science 2025-06-04 Qingyu Xiao , Yuanlin Chang , Youtian Du

Recent advancements have significantly enhanced the performance of large language models (LLMs) in tackling complex reasoning tasks, achieving notable success in domains like mathematical and logical reasoning. However, these methods…

Artificial Intelligence · Computer Science 2025-05-30 Runquan Gui , Zhihai Wang , Jie Wang , Chi Ma , Huiling Zhen , Mingxuan Yuan , Jianye Hao , Defu Lian , Enhong Chen , Feng Wu

Explicit planning is a critical capability for LLM-based agents solving complex data-centric tasks, which require precise tool calling over external data sources. Existing strategies fall into two paradigms based on planning horizon: (1)…

Computation and Language · Computer Science 2026-05-12 Naoki Otani , Nikita Bhutani , Hannah Kim , Dan Zhang , Estevam Hruschka

Reinforcement learning has been successful in many tasks ranging from robotic control, games, energy management etc. In complex real world environments with sparse rewards and long task horizons, sample efficiency is still a major…

Artificial Intelligence · Computer Science 2021-10-12 Bharat Prakash , Nicholas Waytowich , Tim Oates , Tinoosh Mohsenin

Deep reinforcement learning (DRL) has achieved remarkable success in various research domains. However, its reliance on neural networks results in a lack of transparency, which limits its practical applications. To achieve explainability,…

Machine Learning · Computer Science 2026-05-25 Yongyan Wen , Siyuan Li , Rongchang Zuo , Lei Yuan , Hangyu Mao , Peng Liu

Long-horizon routing tasks of deformable linear objects (DLOs), such as cables and ropes, are common in industrial assembly lines and everyday life. These tasks are particularly challenging because they require robots to manipulate DLO with…

Robotics · Computer Science 2026-04-16 Mingen Li , Houjian Yu , Yixuan Huang , Youngjin Hong , Hantao Ye , Changhyun Choi