English
Related papers

Related papers: Causality-driven Hierarchical Structure Discovery …

200 papers

Discovering causal structure among a set of variables is a fundamental problem in many empirical sciences. Traditional score-based casual discovery methods rely on various local heuristics to search for a Directed Acyclic Graph (DAG)…

Machine Learning · Computer Science 2020-06-09 Shengyu Zhu , Ignavier Ng , Zhitang Chen

Modern listwise recommendation systems need to consider both long-term user perceptions and short-term interest shifts. Reinforcement learning can be applied on recommendation to study such a problem but is also subject to large search…

Information Retrieval · Computer Science 2025-07-22 Luo Ji , Gao Liu , Mingyang Yin , Hongxia Yang , Jingren Zhou

Goal-conditioned hierarchical reinforcement learning (HRL) is a promising approach for scaling up reinforcement learning (RL) techniques. However, it often suffers from training inefficiency as the action space of the high-level, i.e., the…

Machine Learning · Computer Science 2021-03-19 Tianren Zhang , Shangqi Guo , Tian Tan , Xiaolin Hu , Feng Chen

Reinforcement Learning (RL) struggles in problems with delayed rewards, and one approach is to segment the task into sub-tasks with incremental rewards. We propose a framework called Hierarchical Inverse Reinforcement Learning (HIRL), which…

Robotics · Computer Science 2016-04-25 Sanjay Krishnan , Animesh Garg , Richard Liaw , Lauren Miller , Florian T. Pokorny , Ken Goldberg

Developing decision-making algorithms for highly automated driving systems remains challenging, since these systems have to operate safely in an open and complex environments. Reinforcement Learning (RL) approaches can learn comprehensive…

Robotics · Computer Science 2025-07-01 M. Youssef Abdelhamid , Lennart Vater , Zlatan Ajanovic

Recent advances in Reinforcement Learning (RL) combined with Deep Learning (DL) have demonstrated impressive performance in complex tasks, including autonomous driving. The use of RL agents in autonomous driving leads to a smooth human-like…

Artificial Intelligence · Computer Science 2021-07-30 Briti Gangopadhyay , Harshit Soora , Pallab Dasgupta

Decision-making in military aviation Prognostics and Health Management (PHM) faces significant challenges due to the "curse of dimensionality" in large-scale fleet operations, combined with sparse feedback and stochastic mission profiles.…

Machine Learning · Computer Science 2026-04-09 Yong Si , Mingfei Lu , Jing Li , Yang Hu , Guijiang Li , Yueheng Song , Zhaokui Wang

Navigating and understanding complex and unknown environments autonomously demands more than just basic perception and movement from embodied agents. Truly effective exploration requires agents to possess higher-level cognitive abilities,…

Artificial Intelligence · Computer Science 2025-09-12 Abdel Hakim Drid , Vincenzo Suriani , Daniele Nardi , Abderrezzak Debilou

Hierarchical Reinforcement Learning (HRL) has held longstanding promise to advance reinforcement learning. Yet, it has remained a considerable challenge to develop practical algorithms that exhibit some of these promises. To improve our…

Machine Learning · Computer Science 2022-03-08 Joery A. de Vries , Thomas M. Moerland , Aske Plaat

Reinforcement learning-based mapless navigation holds significant potential. However, it faces challenges in indoor environments with local minima area. This paper introduces a safe mapless navigation framework utilizing hierarchical…

Robotics · Computer Science 2025-03-18 Jianqi Gao , Xizheng Pang , Qi Liu , Yanjie Li

Safety in goal directed Reinforcement Learning (RL) settings has typically been handled through constraints over trajectories and have demonstrated good performance in primarily short horizon tasks. In this paper, we are specifically…

Artificial Intelligence · Computer Science 2024-01-10 Yuxiao Lu , Arunesh Sinha , Pradeep Varakantham

Hierarchical Reinforcement Learning (HRL) agents have the potential to demonstrate appealing capabilities such as planning and exploration with abstraction, transfer, and skill reuse. Recent successes with HRL across different domains…

Machine Learning · Computer Science 2023-03-01 Bernardo Avila Pires , Feryal Behbahani , Hubert Soyer , Kyriacos Nikiforou , Thomas Keck , Satinder Singh

Edge computing faces unprecedented resource orchestration challenges from multi-dimensional heterogeneity across device architectures, diverse task requirements in CPU-intensive, GPU-intensive, I/O-intensive, and dynamic network conditions.…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-12 Jianyong Zhu , Hao Chen , Juan Zhang , Fangda Guo , Albert Y. Zomaya , Renyu Yang

Hierarchical reinforcement learning (HRL) provides a promising solution for complex tasks with sparse rewards of intelligent agents, which uses a hierarchical framework that divides tasks into subgoals and completes them sequentially.…

Artificial Intelligence · Computer Science 2024-11-28 Xinglin Zhou , Yifu Yuan , Shaofu Yang , Jianye Hao

Reinforcement learning (RL) has achieved notable performance in high-dimensional sequential decision-making tasks, yet remains limited by low sample efficiency, sensitivity to noise, and weak generalization under partial observability. Most…

Machine Learning · Computer Science 2026-02-18 Sibo Zhang , Rui Jing , Liangfu Lv , Jian Zhang , Yunliang Zang

Teaching a deep reinforcement learning (RL) agent to follow instructions in multi-task environments is a challenging problem. We consider that user defines every task by a linear temporal logic (LTL) formula. However, some causal…

Robotics · Computer Science 2022-07-14 Duo Xu , Faramarz Fekri

Robotic systems are nowadays capable of solving complex navigation tasks. However, their capabilities are limited to the knowledge of the designer and consequently lack generalizability to initially unconsidered situations. This makes deep…

Robotics · Computer Science 2022-05-24 Christopher Gebauer , Nils Dengler , Maren Bennewitz

The options framework in Hierarchical Reinforcement Learning breaks down overall goals into a combination of options or simpler tasks and associated policies, allowing for abstraction in the action space. Ideally, these options can be…

Machine Learning · Computer Science 2022-06-14 Kushal Chauhan , Soumya Chatterjee , Akash Reddy , Balaraman Ravindran , Pradeep Shenoy

Hierarchical reinforcement learning (HRL) addresses complex long-horizon tasks by skillfully decomposing them into subgoals. Therefore, the effectiveness of HRL is greatly influenced by subgoal reachability. Typical HRL methods only…

Machine Learning · Computer Science 2024-06-27 Yu Luo , Fuchun Sun , Tianying Ji , Xianyuan Zhan

Crafting effective reward signals remains a central challenge in Reinforcement Learning (RL), especially for complex reasoning tasks. Existing automated reward optimization methods typically rely on derivative-free search heuristics that…

Artificial Intelligence · Computer Science 2026-05-14 Sitao Cheng , Tianle Li , Xuhan Huang , Xunjian Yin , Difan Zou