English
Related papers

Related papers: Hierarchical Decision Transformer

200 papers

Decision-making in military aviation Prognostics and Health Management (PHM) faces significant challenges due to the "curse of dimensionality" in large-scale fleet operations, combined with sparse feedback and stochastic mission profiles.…

Machine Learning · Computer Science 2026-04-09 Yong Si , Mingfei Lu , Jing Li , Yang Hu , Guijiang Li , Yueheng Song , Zhaokui Wang

Model-based planners and controllers are commonly used to solve complex manipulation problems as they can efficiently optimize diverse objectives and generalize to long horizon tasks. However, they often fail during deployment due to noisy…

Robotics · Computer Science 2025-03-10 Shivam Vats , Devesh K. Jha , Maxim Likhachev , Oliver Kroemer , Diego Romeres

Reinforcement learning (RL) algorithms assume that users specify tasks by manually writing down a reward function. However, this process can be laborious and demands considerable technical expertise. Can we devise RL algorithms that instead…

Machine Learning · Computer Science 2022-01-03 Benjamin Eysenbach , Sergey Levine , Ruslan Salakhutdinov

Complex, multi-task problems have proven to be difficult to solve efficiently in a sparse-reward reinforcement learning setting. In order to be sample efficient, multi-task learning requires reuse and sharing of low-level policies. To…

Machine Learning · Computer Science 2021-09-28 Valerie Chen , Abhinav Gupta , Kenneth Marino

General purpose agents will require large repertoires of skills. Empowerment -- the maximum mutual information between skills and states -- provides a pathway for learning large collections of distinct skills, but mutual information is…

Machine Learning · Computer Science 2023-10-05 Andrew Levy , Sreehari Rammohan , Alessandro Allievi , Scott Niekum , George Konidaris

Learning in high-dimensional action spaces is a key challenge in applying reinforcement learning (RL) to real-world systems. In this paper, we study the possibility of controlling power networks using RL methods. Power networks are critical…

Machine Learning · Computer Science 2023-11-07 Blazej Manczak , Jan Viebahn , Herke van Hoof

This paper focuses on task recognition and action segmentation in weakly-labeled instructional videos, where only the ordered sequence of video-level actions is available during training. We propose a two-stream framework, which exploits…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Reza Ghoddoosian , Saif Sayed , Vassilis Athitsos

Humans perceive the world as a series of sequential events, which can be hierarchically organized with different levels of abstraction based on conceptual knowledge. Drawing inspiration from human learning behaviors, this work proposes a…

Machine Learning · Computer Science 2025-03-11 Quyen Tran , Hoang Phan , Minh Le , Tuan Truong , Dinh Phung , Linh Ngo , Thien Nguyen , Nhat Ho , Trung Le

Model selection has been proven an effective strategy for improving accuracy in time series forecasting applications. However, when dealing with hierarchical time series, apart from selecting the most appropriate forecasting model,…

Machine Learning · Computer Science 2020-10-30 Mahdi Abolghasemi , Rob J Hyndman , Evangelos Spiliotis , Christoph Bergmeir

The empirical success of deep learning is often attributed to deep networks' ability to exploit hierarchical structure in data, constructing increasingly complex features across layers. Yet despite substantial progress in deep learning…

Machine Learning · Computer Science 2026-01-28 Yunwei Ren , Yatin Dandi , Florent Krzakala , Jason D. Lee

We propose a novel Reinforcement Learning model for discrete environments, which is inherently interpretable and supports the discovery of deep subgoal hierarchies. In the model, an agent learns information about environment in the form of…

Artificial Intelligence · Computer Science 2022-02-16 Alexander Demin , Denis Ponomaryov

This paper proposes a policy-based deep reinforcement learning hyper-heuristic framework for solving the Job Shop Scheduling Problem. The hyper-heuristic agent learns to switch scheduling rules based on the system state dynamically. We…

Artificial Intelligence · Computer Science 2026-01-19 Sofiene Lassoued , Asrat Gobachew , Stefan Lier , Andreas Schwung

Large language model (LLM)-based agents have shown strong potential in multi-task scenarios, owing to their ability to transfer knowledge across diverse tasks. However, existing approaches often treat prior experiences and knowledge as…

Artificial Intelligence · Computer Science 2025-09-17 Shicheng Ye , Chao Yu , Kaiqiang Ke , Chengdong Xu , Yinqi Wei

Real-world tasks are often highly structured. Hierarchical reinforcement learning (HRL) has attracted research interest as an approach for leveraging the hierarchical structure of a given task in reinforcement learning (RL). However,…

Machine Learning · Computer Science 2019-03-08 Takayuki Osa , Voot Tangkaratt , Masashi Sugiyama

In machine learning, meta-learning methods aim for fast adaptability to unknown tasks using prior knowledge. Model-based meta-reinforcement learning combines reinforcement learning via world models with Meta Reinforcement Learning (MRL) for…

Robotics · Computer Science 2022-10-10 Karam Daaboul , Joel Ikels , Marius Zöllner

Two common approaches to sequential decision-making are AI planning (AIP) and reinforcement learning (RL). Each has strengths and weaknesses. AIP is interpretable, easy to integrate with symbolic knowledge, and often efficient, but requires…

Artificial Intelligence · Computer Science 2022-09-30 Junkyu Lee , Michael Katz , Don Joven Agravante , Miao Liu , Geraud Nangue Tasse , Tim Klinger , Shirin Sohrabi

Imitation learning has achieved great success in many sequential decision-making tasks, in which a neural agent is learned by imitating collected human demonstrations. However, existing algorithms typically require a large number of…

Machine Learning · Computer Science 2023-06-14 Tianxiang Zhao , Wenchao Yu , Suhang Wang , Lu Wang , Xiang Zhang , Yuncong Chen , Yanchi Liu , Wei Cheng , Haifeng Chen

To make good decisions in the real world people need efficient planning strategies because their computational resources are limited. Knowing which planning strategies would work best for people in different situations would be very useful…

Artificial Intelligence · Computer Science 2021-02-02 Saksham Consul , Lovis Heindrich , Jugoslav Stojcheski , Falk Lieder

Reinforcement learning (RL), a common tool in decision making, learns control policies from various experiences based on the associated cumulative return/rewards without treating them differently. Humans, on the contrary, often learn to…

Machine Learning · Computer Science 2025-11-25 Mingkang Wu , Devin White , Vernon Lawhern , Nicholas R. Waytowich , Yongcan Cao

Demonstration-guided reinforcement learning (RL) is a promising approach for learning complex behaviors by leveraging both reward feedback and a set of target task demonstrations. Prior approaches for demonstration-guided RL treat every new…

Machine Learning · Computer Science 2021-07-22 Karl Pertsch , Youngwoon Lee , Yue Wu , Joseph J. Lim