English
Related papers

Related papers: Hieros: Hierarchical Imagination on Structured Sta…

200 papers

Learned world models summarize an agent's experience to facilitate learning complex behaviors. While learning world models from high-dimensional sensory inputs is becoming feasible through deep learning, there are many potential ways for…

Machine Learning · Computer Science 2020-03-18 Danijar Hafner , Timothy Lillicrap , Jimmy Ba , Mohammad Norouzi

Rapid sampling from the environment to acquire available frontier points and timely incorporating them into subsequent planning to reduce fragmented regions are critical to improve the efficiency of autonomous exploration. We propose HPHS,…

Robotics · Computer Science 2024-07-22 Shijun Long , Ying Li , Chenming Wu , Bin Xu , Wei Fan

Learning control policies with large discrete action spaces is a challenging problem in the field of reinforcement learning due to present inefficiencies in exploration. With high dimensional action spaces, there are a large number of…

Machine Learning · Computer Science 2023-03-02 Keqin Wang , Alison Bartsch , Amir Barati Farimani

An open problem in artificial intelligence is how systems can flexibly learn discrete abstractions that are useful for solving inherently continuous problems. Previous work in computational neuroscience has considered this functional…

Artificial Intelligence · Computer Science 2024-09-04 Poppy Collis , Ryan Singh , Paul F Kinghorn , Christopher L Buckley

Deep reinforcement learning has over the past few years shown great potential in learning near-optimal control in complex simulated environments with little visible information. Rainbow (Q-Learning) and PPO (Policy Optimisation) have shown…

Artificial Intelligence · Computer Science 2019-07-30 Per-Arne Andersen , Morten Goodwin , Ole-Christoffer Granmo

Many real-world domains are subject to a structured non-stationarity which affects the agent's goals and the environmental dynamics. Meta-reinforcement learning (RL) has been shown successful for training agents that quickly adapt to…

Machine Learning · Computer Science 2021-05-20 Riccardo Poiani , Andrea Tirinzoni , Marcello Restelli

Multivariate time series forecasting with hierarchical structure is widely used in real-world applications, e.g., sales predictions for the geographical hierarchy formed by cities, states, and countries. The hierarchical time series (HTS)…

Machine Learning · Computer Science 2023-10-10 Fan Zhou , Chen Pan , Lintao Ma , Yu Liu , Shiyu Wang , James Zhang , Xinxin Zhu , Xuanwei Hu , Yunhua Hu , Yangfei Zheng , Lei Lei , Yun Hu

Deep reinforcement learning (DRL) is a promising way to achieve human-like autonomous driving. However, the low sample efficiency and difficulty of designing reward functions for DRL would hinder its applications in practice. In light of…

Robotics · Computer Science 2021-10-29 Zhiyu Huang , Jingda Wu , Chen Lv

In the realm of human mobility, the decision-making process for selecting the next-visit location is intricately influenced by a trade-off between spatial and temporal constraints, which are reflective of individual needs and preferences.…

Artificial Intelligence · Computer Science 2023-12-27 Zhaofan Zhang , Yanan Xiao , Lu Jiang , Dingqi Yang , Minghao Yin , Pengyang Wang

Deep reinforcement learning (DRL) algorithms and evolution strategies (ES) have been applied to various tasks, showing excellent performances. These have the opposite properties, with DRL having good sample efficiency and poor stability,…

Machine Learning · Computer Science 2021-04-06 Kyunghyun Lee , Byeong-Uk Lee , Ukcheol Shin , In So Kweon

This work pushes the boundaries of learning-based methods in autonomous robot exploration in terms of environmental scale and exploration efficiency. We present HEADER, an attention-based reinforcement learning approach with hierarchical…

Robotics · Computer Science 2025-10-20 Yuhong Cao , Yizhuo Wang , Jingsong Liang , Shuhao Liao , Yifeng Zhang , Peizhuo Li , Guillaume Sartoretti

Online inference is becoming a key service product for many businesses, deployed in cloud platforms to meet customer demands. Despite their revenue-generation capability, these services need to operate under tight Quality-of-Service (QoS)…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-04 Baolin Li , Siddharth Samsi , Vijay Gadepally , Devesh Tiwari

Deep reinforcement learning has proven to be a great success in allowing agents to learn complex tasks. However, its application to actual robots can be prohibitively expensive. Furthermore, the unpredictability of human behavior in…

Robotics · Computer Science 2019-08-16 Mohammad Thabet , Massimiliano Patacchiola , Angelo Cangelosi

Top-performing Model-Based Reinforcement Learning (MBRL) agents, such as Dreamer, learn the world model by reconstructing the image observations. Hence, they often fail to discard task-irrelevant details and struggle to handle visual…

Machine Learning · Computer Science 2021-10-28 Fei Deng , Ingook Jang , Sungjin Ahn

It has been a challenge to learning skills for an agent from long-horizon unannotated demonstrations. Existing approaches like Hierarchical Imitation Learning(HIL) are prone to compounding errors or suboptimal solutions. In this paper, we…

Machine Learning · Computer Science 2021-06-14 Mingxuan Jing , Wenbing Huang , Fuchun Sun , Xiaojian Ma , Tao Kong , Chuang Gan , Lei Li

We describe a method to use discrete human feedback to enhance the performance of deep learning agents in virtual three-dimensional environments by extending deep-reinforcement learning to model the confidence and consistency of human…

Artificial Intelligence · Computer Science 2021-06-24 Zhiyu Lin , Brent Harrison , Aaron Keech , Mark O. Riedl

We propose a hierarchical reinforcement learning method, HIDIO, that can learn task-agnostic options in a self-supervised manner while jointly learning to utilize them to solve sparse-reward tasks. Unlike current hierarchical RL approaches…

Machine Learning · Computer Science 2022-08-10 Jesse Zhang , Haonan Yu , Wei Xu

Hierarchical reinforcement learning is a promising approach to tackle long-horizon decision-making problems with sparse rewards. Unfortunately, most methods still decouple the lower-level skill acquisition process and the training of a…

Machine Learning · Computer Science 2020-05-15 Alexander C. Li , Carlos Florensa , Ignasi Clavera , Pieter Abbeel

In the training process of Deep Reinforcement Learning (DRL), agents require repetitive interactions with the environment. With an increase in training volume and model complexity, it is still a challenging problem to enhance data…

Machine Learning · Computer Science 2024-05-15 Jingwen Wang , Dehui Du , Yida Li , Yiyang Li , Yikang Chen

Intelligent agents need to generalize from past experience to achieve goals in complex environments. World models facilitate such generalization and allow learning behaviors from imagined outcomes to increase sample-efficiency. While…

Machine Learning · Computer Science 2022-02-15 Danijar Hafner , Timothy Lillicrap , Mohammad Norouzi , Jimmy Ba