English
Related papers

Related papers: A Novel Multi-Timescale Stability-Preserving Hiera…

200 papers

Achieving highly dynamic behaviors on humanoid robots, such as running, requires controllers that are both robust and precise, and hence difficult to design. Classical control methods offer valuable insight into how such systems can…

Robotics · Computer Science 2025-09-25 Zachary Olkin , Kejun Li , William D. Compton , Aaron D. Ames

Reinforcement Learning (RL) and its integration with deep learning have achieved impressive performance in various robotic control tasks, ranging from motion planning and navigation to end-to-end visual manipulation. However, stability is…

Robotics · Computer Science 2020-07-16 Minghao Han , Lixian Zhang , Jun Wang , Wei Pan

We introduce Hierarchical Transformers for Meta-Reinforcement Learning (HTrMRL), a powerful online meta-reinforcement learning approach. HTrMRL aims to address the challenge of enabling reinforcement learning agents to perform effectively…

Machine Learning · Computer Science 2024-02-12 Gresa Shala , André Biedenkapp , Josif Grabocka

Robotic systems operating in dynamic and uncertain environments increasingly require planners that satisfy complex task sequences while adhering to strict temporal constraints. Metric Interval Temporal Logic (MITL) offers a formal and…

Robotics · Computer Science 2026-01-05 Zhaoan Wang , Junchao Li , Mahdi Mohammad , Shaoping Xiao

Achieving safe and coordinated behavior in dynamic, constraint-rich environments remains a major challenge for learning-based control. Pure end-to-end learning often suffers from poor sample efficiency and limited reliability, while…

Systems and Control · Electrical Eng. & Systems 2025-10-10 Max Studt , Georg Schildbach

In many real-world reinforcement learning (RL) problems, besides optimizing the main objective function, an agent must concurrently avoid violating a number of constraints. In particular, besides optimizing performance it is crucial to…

Machine Learning · Computer Science 2018-05-22 Yinlam Chow , Ofir Nachum , Edgar Duenez-Guzman , Mohammad Ghavamzadeh

This paper proposes a novel hierarchical model predictive control (MPC) strategy that guarantees overall system stability. This method differs significantly from previous approaches to guaranteeing overall stability, which have relied upon…

Optimization and Control · Mathematics 2013-09-24 Chris Vermillion , Amor Menezes , Ilya Kolmanovsky

Hierarchical reinforcement learning (HRL) holds great potential for sample-efficient learning on challenging long-horizon tasks. In particular, letting a higher level assign subgoals to a lower level has been shown to enable fast learning…

Machine Learning · Computer Science 2021-12-07 Nico Gürtler , Dieter Büchler , Georg Martius

Hierarchical Reinforcement Learning (HRL) is well-suitedd for solving complex tasks by breaking them down into structured policies. However, HRL agents often struggle with efficient exploration and quick adaptation. To overcome these…

Machine Learning · Computer Science 2025-03-18 Arash Khajooeinejad , Fatemeh Sadat Masoumi , Masoumeh Chapariniya

Reinforcement Learning (RL) has emerged as an efficient method of choice for solving complex sequential decision making problems in automatic control, computer science, economics, and biology. In this paper we present a model-free RL…

Logic in Computer Science · Computer Science 2019-09-13 Mohammadhosein Hasanbeig , Yiannis Kantaros , Alessandro Abate , Daniel Kroening , George J. Pappas , Insup Lee

Developing an automated driving system capable of navigating complex traffic environments remains a formidable challenge. Unlike rule-based or supervised learning-based methods, Deep Reinforcement Learning (DRL) based controllers eliminate…

Machine Learning · Computer Science 2025-01-28 Zhihao Zhang , Ekim Yurtsever , Keith A. Redmill

Safe and efficient assistive planning for visually impaired scenarios remains challenging, since existing methods struggle with multi-objective optimization, generalization, and interpretability. In response, this paper proposes a…

Robotics · Computer Science 2026-04-17 Yuting Zeng , Zhiwen Zheng , Jingya Wang , You Zhou , JiaLing Xiao , Yongbin Yu , Manping Fan , Bo Gong , Liyong Ren

For stabilizing control tasks, model-free reinforcement learning (RL) approaches face numerous challenges, particularly regarding the issues of effectiveness and efficiency in complex high-dimensional environments with limited training…

Machine Learning · Computer Science 2026-03-24 Yongwei Zhang , Yuanzhe Xing , Quanyi Liang , Quan Quan , Zhikun She

Hierarchical reinforcement learning (HRL) helps address large-scale and sparse reward issues in reinforcement learning. In HRL, the policy model has an inner representation structured in levels. With this structure, the reinforcement…

Artificial Intelligence · Computer Science 2020-02-07 Wen-Ji Zhou , Yang Yu

Decentralized multi-agent control has broad applications, ranging from multi-robot cooperation to distributed sensor networks. In decentralized multi-agent control, systems are complex with unknown or highly uncertain dynamics, where…

Systems and Control · Electrical Eng. & Systems 2020-09-22 Qingrui Zhang , Hao Dong , Wei Pan

Urban search and rescue missions require rapid first response to minimize loss of life and damage. Often, such efforts are assisted by humanitarian robots which need to handle dynamic operational conditions such as uneven and rough…

Robotics · Computer Science 2024-01-09 Nishaant Shah , Kshitij Tiwari , Aniket Bera

Hierarchical reinforcement learning (HRL) incorporates temporal abstraction into reinforcement learning (RL) by explicitly taking advantage of hierarchical structure. Modern HRL typically designs a hierarchical agent composed of a…

Machine Learning · Computer Science 2024-01-24 Sang-Hyun Lee , Yoonjae Jung , Seung-Woo Seo

Deep Reinforcement Learning (DRL) is applied to control a nonlinear, chaotic system governed by the one-dimensional Kuramoto-Sivashinsky (KS) equation. DRL uses reinforcement learning principles for the determination of optimal control…

Recent advancements in reinforcement learning have made significant impacts across various domains, yet they often struggle in complex multi-agent environments due to issues like algorithm instability, low sampling efficiency, and the…

Multiagent Systems · Computer Science 2024-08-22 Cheng Xu , Changtian Zhang , Yuchen Shi , Ran Wang , Shihong Duan , Yadong Wan , Xiaotong Zhang

Complex high-dimensional spaces with high Degree-of-Freedom and complicated action spaces, such as humanoid robots equipped with dexterous hands, pose significant challenges for reinforcement learning (RL) algorithms, which need to wisely…

Robotics · Computer Science 2025-02-25 Zifeng Zhuang , Diyuan Shi , Runze Suo , Xiao He , Hongyin Zhang , Ting Wang , Shangke Lyu , Donglin Wang