English
Related papers

Related papers: A Novel Multi-Timescale Stability-Preserving Hiera…

200 papers

Deep reinforcement learning (DRL) has emerged as a powerful paradigm for solving complex decision-making problems. However, DRL-based systems still face significant dependability challenges particularly in real-time environments due to the…

Software Engineering · Computer Science 2026-03-25 Guoxin Su , Thomas Robinson , Hoa Khanh Dam , Li Liu , David S. Rosenblum

Model-free Deep Reinforcement Learning (DRL) controllers have demonstrated promising results on various challenging non-linear control tasks. While a model-free DRL algorithm can solve unknown dynamics and high-dimensional problems, it…

Robotics · Computer Science 2022-03-03 Zikang Xiong , Joe Eappen , Ahmed H. Qureshi , Suresh Jagannathan

Many applications -- including power systems, robotics, and economics -- involve a dynamical system interacting with a stochastic and hard-to-model environment. We adopt a reinforcement learning approach to control such systems.…

Optimization and Control · Mathematics 2025-08-26 Abed AlRahman Al Makdah , Oliver Kosut , Lalitha Sankar , Shaofeng Zou

Deep reinforcement learning for high dimensional, hierarchical control tasks usually requires the use of complex neural networks as functional approximators, which can lead to inefficiency, instability and even divergence in the training…

Machine Learning · Computer Science 2019-11-26 Yuguang Yang

Hierarchical reinforcement learning (HRL) has seen widespread interest as an approach to tractable learning of complex modular behaviors. However, existing work either assume access to expert-constructed hierarchies, or use…

Machine Learning · Computer Science 2021-10-19 Kurtland Chua , Qi Lei , Jason D. Lee

Many real-world applications can be formulated as multi-agent cooperation problems, such as network packet routing and coordination of autonomous vehicles. The emergence of deep reinforcement learning (DRL) provides a promising approach for…

Multiagent Systems · Computer Science 2022-06-28 Zhixuan Liang , Jiannong Cao , Shan Jiang , Divya Saxena , Huafeng Xu

Triangular tethered formation system (TTFS) provide a promising platform for deep space exploration and distributed sensing due to its intrinsic spatial-orientation stability and capability of adjusting distances among node satellites…

Systems and Control · Electrical Eng. & Systems 2026-01-09 Xinyi Tao , Panfeng Huang , Fan Zhang

Reinforcement learning (RL) is currently one of the most prominent methods for optimizing dynamical systems, with breakthrough results across various fields. The framework is based on the concept of a Markov decision process (MDP), leading…

Optimization and Control · Mathematics 2025-11-17 Rene Carmona , Mathieu Lauriere

Hierarchical Reinforcement Learning (HRL) approaches have shown successful results in solving a large variety of complex, structured, long-horizon problems. Nevertheless, a full theoretical understanding of this empirical evidence is…

Machine Learning · Computer Science 2025-02-05 Gianluca Drappo , Alberto Maria Metelli , Marcello Restelli

In this work, we propose a hierarchical reinforcement learning (HRL) structure which is capable of performing autonomous vehicle planning tasks in simulated environments with multiple sub-goals. In this hierarchical structure, the network…

Robotics · Computer Science 2019-11-12 Zhiqian Qiao , Zachariah Tyree , Priyantha Mudalige , Jeff Schneider , John M. Dolan

Reinforcement learning (RL) is promising for complicated stochastic nonlinear control problems. Without using a mathematical model, an optimal controller can be learned from data evaluated by certain performance criteria through…

Systems and Control · Electrical Eng. & Systems 2020-11-16 Minghao Han , Yuan Tian , Lixian Zhang , Jun Wang , Wei Pan

Autonomous spacecraft control for mission phases such as launch, ascent, stage separation, and orbit insertion remains a critical challenge due to the need for adaptive policies that generalize across dynamically distinct regimes. While…

Machine Learning · Computer Science 2025-11-17 Amit Jain , Victor Rodriguez-Fernandez , Richard Linares

Spatiotemporal chaos in fluid systems exhibits severe parametric sensitivity, rendering classical adjoint-based optimal control intractable because each operating regime requires recomputing the control law. We address this bottleneck with…

Computational Engineering, Finance, and Science · Computer Science 2026-04-09 Anil Sapkota , Omer San

This paper proposes a momentum-constrained hybrid heuristic trajectory optimization framework (MHHTOF) tailored for assistive navigation in visually impaired scenarios, integrating trajectory sampling generation, optimization and evaluation…

Robotics · Computer Science 2025-12-08 Yuting Zeng , Zhiwen Zheng , You Zhou , JiaLing Xiao , Yongbin Yu , Manping Fan , Bo Gong , Liyong Ren

Continuous-time nonlinear optimal control problems hold great promise in real-world applications. After decades of development, reinforcement learning (RL) has achieved some of the greatest successes as a general nonlinear control design…

Systems and Control · Electrical Eng. & Systems 2023-07-19 Brent A. Wallace , Jennie Si

Many real-world tasks involve delayed effects, where the outcomes of actions emerge after varying time lags. Existing delay-aware reinforcement learning methods often rely on state augmentation, prior knowledge of delay distributions, or…

Machine Learning · Computer Science 2026-05-13 Chenran Zhao , Dianxi Shi , Haotian Wang , Mengzhu Wang , Yaowen Zhang , Chunping Qiu , Shaowu Yang

Hierarchical model-based reinforcement learning (HMBRL) aims to combine the benefits of better sample efficiency of model based reinforcement learning (MBRL) with the abstraction capability of hierarchical reinforcement learning (HRL) to…

Machine Learning · Computer Science 2024-06-04 Robin Schiewer , Anand Subramoney , Laurenz Wiskott

Deep reinforcement learning has been recognized as a promising tool to address the challenges in real-time control of power systems. However, its deployment in real-world power systems has been hindered by a lack of explicit stability and…

Systems and Control · Electrical Eng. & Systems 2023-10-04 Jie Feng , Yuanyuan Shi , Guannan Qu , Steven H. Low , Anima Anandkumar , Adam Wierman

Building Reinforcement Learning (RL) algorithms which are able to adapt to continuously evolving tasks is an open research challenge. One technology that is known to inherently handle such non-stationary input patterns well is Hierarchical…

Machine Learning · Computer Science 2020-09-21 Jakob Struye , Kevin Mets , Steven Latré

Real-time multi-robot coordination in hazardous and adversarial environments requires fast, reliable adaptation to dynamic threats. While Large Language Models (LLMs) offer strong high-level reasoning capabilities, the lack of safety…

Robotics · Computer Science 2025-11-19 Yuwei Wu , Yuezhan Tao , Peihan Li , Guangyao Shi , Gaurav S. Sukhatme , Vijay Kumar , Lifeng Zhou