English
Related papers

Related papers: Hierarchical Reinforcement Learning with Runtime S…

200 papers

Reinforcement learning has been established over the past decade as an effective tool to find optimal control policies for dynamical systems, with recent focus on approaches that guarantee safety during the learning and/or execution phases.…

Systems and Control · Electrical Eng. & Systems 2021-10-06 S M Nahid Mahmud , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar

Autonomous driving has achieved significant progress in recent years, but autonomous cars are still unable to tackle high-risk situations where a potential accident is likely. In such near-accident scenarios, even a minor change in the…

Machine Learning · Computer Science 2020-07-02 Zhangjie Cao , Erdem Bıyık , Woodrow Z. Wang , Allan Raventos , Adrien Gaidon , Guy Rosman , Dorsa Sadigh

Designing controllers that accomplish tasks while guaranteeing safety constraints remains a significant challenge. We often want an agent to perform well in a nominal task, such as environment exploration, while ensuring it can avoid unsafe…

Systems and Control · Electrical Eng. & Systems 2025-06-04 Azra Begzadić , Nikhil Uday Shinde , Sander Tonkens , Dylan Hirsch , Kaleb Ugalde , Michael C. Yip , Jorge Cortés , Sylvia Herbert

This paper focuses on finding reinforcement learning policies for control systems with hard state and action constraints. Despite its success in many domains, reinforcement learning is challenging to apply to problems with hard constraints,…

Machine Learning · Computer Science 2020-03-24 Liyuan Zheng , Yuanyuan Shi , Lillian J. Ratliff , Baosen Zhang

For the task with complicated manipulation in unstructured environments, traditional hand-coded methods are ineffective, while reinforcement learning can provide more general and useful policy. Although the reinforcement learning is able to…

Robotics · Computer Science 2025-12-03 Nan Lin , Linrui Zhang , Yuxuan Chen , Zhenrui Chen , Yujun Zhu , Ruoxi Chen , Peichen Wu , Xiaoping Chen

Driving in dense traffic with human and autonomous drivers is a challenging task that requires high-level planning and reasoning. Human drivers can achieve this task comfortably, and there has been many efforts to model human driver…

Machine Learning · Computer Science 2024-10-28 Yigit Gurses , Kaan Buyukdemirci , Yildiray Yildiz

Purpose: This study aims to address the challenges of controlling unstable and nonlinear systems by proposing an adaptive PID controller based on predictive reinforcement learning (PRL-PID), where the PRL-PID combines the advantages of both…

Systems and Control · Electrical Eng. & Systems 2025-06-11 Chaoqun Ma , Zhiyong Zhang

In 5G non-standalone mode, an intelligent traffic steering mechanism can vastly aid in ensuring smooth user experience by selecting the best radio access technology (RAT) from a multi-RAT environment for a specific traffic flow. In this…

Networking and Internet Architecture · Computer Science 2023-01-20 Md Arafat Habib , Hao Zhou , Pedro Enrique Iturria-Rivera , Medhat Elsayed , Majid Bavand , Raimundas Gaigalas , Yigit Ozcan , Melike Erol-Kantarci

Hierarchical decomposition of control is unavoidable in large dynamical systems. In reinforcement learning (RL), it is usually solved with subgoals defined at higher policy levels and achieved at lower policy levels. Reaching these goals…

This work presents a Hierarchical Multi-Agent Reinforcement Learning framework for analyzing simulated air combat scenarios involving heterogeneous agents. The objective is to identify effective Courses of Action that lead to mission…

Artificial Intelligence · Computer Science 2025-05-15 Ardian Selmonaj , Oleg Szehr , Giacomo Del Rio , Alessandro Antonucci , Adrian Schneider , Michael Rüegsegger

Power systems are subject to fundamental changes due to the increasing infeed of renewable energy sources. Taking the accompanying decentralization of power generation into account, the concept of prosumer-based microgrids gives the…

Systems and Control · Electrical Eng. & Systems 2021-08-11 Lia Strenge , Xiaohan Jing , Ruth Boersma , Paul Schultz , Frank Hellmann , Jürgen Kurths , Jörg Raisch , Thomas Seel

Real-world tasks are often highly structured. Hierarchical reinforcement learning (HRL) has attracted research interest as an approach for leveraging the hierarchical structure of a given task in reinforcement learning (RL). However,…

Machine Learning · Computer Science 2019-03-08 Takayuki Osa , Voot Tangkaratt , Masashi Sugiyama

This paper presents the background material required for the Learning to Run Power Networks Challenge. The challenge is focused on using Reinforcement Learning to train an agent to manage the real-time operations of a power grid, balancing…

Signal Processing · Electrical Eng. & Systems 2020-03-17 Adrian Kelly , Aidan O'Sullivan , Patrick de Mars , Antoine Marot

The operation of electricity grids has become increasingly complex due to the current upheaval and the increase in renewable energy production. As a consequence, active grid management is reaching its limits with conventional approaches. In…

Machine Learning · Computer Science 2024-09-18 Malte Lehna , Jan Viebahn , Christoph Scholz , Antoine Marot , Sven Tomforde

To achieve scenario intelligence, humans must transfer knowledge to robots by developing goal-oriented algorithms, which are sometimes insensitive to dynamically changing environments. While deep reinforcement learning achieves significant…

Artificial Intelligence · Computer Science 2018-07-31 Tingguang Li , Jin Pan , Delong Zhu , Max Q. -H. Meng

The deployment of robots in uncontrolled environments requires them to operate robustly under previously unseen scenarios, like irregular terrain and wind conditions. Unfortunately, while rigorous safety frameworks from robust optimal…

Machine Learning · Computer Science 2024-06-11 Kai-Chieh Hsu , Duy Phuong Nguyen , Jaime Fernández Fisac

This thesis develops data-driven machine learning algorithms to managing and optimizing the next-generation highly complex cyberphysical systems, which desperately need ground-breaking control, monitoring, and decision making schemes that…

Machine Learning · Computer Science 2022-02-14 Alireza Sadeghi

In swarm robotics, confrontation including the pursuit-evasion game is a key scenario. High uncertainty caused by unknown opponents' strategies, dynamic obstacles, and insufficient training complicates the action space into a hybrid…

Robotics · Computer Science 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen , Jinhu Lü

Deriving fast and effectively coordinated control actions remains a grand challenge affecting the secure and economic operation of today's large-scale power grid. This paper presents a novel artificial intelligence (AI) based methodology to…

Optimization and Control · Mathematics 2020-12-14 Ruisheng Diao , Di Shi , Bei Zhang , Siqi Wang , Haifeng Li , Chunlei Xu , Tu Lan , Desong Bian , Jiajun Duan

Imitation learning (IL) has shown great success in learning complex robot manipulation tasks. However, there remains a need for practical safety methods to justify widespread deployment. In particular, it is important to certify that a…