English
Related papers

Related papers: Safety-Critical Reinforcement Learning with Viabil…

200 papers

Applying reinforcement learning to robotic systems poses a number of challenging problems. A key requirement is the ability to handle continuous state and action spaces while remaining within a limited time and resource budget.…

Machine Learning · Computer Science 2020-06-29 Benjamin van Niekerk , Andreas Damianou , Benjamin Rosman

Loss-of-control (LOC) remains a leading cause of fixed-wing aircraft accidents, especially in post-stall and flat-spin regimes where conventional gain-scheduled or logic-based recovery laws may fail. This study formulates spin-recovery as a…

Systems and Control · Electrical Eng. & Systems 2026-01-13 Imran Sayyed , Aayush Konar , Nandan Kumar Sinha

This study presents a framework to guarantee safety for a class of second-order nonlinear systems under multiple state and input constraints. To facilitate real-world applications, a safety-critical controller must consider multiple…

Systems and Control · Electrical Eng. & Systems 2023-08-09 Donggeon David Oh , Dongjae Lee , H. Jin Kim

This tutorial paper focuses on safe physics-informed machine learning in the context of dynamics and control, providing a comprehensive overview of how to integrate physical models and safety guarantees. As machine learning techniques…

Systems and Control · Electrical Eng. & Systems 2025-06-16 Jan Drgona , Truong X. Nghiem , Thomas Beckers , Mahyar Fazlyab , Enrique Mallada , Colin Jones , Draguna Vrabie , Steven L. Brunton , Rolf Findeisen

Safe and efficient autonomous driving maneuvers in an interactive and complex environment can be considerably challenging due to the unpredictable actions of other surrounding agents that may be cooperative or adversarial in their…

Robotics · Computer Science 2019-01-28 Pin Wang , Ching-Yao Chan , Hanhan Li

Many real-world control problems involve both discrete decision variables - such as the choice of control modes, gear switching or digital outputs - as well as continuous decision variables - such as velocity setpoints, control gains or…

This paper presents a novel model-reference reinforcement learning control method for uncertain autonomous surface vehicles. The proposed control combines a conventional control method with deep reinforcement learning. With the conventional…

Systems and Control · Electrical Eng. & Systems 2021-06-17 Qingrui Zhang , Wei Pan , Vasso Reppa

In this paper, we develop safe reinforcement-learning-based controllers for systems tasked with accomplishing complex missions that can be expressed as linear temporal logic specifications, similar to those required by search-and-rescue…

Systems and Control · Electrical Eng. & Systems 2022-03-30 Aris Kanellopoulos , Filippos Fotiadis , Chuangchuang Sun , Zhe Xu , Kyriakos G. Vamvoudakis , Ufuk Topcu , Warren E. Dixon

Deep reinforcement learning (RL) has been endowed with high expectations in tackling challenging manipulation tasks in an autonomous and self-directed fashion. Despite the significant strides made in the development of reinforcement…

Robotics · Computer Science 2023-04-27 Zhenshan Bing , Aleksandr Mavrichev , Sicong Shen , Xiangtong Yao , Kejia Chen , Kai Huang , Alois Knoll

Designing Reinforcement Learning (RL) solutions for real-life problems remains a significant challenge. A major area of concern is safety. "Shielding" is a popular technique to enforce safety in RL by turning user-defined safety…

Machine Learning · Computer Science 2024-05-31 Alexander Politowicz , Sahisnu Mazumder , Bing Liu

Linear dynamical systems that obey stochastic differential equations are canonical models. While optimal control of known systems has a rich literature, the problem is technically hard under model uncertainty and there are hardly any…

Systems and Control · Electrical Eng. & Systems 2023-06-09 Mohamad Kazem Shirani Faradonbeh , Mohamad Sadegh Shirani Faradonbeh

Advancements in reinforcement learning have produced a variety of complex and useful intrinsic driving forces; crucially, these drivers operate under a direct conditioning paradigm. This form of conditioning limits our agents' capacity by…

Machine Learning · Computer Science 2026-05-13 Rodney A Sanchez , Ferat Sahin , Alex Ororbia , Jamison Heard

This paper presents a novel model-reference reinforcement learning algorithm for the intelligent tracking control of uncertain autonomous surface vehicles with collision avoidance. The proposed control algorithm combines a conventional…

Systems and Control · Electrical Eng. & Systems 2020-08-18 Qingrui Zhang , Wei Pan , Vasso Reppa

Safety is a critical concern when deploying reinforcement learning agents for realistic tasks. Recently, safe reinforcement learning algorithms have been developed to optimize the agent's performance while avoiding violations of safety…

Machine Learning · Computer Science 2021-01-05 Baiming Chen , Zuxin Liu , Jiacheng Zhu , Mengdi Xu , Wenhao Ding , Ding Zhao

Lifelong reinforcement learning provides a promising framework for developing versatile agents that can accumulate knowledge over a lifetime of experience and rapidly learn new tasks by building upon prior knowledge. However, current…

Machine Learning · Computer Science 2015-05-22 Haitham Bou Ammar , Rasul Tutunov , Eric Eaton

For safely applying reinforcement learning algorithms on high-dimensional nonlinear dynamical systems, a simplified system model is used to formulate a safe reinforcement learning framework. Based on the simplified system model, a…

Robotics · Computer Science 2021-09-09 Zhehua Zhou , Ozgur S. Oguz , Marion Leibold , Martin Buss

Safety-critical robot systems need thorough testing to expose design flaws and software bugs which could endanger humans. Testing in simulation is becoming increasingly popular, as it can be applied early in the development process and does…

Safety has become one of the main challenges of applying deep reinforcement learning to real world systems. Currently, the incorporation of external knowledge such as human oversight is the only means to prevent the agent from visiting the…

Artificial Intelligence · Computer Science 2021-11-17 Yunkun Xu , Zhenyu Liu , Guifang Duan , Jiangcheng Zhu , Xiaolong Bai , Jianrong Tan

Achieving safe and coordinated behavior in dynamic, constraint-rich environments remains a major challenge for learning-based control. Pure end-to-end learning often suffers from poor sample efficiency and limited reliability, while…

Systems and Control · Electrical Eng. & Systems 2025-10-10 Max Studt , Georg Schildbach

In large-scale networks of uncertain dynamical systems, where communication is limited and there is a strong interaction among subsystems, learning local models and control policies offers great potential for designing high-performance…

Systems and Control · Electrical Eng. & Systems 2021-11-08 Andrea Carron , Jerome Sieber , Melanie N. Zeilinger