English
Related papers

Related papers: A Physics-Informed Machine Learning Framework for …

200 papers

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

Machine Learning · Computer Science 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

Racing demands each vehicle to drive at its physical limits, when any safety infraction could lead to catastrophic failure. In this work, we study the problem of safe reinforcement learning (RL) for autonomous racing, using the vehicle's…

Robotics · Computer Science 2021-12-02 Bingqing Chen , Jonathan Francis , Jean Oh , Eric Nyberg , Sylvia L. Herbert

Safety remains a central challenge in control of dynamical systems, particularly when the boundaries of unsafe sets are complex (e.g., nonconvex, nonsmooth) or unknown. This paper proposes a learning-enabled framework for safety-critical…

Systems and Control · Electrical Eng. & Systems 2025-09-16 Shuo Liu , Zhe Huang , Jun Zeng , Koushil Sreenath , Calin A. Belta

Recent literature has proposed approaches that learn control policies with high performance while maintaining safety guarantees. Synthesizing Hamilton-Jacobi (HJ) reachable sets has become an effective tool for verifying safety and…

Systems and Control · Electrical Eng. & Systems 2024-08-23 Milan Ganai , Sicun Gao , Sylvia Herbert

Multi-vehicle collision avoidance is a highly crucial problem due to the soaring interests of introducing autonomous vehicles into the real world in recent years. The safety of these vehicles while they complete their objectives is of…

Robotics · Computer Science 2021-09-28 Jennifer C. Shih , Akshara Rai , Laurent El Ghaoui

We present a framework to \emph{certify} Hamilton--Jacobi (HJ) reachability learned by reinforcement learning (RL). Building on a discounted initial time \emph{travel-cost} formulation that makes small-step RL value iteration provably…

Systems and Control · Electrical Eng. & Systems 2026-02-19 Prashant Solanki , Isabelle El-Hajj , Jasper J. van Beers , Erik-Jan van Kampen , Coen C. de Visser

Control Barrier Functions (CBFs) are a powerful tool for ensuring robotic safety, but designing or learning valid CBFs for complex systems is a significant challenge. While Hamilton-Jacobi Reachability provides a formal method for…

Robotics · Computer Science 2026-03-02 Sander Tonkens , Sosuke Kojima , Chenhao Liu , Judy Masri , Sylvia Herbert

Ensuring robot safety in complex environments is a difficult task due to actuation limits, such as torque bounds. This paper presents a safety-critical control framework that leverages learning-based switching between multiple backup…

Robotics · Computer Science 2024-03-08 Neil C. Janwani , Ersin Daş , Thomas Touma , Skylar X. Wei , Tamas G. Molnar , Joel W. Burdick

In this paper, we present a framework for enabling autonomous vehicles to interact with cyclists in a manner that balances safety and optimality. The approach integrates Hamilton-Jacobi reachability analysis with deep Q-learning to jointly…

Robotics · Computer Science 2026-02-23 Aarati Andrea Noronha , Jean Oh

Research, innovation and practical capital investment have been increasing rapidly toward the realization of autonomous physical agents. This includes industrial and service robots, unmanned aerial vehicles, embedded control devices, and a…

Safety filters provide a practical approach for enforcing safety constraints in autonomous systems. While learning-based tools scale to high-dimensional systems, their performance depends on informative data that includes states likely to…

Robotics · Computer Science 2026-04-16 James Dallas , Thomas Lew , John Talbot , Jonathan DeCastro , Somil Bansal , John Subosits

Modern nonlinear control theory seeks to develop feedback controllers that endow systems with properties such as safety and stability. The guarantees ensured by these controllers often rely on accurate estimates of the system state for…

Systems and Control · Electrical Eng. & Systems 2020-11-02 Sarah Dean , Andrew J. Taylor , Ryan K. Cosner , Benjamin Recht , Aaron D. Ames

In safe Reinforcement Learning (RL), safety cost is typically defined as a function dependent on the immediate state and actions. In practice, safety constraints can often be non-Markovian due to the insufficient fidelity of state…

Machine Learning · Computer Science 2024-05-07 Siow Meng Low , Akshat Kumar

Physics-informed neural solvers offer a promising route to model-based reinforcement learning in continuous time, where optimal feedback synthesis is governed by Hamilton--Jacobi--Bellman (HJB) equations. Practical implementations often…

Machine Learning · Computer Science 2026-05-11 Minseok Kim , Yeongjong Kim , Namkyeong Cho , Yeoneung Kim

This paper addresses the target-pursuit problem, aiming to ensure each pursuer's safety regarding collision avoidance, sensing range, and input saturation. An input-constrained CBF is proposed to dynamically regulate the pursuer's control,…

Systems and Control · Electrical Eng. & Systems 2024-12-11 Yaosheng Deng , Junjie Gao , Jiaping Xiao , Mir Feroskhan

Control Barrier Functions (CBFs) have been used to enforce safety and task specifications expressed in Signal Temporal Logic (STL). However, existing CBF-STL approaches typically rely on fixed hyperparameters and per-step optimization,…

Systems and Control · Electrical Eng. & Systems 2026-01-29 Wenliang Liu , Shuo Liu , Wei Xiao , Calin A. Belta

While artificial-intelligence-based methods suffer from lack of transparency, rule-based methods dominate in safety-critical systems. Yet, the latter cannot compete with the first ones in robustness to multiple requirements, for instance,…

Artificial Intelligence · Computer Science 2022-02-01 Andrei Aksjonov , Ville Kyrki

Reinforcement learning (RL) is a promising approach. However, success is limited to real-world applications, because ensuring safe exploration and facilitating adequate exploitation is a challenge for controlling robotic systems with…

Robotics · Computer Science 2022-08-29 Mingyu Cai , Cristian-Ioan Vasile

This paper addresses the problem of safety-critical control for non-affine control systems. It has been shown that optimizing quadratic costs subject to state and control constraints can be sub-optimally reduced to a sequence of quadratic…

Systems and Control · Electrical Eng. & Systems 2024-02-15 Wei Xiao , Ross Allen , Daniela Rus

Control Barrier Functions (CBFs) have become a popular tool for enforcing set invariance in safety-critical control systems. While guaranteeing safety, most CBF approaches are myopic in the sense that they solve an optimization problem at…

Systems and Control · Electrical Eng. & Systems 2020-08-11 Max Cohen , Calin Belta