English
Related papers

Related papers: Hamilton-Jacobi Reachability in Reinforcement Lear…

200 papers

Safety assurance is a critical yet challenging aspect when developing self-driving technologies. Hamilton-Jacobi backward-reachability analysis is a formal verification tool for verifying the safety of dynamic systems in the presence of…

Robotics · Computer Science 2021-06-08 Ran Tian , Anjian Li , Masayoshi Tomizuka , Liting Sun

Multi-vehicle collision avoidance is a highly crucial problem due to the soaring interests of introducing autonomous vehicles into the real world in recent years. The safety of these vehicles while they complete their objectives is of…

Robotics · Computer Science 2021-09-28 Jennifer C. Shih , Akshara Rai , Laurent El Ghaoui

In this paper, we present a framework for enabling autonomous vehicles to interact with cyclists in a manner that balances safety and optimality. The approach integrates Hamilton-Jacobi reachability analysis with deep Q-learning to jointly…

Robotics · Computer Science 2026-02-23 Aarati Andrea Noronha , Jean Oh

Hamilton-Jacobi (HJ) reachability provides formal safety guarantees for nonlinear systems. However, it becomes computationally intractable in high-dimensional settings, motivating learning-based approximations that may introduce unsafe…

Systems and Control · Electrical Eng. & Systems 2026-03-27 Ebonye Smith , Sampada Deglurkar , Jingqi Li , Gechen Qu , Claire J. Tomlin

Learning-based approaches for controlling safety-critical systems are rapidly growing in popularity; thus, it is important to assure their performance and safety. Hamilton-Jacobi (HJ) reachability analysis is a popular formal verification…

Robotics · Computer Science 2024-04-11 Albert Lin , Somil Bansal

Hamilton-Jacobi (HJ) reachability analysis is a powerful tool for analyzing the safety of autonomous systems. However, the provided safety assurances are often predicated on the assumption that once deployed, the system or its environment…

Robotics · Computer Science 2024-04-24 Javier Borquez , Kensuke Nakamura , Somil Bansal

As safety-critical autonomous vehicles (AVs) will soon become pervasive in our society, a number of safety concepts for trusted AV deployment have recently been proposed throughout industry and academia. Yet, achieving consensus on an…

Robotics · Computer Science 2022-06-22 Karen Leung , Andrea Bajcsy , Edward Schmerling , Marco Pavone

As perception-based controllers for autonomous systems become increasingly popular in the real world, it is important that we can formally verify their safety and performance despite perceptual uncertainty. Unfortunately, the verification…

Robotics · Computer Science 2026-04-16 Albert Lin , Alessandro Pinto , Somil Bansal

Hamilton-Jacobi (HJ) reachability-based filtering provides a powerful framework to co-optimize performance and safety (or liveness) for autonomous systems. Under this filtering scheme, a nominal controller is minimally modified to ensure…

Robotics · Computer Science 2024-08-20 Javier Borquez , Kaustav Chakraborty , Hao Wang , Somil Bansal

Multi-agent differential games are important and useful tools for analyzing many practical problems. With the recent surge of interest in using UAVs for civil purposes, the importance and urgency of developing tractable multi-agent analysis…

Systems and Control · Computer Science 2016-10-05 Mo Chen , Jennifer C. Shih , Claire J. Tomlin

Within a robot autonomy stack, the planner and controller are typically designed separately, and serve different purposes. As such, there is often a diffusion of responsibilities when it comes to ensuring safety for the robot. We propose…

Robotics · Computer Science 2020-08-04 Xinrui Wang , Karen Leung , Marco Pavone

Hamilton-Jacobi (HJ) reachability provides formal safety guarantees for dynamical systems, but solving high-dimensional HJ partial differential equations limits its use in real-time planning. This paper presents a contingency-aware…

Robotics · Computer Science 2026-03-19 Kasidit Muenprasitivej , Derya Aksaray

Traditional reachability methods provide formal guarantees of safety under bounded disturbances. However, they strictly enforce state constraints as inviolable, which can result in overly conservative or infeasible solutions in complex…

Systems and Control · Electrical Eng. & Systems 2025-10-30 Chams Eddine Mballo , Donggun Lee , Claire J. Tomlin

We present a framework to \emph{certify} Hamilton--Jacobi (HJ) reachability learned by reinforcement learning (RL). Building on a discounted initial time \emph{travel-cost} formulation that makes small-step RL value iteration provably…

Systems and Control · Electrical Eng. & Systems 2026-02-19 Prashant Solanki , Isabelle El-Hajj , Jasper J. van Beers , Erik-Jan van Kampen , Coen C. de Visser

Providing formal safety and performance guarantees for autonomous systems is becoming increasingly important. Hamilton-Jacobi (HJ) reachability analysis is a popular formal verification tool for providing these guarantees, since it can…

Robotics · Computer Science 2023-06-13 Albert Lin , Somil Bansal

Contact-rich robotic systems, such as legged robots and manipulators, are often represented as hybrid systems. However, the stability analysis and region-of-attraction computation for these systems are often challenging because of the…

Robotics · Computer Science 2022-02-10 Jason J. Choi , Ayush Agrawal , Koushil Sreenath , Claire J. Tomlin , Somil Bansal

Hamilton-Jacobi (HJ) reachability analysis is a widely adopted verification tool to provide safety and performance guarantees for autonomous systems. However, it involves solving a partial differential equation (PDE) to compute a safety…

Robotics · Computer Science 2025-05-12 Aditya Singh , Zeyuan Feng , Somil Bansal

The proven efficacy of learning-based control schemes strongly motivates their application to robotic systems operating in the physical world. However, guaranteeing correct operation during the learning process is currently an unresolved…

We propose a novel formulation for approximating reachable sets through a minimum discounted reward optimal control problem. The formulation yields a continuous solution that can be obtained by solving a Hamilton-Jacobi equation.…

Optimization and Control · Mathematics 2018-09-05 Anayo K. Akametalu , Shromona Ghosh , Jaime F. Fisac , Claire J. Tomlin

Autonomous navigation requires planning to reach a goal safely and efficiently in complex and potentially dynamic environments. Graph search-based algorithms are widely adopted due to their generality and theoretical guarantees when…

Robotics · Computer Science 2026-04-21 Hanyang Hu , Cameron Siu , Mo Chen