English
Related papers

Related papers: Hamilton-Jacobi Reachability in Reinforcement Lear…

200 papers

Recently there have been a lot of interests in introducing UAVs for a wide range of applications, making ensuring safety of multi-vehicle systems a highly crucial problem. Hamilton-Jacobi (HJ) reachability is a promising tool for analyzing…

Robotics · Computer Science 2021-08-06 Jennifer C. Shih , Laurent El Ghaoui

Machine learning driven image-based controllers allow robotic systems to take intelligent actions based on the visual feedback from their environment. Understanding when these controllers might lead to system safety violations is important…

Robotics · Computer Science 2024-04-11 Kaustav Chakraborty , Somil Bansal

Hamilton-Jacobi reachability (HJR) provides a value function that encodes the set of states from which a system with bounded control inputs can reach or avoid a target despite any bounded disturbance, and the corresponding robust, optimal…

Systems and Control · Electrical Eng. & Systems 2025-06-23 Will Sharpless , Yat Tin Chow , Sylvia Herbert

Ensuring the safety of autonomous systems under uncertainty is a critical challenge. Hamilton-Jacobi reachability (HJR) analysis is a widely used method for guaranteeing safety under worst-case disturbances. In this work, we propose HJRNO,…

Robotics · Computer Science 2025-06-09 Yankai Li , Mo Chen

In Bansal et al. (2019), a novel visual navigation framework that combines learning-based and model-based approaches has been proposed. Specifically, a Convolutional Neural Network (CNN) predicts a waypoint that is used by the dynamics…

Robotics · Computer Science 2020-05-19 Anjian Li , Somil Bansal , Georgios Giovanis , Varun Tolani , Claire Tomlin , Mo Chen

Hamilton-Jacobi Reachability (HJR) analysis has been successfully used in many robotics and control tasks, and is especially effective in computing reach-avoid sets and control laws that enable an agent to reach a goal while satisfying…

Robotics · Computer Science 2026-02-03 Zheng Gong , Boyang Li , Sylvia Herbert

Real-world autonomous systems often employ probabilistic predictive models of human behavior during planning to reason about their future motion. Since accurately modeling human behavior a priori is challenging, such models are often…

Robotics · Computer Science 2020-04-07 Somil Bansal , Andrea Bajcsy , Ellis Ratner , Anca D. Dragan , Claire J. Tomlin

We present a fast planning architecture called Hamilton-Jacobi-based bidirectional A* (HJBA*) to solve general tight parking scenarios. The algorithm is a two-layer composed of a high-level HJ-based reachability analysis and a lower-level…

Robotics · Computer Science 2026-03-24 Xuemin Chi , Jun Zeng , Jihao Huang , Zhitao Liu , Hongye Su

This paper works towards unifying two popular approaches in the safety control community: Hamilton-Jacobi (HJ) reachability and Control Barrier Functions (CBFs). HJ Reachability has methods for direct construction of value functions that…

Systems and Control · Electrical Eng. & Systems 2021-10-26 Jason J. Choi , Donggun Lee , Koushil Sreenath , Claire J. Tomlin , Sylvia L. Herbert

Hamilton-Jacobi reachability analysis is a powerful technique used to verify the safety of autonomous systems. This method is very good at handling non-linear system dynamics with disturbances and flexible set representations. A drawback to…

Systems and Control · Electrical Eng. & Systems 2020-12-09 Minh Bui , Michael Lu , Reza Hojabr , Mo Chen , Arrvindh Shriraman

Hamilton-Jacobi (HJ) reachability analysis is a fundamental tool for the safety verification and control synthesis of nonlinear control systems. Classical HJ reachability analysis methods compute value functions over grids which discretize…

Systems and Control · Electrical Eng. & Systems 2026-03-31 Ihab Tabbara , Eliya Badr , Hussein Sibai

We unify Hamilton-Jacobi (HJ) reachability and Reinforcement Learning (RL) through a proposed running cost formulation. We prove that the resultant travel-cost value function is the unique bounded viscosity solution of a time-dependent…

Systems and Control · Electrical Eng. & Systems 2026-05-12 Prashant Solanki , Isabelle El-Hajj , Jasper van Beers , Erik-Jan van Kampen , Coen de Visser

The Hopf formula for Hamilton-Jacobi reachability (HJR) analysis has been proposed to solve high-dimensional differential games, producing the set of initial states and corresponding controller required to reach (or avoid) a target despite…

Systems and Control · Electrical Eng. & Systems 2025-06-23 Will Sharpless , Nikhil Shinde , Matthew Kim , Yat Tin Chow , Sylvia Herbert

Safety is a central requirement for autonomous system operation across domains. Hamilton-Jacobi (HJ) reachability analysis can be used to construct "least-restrictive" safety filters that result in infrequent, but often extreme, control…

Systems and Control · Electrical Eng. & Systems 2024-02-15 Athindran Ramesh Kumar , Kai-Chieh Hsu , Peter J. Ramadge , Jaime F. Fisac

Hamilton-Jacobi Reachability (HJR) is a popular method for analyzing the liveness and safety of a dynamical system with bounded control and disturbance. The corresponding HJ value function offers a robust controller and characterizes the…

Systems and Control · Electrical Eng. & Systems 2025-06-23 Will Sharpless , Yat Tin Chow , Sylvia Herbert

Safe value functions, such as control barrier functions, characterize a safe set and synthesize a safety filter, overriding unsafe actions, for a dynamic system. While function approximators like neural networks can synthesize approximately…

Robotics · Computer Science 2024-09-10 Sander Tonkens , Alex Toofanian , Zhizhen Qin , Sicun Gao , Sylvia Herbert

Recent approaches to leveraging deep learning for computing reachable sets of continuous-time dynamical systems have gained popularity over traditional level-set methods, as they overcome the curse of dimensionality. However, as with…

Systems and Control · Electrical Eng. & Systems 2025-04-01 Prashant Solanki , Nikolaus Vertovec , Yannik Schnitzer , Jasper Van Beers , Coen de Visser , Alessandro Abate

Recent developments in autonomous driving and robotics underscore the necessity of safety-critical controllers. Control barrier functions (CBFs) are a popular method for appending safety guarantees to a general control framework, but they…

Robotics · Computer Science 2025-05-21 Matthew Kim , William Sharpless , Hyun Joe Jeong , Sander Tonkens , Somil Bansal , Sylvia Herbert

Hamilton-Jacobi (HJ) Reachability is widely used to compute value functions for states satisfying specific control objectives. However, it becomes intractable for high-dimensional problems due to the curse of dimensionality. Dimensionality…

Systems and Control · Electrical Eng. & Systems 2025-05-16 Chong He , Mugilan Mariappan , Keval Vora , Mo Chen

Real-world autonomous vehicles often operate in a priori unknown environments. Since most of these systems are safety-critical, it is important to ensure they operate safely in the face of environment uncertainty, such as unseen obstacles.…

Robotics · Computer Science 2025-10-20 Andrea Bajcsy , Somil Bansal , Eli Bronstein , Varun Tolani , Claire J. Tomlin