English
Related papers

Related papers: Discovering Closed-Loop Failures of Vision-Based C…

200 papers

Deep Reinforcement Learning (RL) has shown remarkable success in robotics with complex and heterogeneous dynamics. However, its vulnerability to unknown disturbances and adversarial attacks remains a significant challenge. In this paper, we…

Robotics · Computer Science 2024-10-01 Hanyang Hu , Xilun Zhang , Xubo Lyu , Mo Chen

Autonomous robots commonly aim to complete a nominal behavior while minimizing a cost; this leaves them vulnerable to failure or unplanned scenarios, where a backup or contingency plan to a safe set is needed to avoid a total mission…

Robotics · Computer Science 2026-03-31 Raj Harshit Srirangam , Leonard Jung , Rohith Poola , Michael Everett

This paper presents Verisig, a hybrid system approach to verifying safety properties of closed-loop systems using neural networks as controllers. Although techniques exist for verifying input/output properties of the neural network itself,…

Systems and Control · Computer Science 2018-11-06 Radoslav Ivanov , James Weimer , Rajeev Alur , George J. Pappas , Insup Lee

Ensuring safety in autonomous systems with vision-based control remains a critical challenge due to the high dimensionality of image inputs and the fact that the relationship between true system state and its visual manifestation is…

Robotics · Computer Science 2025-11-12 Xinhang Ma , Junlin Wu , Hussein Sibai , Yiannis Kantaros , Yevgeniy Vorobeychik

Robots must operate safely when deployed in novel and human-centered environments, like homes. Current safe control approaches typically assume that the safety constraints are known a priori, and thus, the robot can pre-compute a…

Robotics · Computer Science 2024-09-24 Leonardo Santos , Zirui Li , Lasse Peters , Somil Bansal , Andrea Bajcsy

Reachability analysis is important for studying optimal control problems and differential games, which are powerful theoretical tools for analyzing and modeling many practical problems in robotics, aircraft control, among other application…

Optimization and Control · Mathematics 2016-03-22 Mo Chen , Claire J. Tomlin

This paper considers the final approach phase of visual-closed-loop grasping where the RGB-D camera is no longer able to provide valid depth information. Many current robotic grasping controllers are not closed-loop and therefore fail for…

Robotics · Computer Science 2020-03-02 Jesse Haviland , Feras Dayoub , Peter Corke

We present a framework to \emph{certify} Hamilton--Jacobi (HJ) reachability learned by reinforcement learning (RL). Building on a discounted initial time \emph{travel-cost} formulation that makes small-step RL value iteration provably…

Systems and Control · Electrical Eng. & Systems 2026-02-19 Prashant Solanki , Isabelle El-Hajj , Jasper J. van Beers , Erik-Jan van Kampen , Coen C. de Visser

Hamilton-Jacobi (HJ) reachability analysis is a fundamental tool for the safety verification and control synthesis of nonlinear control systems. Classical HJ reachability analysis methods compute value functions over grids which discretize…

Systems and Control · Electrical Eng. & Systems 2026-03-31 Ihab Tabbara , Eliya Badr , Hussein Sibai

Autonomous ground vehicles (AGVs) must navigate safely in cluttered environments while accounting for complex dynamics and environmental uncertainty. Hamilton-Jacobi Reachability (HJR) offers formal safety guarantees through the computation…

Robotics · Computer Science 2025-12-02 Granthik Halder , Rudrashis Majumder , Rakshith M R , Rahi Shah , Suresh Sundaram

Control Barrier Functions (CBFs) have been widely utilized in the design of optimization-based controllers and filters for dynamical systems to ensure forward invariance of a given set of safe states. While CBF-based controllers offer…

Systems and Control · Electrical Eng. & Systems 2025-04-14 Damola Ajeyemi , Saber Jafarpour , Emiliano Dall'Anese

The increasing prevalence of neural networks (NNs) in safety-critical applications calls for methods to certify their behavior and guarantee safety. This paper presents a backward reachability approach for safety verification of neural…

Systems and Control · Electrical Eng. & Systems 2022-11-22 Nicholas Rober , Michael Everett , Jonathan P. How

We present an overview of recently developed data-driven tools for safety analysis of autonomous vehicles and advanced driver assist systems. The core algorithms combine model-based, hybrid system reachability analysis with sensitivity…

Systems and Control · Computer Science 2017-04-24 Chuchu Fan , Bolun Qi , Sayan Mitra

As autonomous systems become more ubiquitous in daily life, ensuring high performance with guaranteed safety is crucial. However, safety and performance could be competing objectives, which makes their co-optimization difficult.…

Robotics · Computer Science 2025-05-29 Manan Tayal , Aditya Singh , Shishir Kolathaya , Somil Bansal

Hamilton-Jacobi (HJ) reachability analysis is a powerful tool for analyzing the safety of autonomous systems. However, the provided safety assurances are often predicated on the assumption that once deployed, the system or its environment…

Robotics · Computer Science 2024-04-24 Javier Borquez , Kensuke Nakamura , Somil Bansal

Multi-agent differential games are important and useful tools for analyzing many practical problems. With the recent surge of interest in using UAVs for civil purposes, the importance and urgency of developing tractable multi-agent analysis…

Systems and Control · Computer Science 2016-10-05 Mo Chen , Jennifer C. Shih , Claire J. Tomlin

Neural Networks (NNs) can provide major empirical performance improvements for closed-loop systems, but they also introduce challenges in formally analyzing those systems' safety properties. In particular, this work focuses on estimating…

Systems and Control · Electrical Eng. & Systems 2022-02-03 Michael Everett , Golnaz Habibi , Chuangchuang Sun , Jonathan P. How

We study the problem of target stabilization with robust obstacle avoidance in robots and vehicles that have access only to vision-based sensors for the purpose of realtime localization. This problem is particularly challenging due to the…

Robotics · Computer Science 2022-09-07 Alejandro Murillo-Gonzalez , Jorge I. Poveda

Hamilton-Jacobi reachability (HJR) is an exciting framework used for control of safety-critical systems with nonlinear and possibly uncertain dynamics. However, HJR suffers from the curse of dimensionality, with computation times growing…

Systems and Control · Electrical Eng. & Systems 2025-03-19 Dylan Hirsch , Sylvia Herbert

The deployment of Large Language Models (LLMs) in robotic systems presents unique safety challenges, particularly in unpredictable environments. Although LLMs, leveraging zero-shot learning, enhance human-robot interaction and…

Robotics · Computer Science 2025-03-07 Ahmad Hafez , Alireza Naderi Akhormeh , Amr Hegazy , Amr Alanwar