English
Related papers

Related papers: Discovering Closed-Loop Failures of Vision-Based C…

200 papers

Autonomous systems are increasingly implemented using end-to-end learning-based controllers. Such controllers make decisions that are executed on the real system, with images as one of the primary sensing modalities. Deep neural networks…

Machine Learning · Computer Science 2024-05-03 Yuang Geng , Jake Brandon Baldauf , Souradeep Dutta , Chao Huang , Ivan Ruchkin

Hamilton-Jacobi (HJ) reachability provides formal safety guarantees for nonlinear systems. However, it becomes computationally intractable in high-dimensional settings, motivating learning-based approximations that may introduce unsafe…

Systems and Control · Electrical Eng. & Systems 2026-03-27 Ebonye Smith , Sampada Deglurkar , Jingqi Li , Gechen Qu , Claire J. Tomlin

Occlusions caused by a robot's own body is a common problem for closed-loop control methods employed in eye-to-hand camera setups. We propose an optimization-based reactive controller that minimizes self-occlusions while achieving a desired…

In this paper, we investigate the synthesis of piecewise affine feedback controllers to address the problem of safe and robust controller design in robotics based on high-level controls specifications. The methodology is based on…

Robotics · Computer Science 2016-10-10 Marijan Vukosavljev , Ivo Jansen , Mireille E. Broucke , Angela P. Schoellig

We investigate the control synthesis problem for continuous-time time-varying nonlinear systems with disturbance under a class of multiple reach-avoid (MRA) tasks. Specifically, the MRA task requires the system to reach a series of target…

Systems and Control · Electrical Eng. & Systems 2025-09-16 Yu Chen , Shaoyuan Li , Xiang Yin

With the recent surge of interest in UAVs for civilian services, the importance of developing tractable multi-agent analysis techniques that provide safety and performance guarantees have drastically increased. Hamilton-Jacobi (HJ)…

Optimization and Control · Mathematics 2017-03-23 Aparna Dhinakaran , Mo Chen , Glen Chou , Jennifer C. Shih , Claire J. Tomlin

Safe multi-agent motion planning (MAMP) under task-induced constraints is a critical challenge in robotics. Many real-world scenarios require robots to navigate dynamic environments while adhering to manifold constraints imposed by tasks.…

Robotics · Computer Science 2025-11-06 Qingyi Chen , Ruiqi Ni , Jun Kim , Ahmed H. Qureshi

Hamilton-Jacobi (HJ) Reachability is widely used to compute value functions for states satisfying specific control objectives. However, it becomes intractable for high-dimensional problems due to the curse of dimensionality. Dimensionality…

Systems and Control · Electrical Eng. & Systems 2025-05-16 Chong He , Mugilan Mariappan , Keval Vora , Mo Chen

In this work we present a constructive method to design a family of virtual contraction based controllers that solve the standard trajectory tracking problem of flexible-joint robots (FJRs) in the port-Hamiltonian (pH) framework. The…

Systems and Control · Electrical Eng. & Systems 2020-02-06 Rodolfo Reyes-Báez , Arjan van der Schaft , Bayu Jayawardhana , Le Pan

Hamilton-Jacobi reachability (HJR) provides a value function that encodes the set of states from which a system with bounded control inputs can reach or avoid a target despite any bounded disturbance, and the corresponding robust, optimal…

Systems and Control · Electrical Eng. & Systems 2025-06-23 Will Sharpless , Yat Tin Chow , Sylvia Herbert

This paper focuses on an adaptive and fault-tolerant vision-guided robotic system that enables to choose the most appropriate control action if partial or complete failure of the vision system in the short term occurs. Moreover, the…

Robotics · Computer Science 2022-09-07 Farhad Aghili

Safe value functions, such as control barrier functions, characterize a safe set and synthesize a safety filter, overriding unsafe actions, for a dynamic system. While function approximators like neural networks can synthesize approximately…

Robotics · Computer Science 2024-09-10 Sander Tonkens , Alex Toofanian , Zhizhen Qin , Sicun Gao , Sylvia Herbert

Safety filters based on Control Barrier Functions (CBFs) have emerged as a practical tool for the safety-critical control of autonomous systems. These approaches encode safety through a value function and enforce safety by imposing a…

Robotics · Computer Science 2022-08-23 Sander Tonkens , Sylvia Herbert

In this paper, we propose an approach for synthesizing provable reach-avoid controllers, which drive a deterministic system operating in an unknown environment to safely reach a desired target set. The approach falls within the reachability…

Systems and Control · Electrical Eng. & Systems 2023-04-25 Jianqiang Ding , Taoran Wu , Yuping Qian , Lijun Zhang , Bai Xue

Simulation-based testing remains the main approach for validating Autonomous Driving Systems. We propose a rigorous test method based on breaking down scenarios into simple ones, taking into account the fact that autopilots make decisions…

Software Engineering · Computer Science 2024-05-28 Changwen Li , Joseph Sifakis , Rongjie Yan , Jian Zhang

Despite their success in massive engineering applications, deep neural networks are vulnerable to various perturbations due to their black-box nature. Recent study has shown that a deep neural network can misclassify the data even if the…

Machine Learning · Computer Science 2021-04-29 Zhuotong Chen , Qianxiao Li , Zheng Zhang

We propose VISION-SLS, a method for nonlinear output-feedback control from high-resolution RGB images which provides robust constraint satisfaction guarantees under calibrated uncertainty bounds despite partial observability, sensor noise,…

Robotics · Computer Science 2026-04-29 Antoine P. Leeman , Shuyu Zhan , Melanie N. Zeilinger , Glen Chou

Latent safety filters extend Hamilton-Jacobi (HJ) reachability to operate on latent state representations and dynamics learned directly from high-dimensional observations, enabling safe visuomotor control under hard-to-model constraints.…

Control Barrier Functions (CBFs) are a powerful tool for ensuring robotic safety, but designing or learning valid CBFs for complex systems is a significant challenge. While Hamilton-Jacobi Reachability provides a formal method for…

Robotics · Computer Science 2026-03-02 Sander Tonkens , Sosuke Kojima , Chenhao Liu , Judy Masri , Sylvia Herbert

Logging of incoming/outgoing vehicles serves as a piece of critical information for root-cause analysis to combat security breach incidents in various sensitive organizations. RFID tagging hampers the scalability of vehicle tracking…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Pranav Kant Gaur , Abhilash Bhardwaj , Pritam Shete , Mohini Laghate , Dinesh M Sarode