English
Related papers

Related papers: Backward Reachability Analysis for Neural Feedback…

200 papers

In this paper, a robust optimization framework is developed to train shallow neural networks based on reachability analysis of neural networks. To characterize noises of input data, the input training data is disturbed in the description of…

Machine Learning · Computer Science 2021-07-28 Yejiang Yang , Weiming Xiang

Hamilton-Jacobi (HJ) reachability provides formal safety guarantees for nonlinear systems. However, it becomes computationally intractable in high-dimensional settings, motivating learning-based approximations that may introduce unsafe…

Systems and Control · Electrical Eng. & Systems 2026-03-27 Ebonye Smith , Sampada Deglurkar , Jingqi Li , Gechen Qu , Claire J. Tomlin

Feedforward neural networks are widely used in autonomous systems, particularly for control and perception tasks within the system loop. However, their vulnerability to adversarial attacks necessitates formal verification before deployment…

Optimization and Control · Mathematics 2025-09-03 Yuhao Zhang , Xiangru Xu

The intrinsic complexity of deep neural networks (DNNs) makes it challenging to verify not only the networks themselves but also the hosting DNN-controlled systems. Reachability analysis of these systems faces the same challenge. Existing…

Machine Learning · Computer Science 2023-11-01 Jiaxu Tian , Dapeng Zhi , Si Liu , Peixin Wang , Guy Katz , Min Zhang

Providing formal safety and performance guarantees for autonomous systems is becoming increasingly important. Hamilton-Jacobi (HJ) reachability analysis is a popular formal verification tool for providing these guarantees, since it can…

Robotics · Computer Science 2023-06-13 Albert Lin , Somil Bansal

Neural networks hold great potential to act as approximate models of nonlinear dynamical systems, with the resulting neural approximations enabling verification and control of such systems. However, in safety-critical contexts, the use of…

Machine Learning · Computer Science 2025-09-30 Frederik Baymler Mathiesen , Nikolaus Vertovec , Francesco Fabiano , Luca Laurenti , Alessandro Abate

Reinforcement learning (RL) for reachability specifications is fundamental in sequential decision-making, yet theoretical guarantees remain less explored. A recent work achieves asymptotic convergence to optimal policies. However, this…

Machine Learning · Computer Science 2026-05-26 Amogh Palasamudram , Jakub Svoboda , Suguman Bansal , Krishnendu Chatterjee

Reachability analysis is a popular method to give safety guarantees for stochastic cyber-physical systems (SCPSs) that takes in a symbolic description of the system dynamics and uses set-propagation methods to compute an overapproximation…

Robotics · Computer Science 2024-07-17 Navid Hashemi , Lars Lindemann , Jyotirmoy V. Deshmukh

Efficiently handling time-triggered and possibly nondeterministic switches for hybrid systems reachability is a challenging task. In this paper we present an approach based on conservative set-based enclosure of the dynamics that can handle…

Systems and Control · Electrical Eng. & Systems 2022-07-07 Marcelo Forets , Daniel Freire , Christian Schilling

Safety is one of the main challenges in applying reinforcement learning to realistic environmental tasks. To ensure safety during and after training process, existing methods tend to adopt overly conservative policy to avoid unsafe…

Machine Learning · Computer Science 2023-06-27 Xiao Zhang , Hai Zhang , Hongtu Zhou , Chang Huang , Di Zhang , Chen Ye , Junqiao Zhao

Graph Neural Networks (GNNs) have gained popularity in numerous domains, yet they are vulnerable to backdoor attacks that can compromise their performance and ethical application. The detection of these attacks is crucial for maintaining…

Machine Learning · Computer Science 2026-05-12 Jane Downer , Ren Wang , Binghui Wang

Autonomous spacecraft docking requires control policies that simultaneously ensure collision avoidance and target reachability under coupled, high-dimensional translational-rotational dynamics. Hamilton-Jacobi (HJ) reachability provides…

Robotics · Computer Science 2026-05-05 Santiago Thorup , Luca Castelletto , Zeyuan Feng , Somil Bansal

Robustness verification that aims to formally certify the prediction behavior of neural networks has become an important tool for understanding model behavior and obtaining safety guarantees. However, previous methods can usually only…

Machine Learning · Computer Science 2020-12-24 Zhouxing Shi , Huan Zhang , Kai-Wei Chang , Minlie Huang , Cho-Jui Hsieh

Neural networks have achieved state-of-the-art performance in solving many problems, including many applications in safety/security-critical systems. Researchers also discovered multiple security issues associated with neural networks. One…

Cryptography and Security · Computer Science 2022-05-17 Long H. Pham , Jun Sun

Over the last decade, Neural Networks (NNs) have been widely used in numerous applications including safety-critical ones such as autonomous systems. Despite their emerging adoption, it is well known that NNs are susceptible to Adversarial…

Machine Learning · Computer Science 2022-07-19 Dor Cohen , Ofer Strichman

Recently backdoor attack has become an emerging threat to the security of deep neural network (DNN) models. To date, most of the existing studies focus on backdoor attack against the uncompressed model; while the vulnerability of compressed…

Cryptography and Security · Computer Science 2022-08-24 Huy Phan , Cong Shi , Yi Xie , Tianfang Zhang , Zhuohang Li , Tianming Zhao , Jian Liu , Yan Wang , Yingying Chen , Bo Yuan

Reinforcement learning (RL) is capable of sophisticated motion planning and control for robots in uncertain environments. However, state-of-the-art deep RL approaches typically lack safety guarantees, especially when the robot and…

Robotics · Computer Science 2022-11-22 Mahmoud Selim , Amr Alanwar , Shreyas Kousik , Grace Gao , Marco Pavone , Karl H. Johansson

Many current autonomous systems are being designed with a strong reliance on black box predictions from deep neural networks (DNNs). However, DNNs tend to be overconfident in predictions on unseen data and can give unpredictable results for…

Robotics · Computer Science 2019-03-04 Björn Lütjens , Michael Everett , Jonathan P. How

Recurrent neural networks (RNNs) have emerged as an effective representation of control policies in sequential decision-making problems. However, a major drawback in the application of RNN-based policies is the difficulty in providing…

Artificial Intelligence · Computer Science 2020-02-14 Steven Carr , Nils Jansen , Ufuk Topcu

Deep neural networks (DNN) are increasingly being used to learn controllers due to their excellent approximation capabilities. However, their black-box nature poses significant challenges to closed-loop stability guarantees and performance…

Robotics · Computer Science 2024-09-13 Jiajun Qian , Liang Xu , Xiaoqiang Ren , Xiaofan Wang