English
Related papers

Related papers: Reachable Polyhedral Marching (RPM): A Safety Veri…

200 papers

The increasing prevalence of neural networks (NNs) in safety-critical applications calls for methods to certify their behavior and guarantee safety. This paper presents a backward reachability approach for safety verification of neural…

Systems and Control · Electrical Eng. & Systems 2022-11-22 Nicholas Rober , Michael Everett , Jonathan P. How

This paper aims to enhance the computational efficiency of safety verification of neural network control systems by developing a guaranteed neural network model reduction method. First, a concept of model reduction precision is proposed to…

Machine Learning · Computer Science 2023-01-19 Weiming Xiang , Zhongzhu Shao

In this work, we analyze an efficient sampling-based algorithm for general-purpose reachability analysis, which remains a notoriously challenging problem with applications ranging from neural network verification to safety analysis of…

Systems and Control · Electrical Eng. & Systems 2022-04-15 Thomas Lew , Lucas Janson , Riccardo Bonalli , Marco Pavone

The next generation of aircraft collision avoidance systems frame the problem as a Markov decision process and use dynamic programming to optimize the alerting logic. The resulting system uses a large lookup table to determine advisories…

Systems and Control · Computer Science 2019-03-05 Kyle D. Julian , Shivam Sharma , Jean-Baptiste Jeannin , Mykel J. Kochenderfer

Theoretical analyses of Empirical Risk Minimization (ERM) are standardly framed within the Real-RAM model of computation. In this setting, training even simple neural networks is known to be $\exists \mathbb{R}$-complete -- a complexity…

Machine Learning · Computer Science 2026-02-24 Ilan Doron-Arad , Elchanan Mossel

Deep neural network with rectified linear units (ReLU) is getting more and more popular recently. However, the derivatives of the function represented by a ReLU network are not continuous, which limit the usage of ReLU network to situations…

Machine Learning · Computer Science 2020-12-03 Bo Li , Shanshan Tang , Haijun Yu

Generating safe motion plans in real-time is a key requirement for deploying robot manipulators to assist humans in collaborative settings. In particular, robots must satisfy strict safety requirements to avoid self-damage or harming nearby…

Robotics · Computer Science 2023-02-16 Jonathan Michaux , Qingyi Chen , Yongseok Kwon , Ram Vasudevan

For robotic arms to operate in arbitrary environments, especially near people, it is critical to certify the safety of their motion planning algorithms. However, there is often a trade-off between safety and real-time performance; one can…

In this work, we perform safety analysis of linear dynamical systems with uncertainties. Instead of computing a conservative overapproximation of the reachable set, our approach involves computing a statistical approximate reachable set. As…

Systems and Control · Electrical Eng. & Systems 2021-09-17 Bineet Ghosh , Parasara Sridhar Duggirala

Ensuring safety is important for the practical deployment of reinforcement learning (RL). Various challenges must be addressed, such as handling stochasticity in the environments, providing rigorous guarantees of persistent state-wise…

Machine Learning · Computer Science 2023-09-26 Milan Ganai , Zheng Gong , Chenning Yu , Sylvia Herbert , Sicun Gao

Deterministic methods for motion planning guarantee safety amidst uncertainty in obstacle locations by trying to restrict the robot from operating in any possible location that an obstacle could be in. Unfortunately, this can result in…

Robotics · Computer Science 2023-06-21 Jinsun Liu , Challen Enninful Adu , Lucas Lymburner , Vishrut Kaushik , Lena Trang , Ram Vasudevan

Ensuring the safety of reinforcement learning (RL) algorithms is crucial to unlock their potential for many real-world tasks. However, vanilla RL and most safe RL approaches do not guarantee safety. In recent years, several methods have…

Machine Learning · Computer Science 2023-11-21 Hanna Krasowski , Jakob Thumm , Marlon Müller , Lukas Schäfer , Xiao Wang , Matthias Althoff

Over-approximating the reachable sets of dynamical systems is a fundamental problem in safety verification and robust control synthesis. The representation of these sets is a key factor that affects the computational complexity and the…

Systems and Control · Electrical Eng. & Systems 2023-05-17 Taha Entesari , Mahyar Fazlyab

Trajectory planning is challenging for autonomous cars since they operate in unpredictable environments with limited sensor horizons. To incorporate new information as it is sensed, planning is done in a loop, with the next plan being…

Systems and Control · Computer Science 2019-02-07 Sean Vaskov , Utkarsh Sharma , Shreyas Kousik , Matthew Johnson-Roberson , Ramanarayan Vasudevan

We consider the problem of predictive monitoring (PM), i.e., predicting at runtime future violations of a system from the current state. We work under the most realistic settings where only partial and noisy observations of the state are…

Machine Learning · Computer Science 2021-08-18 Francesca Cairoli , Luca Bortolussi , Nicola Paoletti

As neural networks (NNs) become more prevalent in safety-critical applications such as control of vehicles, there is a growing need to certify that systems with NN components are safe. This paper presents a set of backward reachability…

Systems and Control · Electrical Eng. & Systems 2022-11-22 Nicholas Rober , Sydney M. Katz , Chelsea Sidrane , Esen Yel , Michael Everett , Mykel J. Kochenderfer , Jonathan P. How

This paper investigates one-step backward reachability for uncertain max-plus linear systems with additive disturbances. Given a target set, the problem is to compute the set of states from which there exists an admissible control input…

Systems and Control · Electrical Eng. & Systems 2026-03-31 Yuda Li , Xiang Yin

To operate with limited sensor horizons in unpredictable environments, autonomous robots use a receding-horizon strategy to plan trajectories, wherein they execute a short plan while creating the next plan. However, creating safe,…

Robotics · Computer Science 2020-04-24 Shreyas Kousik , Sean Vaskov , Fan Bu , Matthew Johnson-Roberson , Ram Vasudevan

Planning safe motions for legged robots requires sophisticated safety verification tools. However, designing such tools for such complex systems is challenging due to the nonlinear and high-dimensional nature of these systems' dynamics. In…

Robotics · Computer Science 2022-02-28 Junhyeok Ahn , Seung Hyeon Bang , Carlos Gonzalez , Yuanchen Yuan , Luis Sentis

Deep learning methods can be used to produce control policies, but certifying their safety is challenging. The resulting networks are nonlinear and often very large. In response to this challenge, we present OVERT: a sound algorithm for…

Machine Learning · Computer Science 2023-01-06 Chelsea Sidrane , Amir Maleki , Ahmed Irfan , Mykel J. Kochenderfer