English
Related papers

Related papers: Reachable Polyhedral Marching (RPM): A Safety Veri…

200 papers

We present a path planning framework that takes into account the human's safety perception in the presence of a flying robot. The framework addresses two objectives: (i) estimation of the uncertain parameters of the proposed safety…

ACAS Xu is an air-to-air collision avoidance system designed for unmanned aircraft that issues horizontal turn advisories to avoid an intruder aircraft. Due the use of a large lookup table in the design, a neural network compression of the…

Numerical Analysis · Mathematics 2022-06-28 Stanley Bak , Hoang-Dung Tran

Reachability analysis provides formal guarantees for performance and safety properties of nonlinear control systems. Here, one aims to compute the backward reachable set (BRS) or tube (BRT) -- the set of states from which the system can be…

Optimization and Control · Mathematics 2017-07-18 Mo Chen , Sylvia L. Herbert , Mahesh S. Vashishtha , Somil Bansal , Claire J. Tomlin

Neural networks achieve outstanding accuracy in classification and regression tasks. However, understanding their behavior still remains an open challenge that requires questions to be addressed on the robustness, explainability and…

Machine Learning · Computer Science 2021-05-13 Anna-Kathrin Kopetzki , Stephan Günnemann

Neural networks are now extensively used in perception, prediction and control of autonomous systems. Their deployment in safety-critical systems brings forth the need for verification techniques for such networks. As an alternative to…

Artificial Intelligence · Computer Science 2021-04-27 Moumita Das , Rajarshi Ray , Swarup Kumar Mohalik , Ansuman Banerjee

In many real-world reinforcement learning (RL) problems, besides optimizing the main objective function, an agent must concurrently avoid violating a number of constraints. In particular, besides optimizing performance it is crucial to…

Machine Learning · Computer Science 2018-05-22 Yinlam Chow , Ofir Nachum , Edgar Duenez-Guzman , Mohammad Ghavamzadeh

Safe reinforcement learning (RL) that solves constraint-satisfactory policies provides a promising way to the broader safety-critical applications of RL in real-world problems such as robotics. Among all safe RL approaches, model-based…

Robotics · Computer Science 2022-10-17 Dongjie Yu , Wenjun Zou , Yujie Yang , Haitong Ma , Shengbo Eben Li , Jingliang Duan , Jianyu Chen

Reachable set computation is an important technique for the verification of safety properties of dynamical systems. In this paper, we investigate reachable set computation for discrete nonlinear systems based on parallelotope bundles. The…

Systems and Control · Electrical Eng. & Systems 2021-07-08 Edward Kim , Stanley Bak , Parasara Sridhar Duggirala

Deep Neural Networks (DNNs) have grown in popularity over the past decade and are now being used in safety-critical domains such as aircraft collision avoidance. This has motivated a large number of techniques for finding unsafe behavior in…

Machine Learning · Computer Science 2021-04-27 Matthew Sotoudeh , Aditya V. Thakur

Neural networks (NNs) are increasingly applied in safety-critical systems such as autonomous vehicles. However, they are fragile and are often ill-behaved. Consequently, their behaviors should undergo rigorous guarantees before deployment…

Artificial Intelligence · Computer Science 2022-10-11 Zhen Liang , Dejin Ren , Wanwei Liu , Ji Wang , Wenjing Yang , Bai Xue

Reachability analysis is a formal method to guarantee safety of dynamical systems under the influence of uncertainties. A substantial bottleneck of all reachability algorithms is the necessity to adequately tune specific algorithm…

Numerical Analysis · Mathematics 2024-02-23 Mark Wetzlinger , Niklas Kochdumper , Stanley Bak , Matthias Althoff

We improve the effectiveness of propagation- and linear-optimization-based neural network verification algorithms with a new tightened convex relaxation for ReLU neurons. Unlike previous single-neuron relaxations which focus only on the…

Machine Learning · Computer Science 2020-10-26 Christian Tjandraatmadja , Ross Anderson , Joey Huchette , Will Ma , Krunal Patel , Juan Pablo Vielma

A chaotic system is a highly volatile system characterized by its sensitive dependence on initial conditions and outside factors. Chaotic systems are prevalent throughout the world today: in weather patterns, disease outbreaks, and even…

Deep Reinforcement Learning (DRL) has made significant advancements in various fields, such as autonomous driving, healthcare, and robotics, by enabling agents to learn optimal policies through interactions with their environments. However,…

Machine Learning · Computer Science 2026-02-06 Amirhossein Zolfagharian , Manel Abdellatif , Lionel C. Briand , Ramesh S

Recently, formal verification of deep neural networks (DNNs) has garnered considerable attention, and over-approximation based methods have become popular due to their effectiveness and efficiency. However, these strategies face challenges…

Artificial Intelligence · Computer Science 2024-01-24 Zhen Liang , Taoran Wu , Ran Zhao , Bai Xue , Ji Wang , Wenjing Yang , Shaojun Deng , Wanwei Liu

Deep neural networks have achieved impressive experimental results in image classification, but can surprisingly be unstable with respect to adversarial perturbations, that is, minimal changes to the input image that cause the network to…

Artificial Intelligence · Computer Science 2017-05-08 Xiaowei Huang , Marta Kwiatkowska , Sen Wang , Min Wu

In this paper, we observe that current models are susceptible to reward hacking, leading to a substantial overestimation of a model's reasoning ability. This is evidenced by a high incidence of false positives-solutions that reach the…

Computation and Language · Computer Science 2026-04-20 Youliang Yuan , Qiuyang Mang , Jingbang Chen , Hong Wan , Xiaoyuan Liu , Junjielong Xu , Jen-tse Huang , Wenxuan Wang , Wenxiang Jiao , Pinjia He

The driving risk field is applicable to more complex driving scenarios, providing new approaches for safety decision-making and active vehicle control in intricate environments. However, existing research often overlooks the driving risk…

Systems and Control · Electrical Eng. & Systems 2025-05-22 Wenjie Huang , Yang Li , Shijie Yuan , Jingjia Teng , Hongmao Qin , Yougang Bian

A constant-rate multi-mode system is a hybrid system that can switch freely among a finite set of modes, and whose dynamics is specified by a finite number of real-valued variables with mode-dependent constant rates. Alur, Wojtczak, and…

Logic in Computer Science · Computer Science 2017-07-14 Shankara Narayanan Krishna , Aviral Kumar , Fabio Somenzi , Behrouz Touri , Ashutosh Trivedi

In this paper, we study the robustness of safety properties of a linear dynamical system with respect to model uncertainties. Our paper involves three parts. In the first part, we provide symbolic (analytical) and numerical (representation…

Systems and Control · Electrical Eng. & Systems 2021-09-17 Bineet Ghosh , Parasara Sridhar Duggirala