English
Related papers

Related papers: Constraint-Aware Refinement for Safety Verificatio…

200 papers

Reachability analysis has been a prominent way to provide safety guarantees for neurally controlled autonomous systems, but its direct application to neural perception components is infeasible due to imperfect or intractable perception…

Systems and Control · Electrical Eng. & Systems 2026-04-27 Yuang Geng , Thomas Waite , Trevor Turnquist , Radoslav Ivanov , Ivan Ruchkin

Artificial neural networks have recently been utilized in many feedback control systems and introduced new challenges regarding the safety of such systems. This paper considers the safe verification problem for a dynamical system with a…

Optimization and Control · Mathematics 2023-01-25 Yuhao Zhang , Xiangru Xu

Deep Neural Networks (DNNs) are powerful tools that have shown extraordinary results in many scenarios, ranging from pattern recognition to complex robotic problems. However, their intricate designs and lack of transparency raise safety…

Artificial Intelligence · Computer Science 2023-12-12 Luca Marzari , Gabriele Roncolato , Alessandro Farinelli

A runtime assurance system (RTA) for a given plant enables the exercise of an untrusted or experimental controller while assuring safety with a backup (or safety) controller. The relevant computational design problem is to create a logic…

Systems and Control · Electrical Eng. & Systems 2023-10-09 Kristina Miller , Christopher K. Zeitler , William Shen , Kerianne Hobbs , Sayan Mitra , John Schierman , Mahesh Viswanathan

Recently, formal verification of deep neural networks (DNNs) has garnered considerable attention, and over-approximation based methods have become popular due to their effectiveness and efficiency. However, these strategies face challenges…

Artificial Intelligence · Computer Science 2024-01-24 Zhen Liang , Taoran Wu , Ran Zhao , Bai Xue , Ji Wang , Wenjing Yang , Shaojun Deng , Wanwei Liu

This paper proposes a computationally efficient framework, based on interval analysis, for rigorous verification of nonlinear continuous-time dynamical systems with neural network controllers. Given a neural network, we use an existing…

Systems and Control · Electrical Eng. & Systems 2023-08-08 Saber Jafarpour , Akash Harapanahalli , Samuel Coogan

Learning-based neural network (NN) control policies have shown impressive empirical performance in a wide range of tasks in robotics and control. However, formal (Lyapunov) stability guarantees over the region-of-attraction (ROA) for NN…

Machine Learning · Computer Science 2024-06-06 Lujie Yang , Hongkai Dai , Zhouxing Shi , Cho-Jui Hsieh , Russ Tedrake , Huan Zhang

Neural networks achieve outstanding accuracy in classification and regression tasks. However, understanding their behavior still remains an open challenge that requires questions to be addressed on the robustness, explainability and…

Machine Learning · Computer Science 2021-05-13 Anna-Kathrin Kopetzki , Stephan Günnemann

In this paper, we present a contraction-guided adaptive partitioning algorithm for improving interval-valued robust reachable set estimates in a nonlinear feedback loop with a neural network controller and disturbances. Based on an estimate…

Systems and Control · Electrical Eng. & Systems 2024-01-23 Akash Harapanahalli , Saber Jafarpour , Samuel Coogan

Reachability analysis is a formal method to guarantee safety of dynamical systems under the influence of uncertainties. A substantial bottleneck of all reachability algorithms is the necessity to adequately tune specific algorithm…

Numerical Analysis · Mathematics 2024-02-23 Mark Wetzlinger , Niklas Kochdumper , Stanley Bak , Matthias Althoff

Model-based reinforcement learning (RL) has emerged as a promising tool for developing controllers for real world systems (e.g., robotics, autonomous driving, etc.). However, real systems often have constraints imposed on their state space…

Machine Learning · Computer Science 2020-10-22 Akshita Gupta , Inseok Hwang

Deep neural networks can be trained to be efficient and effective controllers for dynamical systems; however, the mechanics of deep neural networks are complex and difficult to guarantee. This work presents a general approach for providing…

Systems and Control · Computer Science 2019-06-05 Kyle D. Julian , Mykel J. Kochenderfer

Learning-based methods could provide solutions to many of the long-standing challenges in control. However, the neural networks (NNs) commonly used in modern learning approaches present substantial challenges for analyzing the resulting…

Machine Learning · Computer Science 2022-02-03 Michael Everett

One often wishes for the ability to formally analyze large-scale systems---typically, however, one can either formally analyze a rather small system or informally analyze a large-scale system. This work tries to further close this…

Numerical Analysis · Mathematics 2020-08-06 Matthias Althoff

Virtual Network Embedding (VNE) is a fundamental resource allocation challenge that is associated with hard and multifaceted constraints in network function virtualization (NFV). Existing works for VNE struggle to handle such complex…

Networking and Internet Architecture · Computer Science 2025-07-28 Tianfu Wang , Long Yang , Chao Wang , Chuan Qin , Liwei Deng , Wei Wu , Junyang Wang , Li Shen , Hui Xiong

Neural solvers have achieved impressive progress in addressing simple routing problems, particularly excelling in computational efficiency. However, their advantages under complex constraints remain nascent, for which current…

Artificial Intelligence · Computer Science 2026-02-19 Jieyi Bi , Zhiguang Cao , Jianan Zhou , Wen Song , Yaoxin Wu , Jie Zhang , Yining Ma , Cathy Wu

In this paper, the output reachable estimation and safety verification problems for multi-layer perceptron neural networks are addressed. First, a conception called maximum sensitivity in introduced and, for a class of multi-layer…

Machine Learning · Computer Science 2018-02-21 Weiming Xiang , Hoang-Dung Tran , Taylor T. Johnson

Learning-enabled planning and control algorithms are increasingly popular, but they often lack rigorous guarantees of performance or safety. We introduce an algorithm for computing underapproximate backward reachable sets of nonlinear…

Artificial Intelligence · Computer Science 2025-05-07 Chelsea Sidrane , Jana Tumova

We present a novel technique for online safety verification of autonomous systems, which performs reachability analysis efficiently for both bounded and unbounded horizons by employing neural barrier certificates. Our approach uses barrier…

Systems and Control · Electrical Eng. & Systems 2024-04-30 Alessandro Abate , Sergiy Bogomolov , Alec Edwards , Kostiantyn Potomkin , Sadegh Soudjani , Paolo Zuliani

Convolutional neural networks (CNNs) have become an established part of numerous safety-critical computer vision applications, including human robot interactions and automated driving. Real-world implementations will need to guarantee their…