English
Related papers

Related papers: Policy Verification in Stochastic Dynamical System…

200 papers

We present a novel technique for online safety verification of autonomous systems, which performs reachability analysis efficiently for both bounded and unbounded horizons by employing neural barrier certificates. Our approach uses barrier…

Systems and Control · Electrical Eng. & Systems 2024-04-30 Alessandro Abate , Sergiy Bogomolov , Alec Edwards , Kostiantyn Potomkin , Sadegh Soudjani , Paolo Zuliani

This paper focuses on synthesizing control policies for discrete-time stochastic control systems together with a lower bound on the probability that the systems satisfy the complex temporal properties. The desired properties of the system…

Systems and Control · Electrical Eng. & Systems 2020-08-07 Pushpak Jagtap , Sadegh Soudjani , Majid Zamani

Stochastic dynamical systems have emerged as fundamental models across numerous application domains, providing powerful mathematical representations for capturing uncertain system behavior. In this paper, we address the problem of runtime…

Systems and Control · Electrical Eng. & Systems 2025-11-13 Shenghua Feng , Jie An , Fanjiang Xu

Data-driven reachability analysis computes over-approximations of reachable sets directly from noisy data. Existing deterministic methods require either known noise bounds or system-specific structural parameters such as Lipschitz…

Systems and Control · Electrical Eng. & Systems 2026-03-17 Yanliang Huang , Zhen Zhang , Peng Xie , Zhuoqi Zeng , Amr Alanwar

The Lipschitz constant of the map between the input and output space represented by a neural network is a natural metric for assessing the robustness of the model. We present a new method to constrain the Lipschitz constant of dense deep…

Machine Learning · Computer Science 2023-08-22 Ouail Kitouni , Niklas Nolte , Mike Williams

This paper investigates necessary and sufficient barrier-like conditions for infinite-horizon safety and reach-avoid verification of stochastic discrete-time systems, derived via a relaxation of the Bellman equations. Unlike prior…

Systems and Control · Electrical Eng. & Systems 2026-01-06 Bai Xue

Reachability analysis of neural networks, which seeks to compute or bound the set of outputs attainable over a given input domain, is central to certifying safety and robustness in learning-enabled physical systems. Since exact reachable…

Machine Learning · Computer Science 2026-05-12 Taha Entesari , Mahyar Fazlyab

This paper addresses the computation of controlled reach-avoid sets (CRASs) for discrete-time polynomial systems subject to control inputs. A CRAS is a set encompassing initial states from which there exist control inputs driving the system…

Systems and Control · Electrical Eng. & Systems 2025-06-10 Taoran Wu , Yiling Xue , Dejin Ren , Arvind Easwaran , Martin Fränzle , Bai Xue

This paper develops an approach to learn a policy of a dynamical system that is guaranteed to be both provably safe and goal-reaching. Here, the safety means that a policy must not drive the state of the system to any unsafe region, while…

Systems and Control · Electrical Eng. & Systems 2020-06-16 Wanxin Jin , Zhaoran Wang , Zhuoran Yang , Shaoshuai Mou

This paper addresses the quantitative verification of finite-time constrained occupation time for stochastic continuous-time systems governed by stochastic differential equations (SDEs). Unlike classical reachability analysis, which focuses…

Systems and Control · Electrical Eng. & Systems 2026-04-22 Bai Xue , C. -H. Luke Ong

Despite the promise of Lipschitz-based methods for provably-robust deep learning with deterministic guarantees, current state-of-the-art results are limited to feed-forward Convolutional Networks (ConvNets) on low-dimensional data, such as…

Machine Learning · Computer Science 2023-10-31 Kai Hu , Andy Zou , Zifan Wang , Klas Leino , Matt Fredrikson

The study of provable adversarial robustness for deep neural networks (DNNs) has mainly focused on static supervised learning tasks such as image classification. However, DNNs have been used extensively in real-world adaptive tasks such as…

Machine Learning · Computer Science 2022-05-31 Aounon Kumar , Alexander Levine , Soheil Feizi

Deep reinforcement learning has been successfully applied to many control tasks, but the application of such agents in safety-critical scenarios has been limited due to safety concerns. Rigorous testing of these controllers is challenging,…

Artificial Intelligence · Computer Science 2020-07-09 Edoardo Bacci , David Parker

We investigate stochastic averaging theory for locally Lipschitz discrete-time nonlinear systems with stochastic perturbation and its applications to convergence analysis of discrete-time stochastic extremum seeking algorithms. Firstly, by…

Optimization and Control · Mathematics 2015-02-18 Shu-Jun Liu , Miroslav Krstic

Ensuring safety of nonlinear systems under model uncertainty and external disturbances is crucial, especially for real-world control tasks. Predictive methods such as robust model predictive control (RMPC) require solving nonconvex…

Systems and Control · Electrical Eng. & Systems 2023-11-14 Zeyang Li , Chuxiong Hu , Weiye Zhao , Changliu Liu

The global Lipschitz constant of a neural network is related to robustness and generalization, yet unlike in many classical models, it is not plainly legible from the parameters. This has motivated sophisticated verification algorithms,…

Machine Learning · Computer Science 2026-05-11 Simon Kuang , Yuezhu Xu , S. Sivaranjani , Xinfan Lin

Certifiable robustness gives the guarantee that small perturbations around an input to a classifier will not change the prediction. There are two approaches to provide certifiable robustness to adversarial examples: a) explicitly training…

Machine Learning · Computer Science 2025-08-04 Meiyu Zhong , Ravi Tandon

A robustness certificate is the minimum distance of a given input to the decision boundary of the classifier (or its lower bound). For {\it any} input perturbations with a magnitude smaller than the certificate value, the classification…

Machine Learning · Computer Science 2020-06-02 Sahil Singla , Soheil Feizi

Reinforcement Learning (RL) has achieved remarkable success in safety-critical areas, but it can be weakened by adversarial attacks. Recent studies have introduced "smoothed policies" in order to enhance its robustness. Yet, it is still…

Machine Learning · Computer Science 2023-12-13 Ronghui Mu , Leandro Soriano Marcolino , Tianle Zhang , Yanghao Zhang , Xiaowei Huang , Wenjie Ruan

Lipschitz Bound Estimation is an effective method of regularizing deep neural networks to make them robust against adversarial attacks. This is useful in a variety of applications ranging from reinforcement learning to autonomous systems.…

Machine Learning · Computer Science 2022-07-18 Sarosij Bose