中文
相关论文

相关论文: Policy Verification in Stochastic Dynamical System…

200 篇论文

In this work, we address the problem of formal safety verification for stochastic cyber-physical systems (CPS) equipped with ReLU neural network (NN) controllers. Our goal is to find the set of initial states from where, with a…

系统与控制 · 电气工程与系统科学 2021-03-10 Shiqi Sun , Yan Zhang , Xusheng Luo , Panagiotis Vlantis , Miroslav Pajic , Michael M. Zavlanos

Partially-Observable Markov Decision Processes (POMDPs) are a well-known stochastic model for sequential decision making under limited information. We consider the EXPTIME-hard problem of synthesising policies that almost-surely reach some…

人工智能 · 计算机科学 2021-03-22 Sebastian Junges , Nils Jansen , Sanjit A. Seshia

We consider the problem of computing reachable sets directly from noisy data without a given system model. Several reachability algorithms are presented for different types of systems generating the data. First, an algorithm for computing…

系统与控制 · 电气工程与系统科学 2023-03-14 Amr Alanwar , Anne Koch , Frank Allgöwer , Karl Henrik Johansson

This paper presents Verisig, a hybrid system approach to verifying safety properties of closed-loop systems using neural networks as controllers. Although techniques exist for verifying input/output properties of the neural network itself,…

系统与控制 · 计算机科学 2018-11-06 Radoslav Ivanov , James Weimer , Rajeev Alur , George J. Pappas , Insup Lee

Extracting dynamic models from data is of enormous importance in understanding the properties of unknown systems. In this work, we employ Lipschitz neural networks, a class of neural networks with a prescribed upper bound on their Lipschitz…

系统与控制 · 电气工程与系统科学 2025-08-21 Shiqing Wei , Prashanth Krishnamurthy , Farshad Khorrami

Neural networks have become increasingly popular in controller design due to their versatility and efficiency. However, their integration into feedback systems can pose stability challenges, particularly in the presence of uncertainties.…

最优化与控制 · 数学 2025-03-04 Yuhao Zhang , Xiangru Xu

Ensuring safety in autonomous systems with vision-based control remains a critical challenge due to the high dimensionality of image inputs and the fact that the relationship between true system state and its visual manifestation is…

机器人学 · 计算机科学 2025-11-12 Xinhang Ma , Junlin Wu , Hussein Sibai , Yiannis Kantaros , Yevgeniy Vorobeychik

We study the safety verification problem for discrete-time stochastic systems. We propose an approach for safety verification termed set-erosion strategy that verifies the safety of a stochastic system on a safe set through the safety of…

系统与控制 · 电气工程与系统科学 2024-10-04 Zishun Liu , Saber Jafarpour , Yongxin Chen

Deep Reinforcement Learning (DRL) has achieved impressive performance in robotics and autonomous systems (RAS). A key challenge to its deployment in real-life operations is the presence of spuriously unsafe DRL policies. Unexplored states…

机器人学 · 计算机科学 2024-01-31 Yi Dong , Xingyu Zhao , Sen Wang , Xiaowei Huang

As control systems become increasingly more complex, there exists a pressing need to find systematic ways of verifying them. To address this concern, there has been significant work in developing test generation schemes for black-box…

系统与控制 · 电气工程与系统科学 2020-09-29 Prithvi Akella , Ugo Rosolia , Andrew Singletary , Aaron D. Ames

Text classifiers suffer from small perturbations, that if chosen adversarially, can dramatically change the output of the model. Verification methods can provide robustness certificates against such adversarial perturbations, by computing a…

机器学习 · 计算机科学 2025-02-21 Elias Abad Rocamora , Grigorios G. Chrysos , Volkan Cevher

We consider the problem of training a deep neural network with nonsmooth regularization to retrieve a sparse and efficient sub-structure. Our regularizer is only assumed to be lower semi-continuous and prox-bounded. We combine an adaptive…

机器学习 · 统计学 2022-06-20 Dounia Lakhmiri , Dominique Orban , Andrea Lodi

Robustness of deep neural networks against adversarial perturbations is a pressing concern motivated by recent findings showing the pervasive nature of such vulnerabilities. One method of characterizing the robustness of a neural network…

机器学习 · 统计学 2021-03-15 Hisham Husain , Borja Balle

Ensuring string stability is critical for the safety and efficiency of large-scale interconnected systems. Although learning-based controllers (e.g., those based on reinforcement learning) have demonstrated strong performance in complex…

系统与控制 · 电气工程与系统科学 2025-09-15 Jingyuan Zhou , Haoze Wu , Haokun Yu , Kaidi Yang

This paper proposes a theoretical and computational framework for training and robustness verification of implicit neural networks based upon non-Euclidean contraction theory. The basic idea is to cast the robustness analysis of a neural…

机器学习 · 计算机科学 2022-08-09 Saber Jafarpour , Alexander Davydov , Matthew Abate , Francesco Bullo , Samuel Coogan

Stability certification and identifying a safe and stabilizing initial set are two important concerns in ensuring operational safety, stability, and robustness of dynamical systems. With the advent of machine-learning tools, these issues…

机器学习 · 计算机科学 2022-09-01 Soumyabrata Talukder , Ratnesh Kumar

This paper introduces a new proximal stochastic gradient method with variance reduction and stabilization for minimizing the sum of a convex stochastic function and a group sparsity-inducing regularization function. Since the method may be…

最优化与控制 · 数学 2023-02-15 Yutong Dai , Guanyi Wang , Frank E. Curtis , Daniel P. Robinson

While reachability analysis is one of the most promising approaches for formal verification of dynamic systems, a major disadvantage preventing a more widespread application is the requirement to manually tune algorithm parameters such as…

计算机科学中的逻辑 · 计算机科学 2024-04-09 Niklas Kochdumper , Stanley Bak

Reach-avoid optimal control problems, in which the system must reach certain goal conditions while staying clear of unacceptable failure modes, are central to safety and liveness assurance for autonomous robotic systems, but their exact…

机器学习 · 计算机科学 2022-01-25 Kai-Chieh Hsu , Vicenç Rubies-Royo , Claire J. Tomlin , Jaime F. Fisac

Continuous-time Markov decision processes are an important class of models in a wide range of applications, ranging from cyber-physical systems to synthetic biology. A central problem is how to devise a policy to control the system in order…

系统与控制 · 计算机科学 2016-06-01 Ezio Bartocci , Luca Bortolussi , Tomǎš Brázdil , Dimitrios Milios , Guido Sanguinetti