English
Related papers

Related papers: Formal Verification of Stochastic Systems with ReL…

200 papers

Ensuring correctness of timed behaviors in cyber-physical systems (CPS) using closed-loop verification is challenging due to the hybrid dynamics in both systems and environments. Simulink and Stateflow are tools for model-based design that…

Software Engineering · Computer Science 2019-11-01 Li Huang , Eun-Young Kang

This paper studies the satisfaction of a class of temporal properties for cyber-physical systems (CPSs) over a finite-time horizon in the presence of an adversary, in an environment described by discrete-time dynamics. The temporal logic…

Systems and Control · Electrical Eng. & Systems 2019-10-29 Bhaskar Ramasubramanian , Luyao Niu , Andrew Clark , Linda Bushnell , Radha Poovendran

This paper addresses the problem of risk-aware fixed-time stabilization of a class of uncertain, output-feedback nonlinear systems modeled via stochastic differential equations. First, novel classes of certificate functions, namely…

Optimization and Control · Mathematics 2024-04-01 Mitchell Black , Georgios Fainekos , Bardh Hoxha , Dimitra Panagou

Safety-critical control using high-dimensional sensory feedback from optical data (e.g., images, point clouds) poses significant challenges in domains like autonomous driving and robotic surgery. Control can rely on low-dimensional states…

Semantic segmentation networks (SSNs) are central to safety-critical applications such as medical imaging and autonomous driving, where robustness under uncertainty is essential. However, existing probabilistic verification methods often…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Navid Hashemi , Samuel Sasaki , Diego Manzanas Lopez , Lars Lindemann , Ipek Oguz , Meiyi Ma , Taylor T. Johnson

We present a simulation-based approach for generating barrier certificate functions for safety verification of cyber-physical systems (CPS) that contain neural network-based controllers. A linear programming solver is utilized to find a…

Systems and Control · Computer Science 2018-04-12 Cumhur Erkan Tuncali , James Kapinski , Hisahiro Ito , Jyotirmoy V. Deshmukh

We study the problem of learning controllers for discrete-time non-linear stochastic dynamical systems with formal reach-avoid guarantees. This work presents the first method for providing formal reach-avoid guarantees, which combine and…

Machine Learning · Computer Science 2022-11-30 Đorđe Žikelić , Mathias Lechner , Thomas A. Henzinger , Krishnendu Chatterjee

The growing complexity of modern Cyber-Physical Systems (CPS) and the frequent communication between their components make them vulnerable to malicious attacks. As a result, secure state estimation is a critical requirement for the control…

Optimization and Control · Mathematics 2020-10-09 Xusheng Luo , Miroslav Pajic , Michael M. Zavlanos

Many Cyber Physical System (CPS) work in a safety-critical environment, where correct execution, reliability and trustworthiness are essential. Signal Temporal Logic (STL) provides a formal framework for checking safety-critical CPS.…

Formal Languages and Automata Theory · Computer Science 2026-03-27 Partha Roop , Sobhan Chatterjee , Avinash Malik , Nathan Allen , Logan Kenwright

Reinforcement learning (RL) methods have demonstrated their efficiency in simulation environments. However, many applications for which RL offers great potential, such as autonomous driving, are also safety critical and require a certified…

Systems and Control · Electrical Eng. & Systems 2021-01-19 Kim P. Wabersich , Lukas Hewing , Andrea Carron , Melanie N. Zeilinger

The vulnerability of artificial intelligence (AI) and machine learning (ML) against adversarial disturbances and attacks significantly restricts their applicability in safety-critical systems including cyber-physical systems (CPS) equipped…

Systems and Control · Electrical Eng. & Systems 2020-04-28 Weiming Xiang , Hoang-Dung Tran , Xiaodong Yang , Taylor T. Johnson

Cyber-Physical Systems (CPS) pose new challenges to verification and validation that go beyond the proof of functional correctness based on high-level models. Particular challenges are, in particular for formal methods, its heterogeneity…

Software Engineering · Computer Science 2017-05-02 Carna Radojicic , Christoph Grimm , Axel Jantsch , Michael Rathmair

This paper studies the problem of enforcing safety of a stochastic dynamical system over a finite-time horizon. We use stochastic control barrier functions as a means to quantify the probability that a system exits a given safe region of…

Systems and Control · Electrical Eng. & Systems 2019-09-12 Cesar Santoyo , Maxence Dutreix , Samuel Coogan

Verification of neural networks enables us to gauge their robustness against adversarial attacks. Verification algorithms fall into two categories: exact verifiers that run in exponential time and relaxed verifiers that are efficient but…

Machine Learning · Computer Science 2020-01-13 Hadi Salman , Greg Yang , Huan Zhang , Cho-Jui Hsieh , Pengchuan Zhang

Since graph neural networks (GNNs) are often vulnerable to attack, we need to know when we can trust them. We develop a computationally effective approach towards providing robust certificates for message-passing neural networks (MPNNs)…

Optimization and Control · Mathematics 2024-05-22 Christopher Hojny , Shiqiang Zhang , Juan S. Campos , Ruth Misener

We present ResilienC, a framework for resilient control of Cyber-Physical Systems subject to STL-based requirements. ResilienC utilizes a recently developed formalism for specifying CPS resiliency in terms of sets of…

Systems and Control · Electrical Eng. & Systems 2023-01-02 Hongkai Chen , Scott A. Smolka , Nicola Paoletti , Shan Lin

The goal of this paper is to analyze Long Short Term Memory (LSTM) neural networks from a dynamical system perspective. The classical recursive equations describing the evolution of LSTM can be recast in state space form, resulting in a…

Systems and Control · Electrical Eng. & Systems 2020-05-29 Fabio Bonassi , Enrico Terzi , Marcello Farina , Riccardo Scattolini

A novel data-driven method for formal verification is proposed to study complex systems operating in safety-critical domains. The proposed approach is able to formally verify discrete-time stochastic dynamical systems against temporal logic…

Systems and Control · Electrical Eng. & Systems 2024-03-11 Zhi Zhang , Chenyu Ma , Saleh Soudijani , Sadegh Soudjani

In this paper, we consider the problem of repairing a data-trained Rectified Linear Unit (ReLU) Neural Network (NN) controller for a discrete-time, input-affine system. That is we assume that such a NN controller is available, and we seek…

Machine Learning · Computer Science 2021-04-08 Ulices Santa Cruz , James Ferlez , Yasser Shoukry

Control applications for cyber-physical systems must make reliably safe control decisions in the presence of continuous dynamics as well as stochastic uncertainty. Providing safety guarantees for such systems requires formal modeling and…

Formal Languages and Automata Theory · Computer Science 2026-04-28 Joanna Delicaris , Erika Ábrahám , Anne Remke