English
Related papers

Related papers: Policy Verification in Stochastic Dynamical System…

200 papers

The maximization of reach-avoid probabilities for stochastic systems is a central topic in the control literature. Yet, the available methods are either restricted to low-dimensional systems or suffer from conservative approximations. To…

Optimization and Control · Mathematics 2026-01-26 Niklas Schmid , Jaeyoun Choi , Oswin So , Chuchu Fan

We show that Neural ODEs, an emerging class of time-continuous neural networks, can be verified by solving a set of global-optimization problems. For this purpose, we introduce Stochastic Lagrangian Reachability (SLR), an abstraction-based…

Machine Learning · Computer Science 2021-11-16 Sophie Gruenbacher , Ramin Hasani , Mathias Lechner , Jacek Cyranka , Scott A. Smolka , Radu Grosu

Reachability analysis is a formal method to guarantee safety of dynamical systems under the influence of uncertainties. A substantial bottleneck of all reachability algorithms is the necessity to adequately tune specific algorithm…

Numerical Analysis · Mathematics 2024-02-23 Mark Wetzlinger , Niklas Kochdumper , Stanley Bak , Matthias Althoff

This paper studies finite-time safety and reach-avoid verification for stochastic discrete-time dynamical systems. The aim is to ascertain lower and upper bounds of the probability that, within a predefined finite-time horizon, a system…

Systems and Control · Electrical Eng. & Systems 2025-10-22 Bai Xue

Model-based reinforcement learning seeks to simultaneously learn the dynamics of an unknown stochastic environment and synthesise an optimal policy for acting in it. Ensuring the safety and robustness of sequential decisions made through a…

Machine Learning · Computer Science 2023-10-04 Matthew Wicker , Luca Laurenti , Andrea Patane , Nicola Paoletti , Alessandro Abate , Marta Kwiatkowska

Methods to certify the robustness of neural networks in the presence of input uncertainty are vital in safety-critical settings. Most certification methods in the literature are designed for adversarial or worst-case inputs, but researchers…

Machine Learning · Computer Science 2023-01-26 Brendon G. Anderson , Somayeh Sojoudi

Neural network controllers (NNCs) have shown great promise in autonomous and cyber-physical systems. Despite the various verification approaches for neural networks, the safety analysis of NNCs remains an open problem. Existing verification…

Machine Learning · Computer Science 2023-01-31 Chi Zhang , Wenjie Ruan , Peipei Xu

We present the first supermartingale certificate for quantitative $\omega$-regular properties of discrete-time infinite-state stochastic systems. Our certificate is defined on the product of the stochastic system and a limit-deterministic…

Logic in Computer Science · Computer Science 2025-05-27 Thomas A. Henzinger , Kaushik Mallik , Pouya Sadeghi , Đorđe Žikelić

In this paper we study reachability verification problems of stochastic discrete-time dynamical systems over the infinite time horizon. The reachability verification of interest in this paper is to certify specified lower and upper bounds…

Systems and Control · Electrical Eng. & Systems 2023-02-21 Bai Xue

This article deals with stochastic processes endowed with the Markov (memoryless) property and evolving over general (uncountable) state spaces. The models further depend on a non-deterministic quantity in the form of a control input, which…

Systems and Control · Computer Science 2015-09-11 Sofie Haesaert , Robert Babuska , Alessandro Abate

Learning-based approaches for controlling safety-critical systems are rapidly growing in popularity; thus, it is important to assure their performance and safety. Hamilton-Jacobi (HJ) reachability analysis is a popular formal verification…

Robotics · Computer Science 2024-04-11 Albert Lin , Somil Bansal

Developing a safe, stable, and efficient obstacle avoidance policy in crowded and narrow scenarios for multiple robots is challenging. Most existing studies either use centralized control or need communication with other robots. In this…

Robotics · Computer Science 2022-09-15 Jiafeng Ma , Guangda chen , Yingfeng Chen , Yujing Hu , Changjie Fan , Jianming Zhang

Randomized smoothing has become a leading approach for certifying adversarial robustness in machine learning models. However, a persistent gap remains between theoretical certified robustness and empirical robustness accuracy. This paper…

Machine Learning · Computer Science 2025-04-10 Blaise Delattre , Paul Caillon , Quentin Barthélemy , Erwan Fagnou , Alexandre Allauzen

In this paper, we propose a data-driven approach to formally verify the safety of (potentially) unknown discrete-time continuous-space stochastic systems. The proposed framework is based on a notion of barrier certificates together with…

Systems and Control · Electrical Eng. & Systems 2021-12-24 Ali Salamati , Abolfazl Lavaei , Sadegh Soudjani , Majid Zamani

In this work, we study verification and synthesis problems for safety specifications over unknown discrete-time stochastic systems. When a model of the system is available, barrier certificates have been successfully applied for ensuring…

Systems and Control · Electrical Eng. & Systems 2023-09-12 Ali Salamati , Abolfazl Lavaei , Sadegh Soudjani , Majid Zamani

Ensuring neural network robustness is essential for the safe and reliable operation of robotic learning systems, especially in perception and decision-making tasks within real-world environments. This paper investigates the robustness of…

Machine Learning · Computer Science 2024-11-01 Abulikemu Abuduweili , Changliu Liu

We consider finite horizon reach-avoid problems for discrete time stochastic systems. Our goal is to construct upper bound functions for the reach-avoid probability by means of tractable convex optimization problems. We achieve this by…

Optimization and Control · Mathematics 2015-06-11 Nikolaos Kariotoglou , Maryam Kamgarpour , Tyler H. Summers , John Lygeros

This report presents a neurosymbolic framework for safety verification and control synthesis in high-dimensional monotone dynamical systems without relying on explicit models or conservative Lipschitz bounds. The approach combines the…

Systems and Control · Electrical Eng. & Systems 2026-01-28 Saber Jafarpour , Alireza Nadali , Ashutosh Trivedi , Majid Zamani

In this work, we address the problem of learning provably stable neural network policies for stochastic control systems. While recent work has demonstrated the feasibility of certifying given policies using martingale theory, the problem of…

Machine Learning · Computer Science 2022-05-25 Đorđe Žikelić , Mathias Lechner , Krishnendu Chatterjee , Thomas A. Henzinger

We consider the problem of computing reach-avoid probabilities for iterative predictions made with Bayesian neural network (BNN) models. Specifically, we leverage bound propagation techniques and backward recursion to compute lower bounds…

Machine Learning · Computer Science 2021-06-22 Matthew Wicker , Luca Laurenti , Andrea Patane , Nicola Paoletti , Alessandro Abate , Marta Kwiatkowska