English
Related papers

Related papers: Learning Control Policies for Stochastic Systems w…

200 papers

Providing formal guarantees for neural network-based controllers in large-scale interconnected systems remains a fundamental challenge. In particular, using neural certificates to capture cooperative interactions and verifying these…

Systems and Control · Electrical Eng. & Systems 2026-01-29 Jingyuan Zhou , Haoze Wu , Kaidi Yang

Stochastic dynamical systems have emerged as fundamental models across numerous application domains, providing powerful mathematical representations for capturing uncertain system behavior. In this paper, we address the problem of runtime…

Systems and Control · Electrical Eng. & Systems 2025-11-13 Shenghua Feng , Jie An , Fanjiang Xu

In this paper, we propose an approach for synthesizing provable reach-avoid controllers, which drive a deterministic system operating in an unknown environment to safely reach a desired target set. The approach falls within the reachability…

Systems and Control · Electrical Eng. & Systems 2023-04-25 Jianqiang Ding , Taoran Wu , Yuping Qian , Lijun Zhang , Bai Xue

In this article we approach a class of stochastic reachability problems with state constraints from an optimal control perspective. Preceding approaches to solving these reachability problems are either confined to the deterministic setting…

Optimization and Control · Mathematics 2017-11-27 Peyman Mohajerin Esfahani , Debasish Chatterjee , John Lygeros

We consider finite horizon reach-avoid problems for discrete time stochastic systems. Our goal is to construct upper bound functions for the reach-avoid probability by means of tractable convex optimization problems. We achieve this by…

Optimization and Control · Mathematics 2015-06-11 Nikolaos Kariotoglou , Maryam Kamgarpour , Tyler H. Summers , John Lygeros

Designing provably safe control is a core problem in trustworthy autonomy. However, most prior work in this regard assumes either that the system dynamics are known or deterministic, or that the state and action space are finite,…

Robotics · Computer Science 2026-02-04 Xinhang Ma , Junlin Wu , Yiannis Kantaros , Yevgeniy Vorobeychik

Emerging applications in robotics and autonomous systems, such as autonomous driving and robotic surgery, often involve critical safety constraints that must be satisfied even when information about system models is limited. In this regard,…

Robotics · Computer Science 2020-02-25 Subin Huh , Insoon Yang

The design of tracking controllers that closely follow a reference trajectory while ensuring safety and robustness against disturbances is a challenging problem in the control of autonomous systems. In this work, we propose a neural…

Systems and Control · Electrical Eng. & Systems 2025-12-01 Yuezhu Xu , Mohamed Serry , Jun Liu , S. Sivaranjani

Sequential decision making using Markov Decision Process underpins many realworld applications. Both model-based and model free methods have achieved strong results in these settings. However, real-world tasks must balance reward…

Machine Learning · Computer Science 2026-04-01 Janaka Chathuranga Brahmanage , Akshat Kumar

Providing finite-time probabilistic safety and reach-avoid guarantees is crucial for safety-critical stochastic systems. Existing state-of-the-art barrier methods often rely on a restrictive boundedness assumption for auxiliary functions,…

Systems and Control · Electrical Eng. & Systems 2026-05-12 Bai Xue , Luke Ong , Dominik Wagner , Peixin Wang

This paper studies finite-time safety and reach-avoid verification for stochastic discrete-time dynamical systems. The aim is to ascertain lower and upper bounds of the probability that, within a predefined finite-time horizon, a system…

Systems and Control · Electrical Eng. & Systems 2025-10-22 Bai Xue

Almost sure reachability refers to the property of a stochastic system whereby, from any initial condition, the system state reaches a given target set with probability one. In this paper, we study the problem of certifying almost sure…

Systems and Control · Electrical Eng. & Systems 2025-07-29 Arash Bahari Kordabad , Rupak Majumdar , Harshit Jitendra Motwani , Sadegh Soudjani

One of the most fundamental problems in Markov decision processes is analysis and control synthesis for safety and reachability specifications. We consider the stochastic reach-avoid problem, in which the objective is to synthesize a…

Optimization and Control · Mathematics 2017-10-09 Nikolaos Kariotoglou , Maryam Kamgarpour , Tyler Summers , John Lygeros

Digital control has become increasingly prevalent in modern systems, making continuous-time plants controlled by discrete-time (digital) controllers ubiquitous and crucial across industries, including aerospace, automotive, and…

Systems and Control · Electrical Eng. & Systems 2023-10-10 Taoran Wu , Dejin Ren , Shuyuan Zhang , Lei Wang , Bai Xue

This work establishes a crucial step toward advancing data-driven trajectory-based methods for stochastic systems with unknown mathematical dynamics. In contrast to scenario-based approaches that rely on independent and identically…

Systems and Control · Electrical Eng. & Systems 2025-08-01 Abolfazl Lavaei

A classic reachability problem for safety of dynamic systems is to compute the set of initial states from which the state trajectory is guaranteed to stay inside a given constraint set over a given time horizon. In this paper, we leverage…

Ensuring safety of nonlinear systems under model uncertainty and external disturbances is crucial, especially for real-world control tasks. Predictive methods such as robust model predictive control (RMPC) require solving nonconvex…

Systems and Control · Electrical Eng. & Systems 2023-11-14 Zeyang Li , Chuxiong Hu , Weiye Zhao , Changliu Liu

We investigate the problem of synthesizing distributionally robust control policies for stochastic systems under safety and reach-avoid specifications. Using a game-theoretical framework, we consider the setting where the probability…

Systems and Control · Electrical Eng. & Systems 2025-11-04 Yu Chen , Yuda Li , Shaoyuan Li , Xiang Yin

The deployment of Large Language Models (LLMs) in robotic systems presents unique safety challenges, particularly in unpredictable environments. Although LLMs, leveraging zero-shot learning, enhance human-robot interaction and…

Robotics · Computer Science 2025-03-07 Ahmad Hafez , Alireza Naderi Akhormeh , Amr Hegazy , Amr Alanwar

A runtime assurance system (RTA) for a given plant enables the exercise of an untrusted or experimental controller while assuring safety with a backup (or safety) controller. The relevant computational design problem is to create a logic…

Systems and Control · Electrical Eng. & Systems 2023-10-09 Kristina Miller , Christopher K. Zeitler , William Shen , Kerianne Hobbs , Sayan Mitra , John Schierman , Mahesh Viswanathan