English
Related papers

Related papers: Neural Continuous-Time Supermartingale Certificate…

200 papers

This paper studies the problem of enforcing safety of a stochastic dynamical system over a finite time horizon. We use stochastic barrier functions as a means to quantify the probability that a system exits a given safe region of the state…

Systems and Control · Computer Science 2019-05-30 Cesar Santoyo , Maxence Dutreix , Samuel Coogan

Learning algorithms have shown considerable prowess in simulation by allowing robots to adapt to uncertain environments and improve their performance. However, such algorithms are rarely used in practice on safety-critical systems, since…

Systems and Control · Computer Science 2018-10-02 Spencer M. Richards , Felix Berkenkamp , Andreas Krause

Safety is a fundamental requirement of control systems. Control Barrier Functions (CBFs) are proposed to ensure the safety of the control system by constructing safety filters or synthesizing control inputs. However, the safety guarantee…

Robotics · Computer Science 2024-03-29 Manan Tayal , Hongchao Zhang , Pushpak Jagtap , Andrew Clark , Shishir Kolathaya

Ensuring that reinforcement learning (RL) controllers satisfy safety and reliability constraints in real-world settings remains challenging: state-avoidance and constrained Markov decision processes often fail to capture trajectory-level…

Machine Learning · Computer Science 2026-04-06 Alper Kamil Bozkurt , Calin Belta , Ming C. Lin

Learning-based methods provide a promising approach to solving highly non-linear control tasks that are often challenging for classical control methods. To ensure the satisfaction of a safety property, learning-based methods jointly learn a…

Machine Learning · Computer Science 2024-12-18 Emily Yu , Đorđe Žikelić , Thomas A. Henzinger

Learning-enabled control systems have demonstrated impressive empirical performance on challenging control problems in robotics, but this performance comes at the cost of reduced transparency and lack of guarantees on the safety or…

Robotics · Computer Science 2022-12-21 Charles Dawson , Sicun Gao , Chuchu Fan

Reinforcement learning has shown promising results in learning neural network policies for complicated control tasks. However, the lack of formal guarantees about the behavior of such policies remains an impediment to their deployment. We…

Machine Learning · Computer Science 2023-12-05 Đorđe Žikelić , Mathias Lechner , Abhinav Verma , Krishnendu Chatterjee , Thomas A. Henzinger

Control design for general nonlinear robotic systems with guaranteed stability and/or safety in the presence of model uncertainties is a challenging problem. Recent efforts attempt to learn a controller and a certificate (e.g., a Lyapunov…

Systems and Control · Electrical Eng. & Systems 2025-06-05 Vivek Sharma , Pan Zhao , Naira Hovakimyan

Learning safe and stable robot motions from demonstrations remains a challenge, especially in complex, nonlinear tasks involving dynamic, obstacle-rich environments. In this paper, we propose Safe and Stable Neural Network Dynamical Systems…

Motivated by the fragility of neural network (NN) controllers in safety-critical applications, we present a data-driven framework for verifying the risk of stochastic dynamical systems with NN controllers. Given a stochastic control system,…

Systems and Control · Electrical Eng. & Systems 2022-11-14 Matthew Cleaveland , Lars Lindemann , Radoslav Ivanov , George Pappas

Recent advances in Deep Machine Learning have shown promise in solving complex perception and control loops via methods such as reinforcement and imitation learning. However, guaranteeing safety for such learned deep policies has been a…

Robotics · Computer Science 2020-03-03 Tom Hirshberg , Sai Vemprala , Ashish Kapoor

While conventional (k=1) discrete-time barrier certificate conditions impose strict safety constraints by requiring the function to be non-increasing at every step, k-inductive barrier certificates relax this by allowing a temporary…

Systems and Control · Electrical Eng. & Systems 2026-05-20 Ben Wooding , Hongchao Zhang , Taylor T. Johnson , Abolfazl Lavaei

We consider the problem of learning control policies in discrete-time stochastic systems which guarantee that the system stabilizes within some specified stabilization region with probability~$1$. Our approach is based on the novel notion…

Machine Learning · Computer Science 2023-07-31 Matin Ansaripour , Krishnendu Chatterjee , Thomas A. Henzinger , Mathias Lechner , Đorđe Žikelić

Several methods have been proposed recently to learn neural network (NN) controllers for autonomous agents, with unknown and stochastic dynamics, tasked with complex missions captured by Linear Temporal Logic (LTL). Due to the…

Robotics · Computer Science 2023-11-23 Jun Wang , Haojun Chen , Zihe Sun , Yiannis Kantaros

With deep neural networks providing state-of-the-art machine learning models for numerous machine learning tasks, quantifying the robustness of these models has become an important area of research. However, most of the research literature…

Machine Learning · Computer Science 2019-01-08 Tsui-Wei Weng , Pin-Yu Chen , Lam M. Nguyen , Mark S. Squillante , Ivan Oseledets , Luca Daniel

This paper focuses on synthesizing control policies for discrete-time stochastic control systems together with a lower bound on the probability that the systems satisfy the complex temporal properties. The desired properties of the system…

Systems and Control · Electrical Eng. & Systems 2020-08-07 Pushpak Jagtap , Sadegh Soudjani , Majid Zamani

This paper deals with the problem of finite-time learning for unknown discrete-time nonlinear systems' dynamics, without the requirement of the persistence of excitation. Two finite-time concurrent learning methods are presented to…

Systems and Control · Electrical Eng. & Systems 2022-05-17 Farzaneh Tatari , Christos Panayiotou , Marios Polycarpou

Randomized smoothing provides strong, model-agnostic robustness certificates, but existing guarantees are limited to single modalities, treating continuous and discrete inputs in isolation. This limitation becomes critical in multimodal…

Machine Learning · Computer Science 2026-05-14 Blaise Delattre , Hengyu Wu , Paul Caillon , Wei Yang Bryan Lim , Yang Cao

We develop an assume-guarantee contract framework for the design of cyber-physical systems, modeled as closed-loop control systems, under probabilistic requirements. We use a variant of signal temporal logic, namely, Stochastic Signal…

Systems and Control · Computer Science 2017-07-03 Jiwei Li , Pierluigi Nuzzo , Alberto Sangiovanni-Vincentelli , Yugeng Xi , Dewei Li

This paper presents a continuous-time optimal control framework for the generation of reference trajectories in driving scenarios with uncertainty. A previous work presented a discrete-time stochastic generator for autonomous vehicles;…

Optimization and Control · Mathematics 2026-03-17 Ange Valli , Shangyuan Zhang , Abdel Lisser