English
Related papers

Related papers: Generating Probabilistic Safety Guarantees for Neu…

200 papers

Neural networks are powerful tools for data-driven modeling of complex dynamical systems, enhancing predictive capability for control applications. However, their inherent nonlinearity and black-box nature challenge control designs that…

Systems and Control · Electrical Eng. & Systems 2025-05-20 Xiao Li , Tianhao Wei , Changliu Liu , Anouck Girard , Ilya Kolmanovsky

Neural networks are increasingly deployed in real-world safety-critical domains such as autonomous driving, aircraft collision avoidance, and malware detection. However, these networks have been shown to often mispredict on inputs with…

Machine Learning · Computer Science 2018-11-09 Shiqi Wang , Kexin Pei , Justin Whitehouse , Junfeng Yang , Suman Jana

The problem of probabilistic verification of a neural network investigates the probability of satisfying the safe constraints in the output space when the input is given by a probability distribution. It is significant to answer this…

Artificial Intelligence · Computer Science 2026-04-24 Jingyang Li , Xin Chen , Hongfei Fu , Guoqiang Li

Neural networks are increasingly applied to support decision making in safety-critical applications (like autonomous cars, unmanned aerial vehicles and face recognition based authentication). While many impressive static verification…

Machine Learning · Computer Science 2021-05-07 Guoliang Dong , Jun Sun , Jingyi Wang , Xinyu Wang , Ting Dai

Control systems operating in the real world face countless sources of unpredictable uncertainties. These random disturbances can render deterministic guarantees inapplicable and cause catastrophic safety failures. To overcome this, this…

Systems and Control · Electrical Eng. & Systems 2026-02-10 Pol Mestres , Blake Werner , Ryan K. Cosner , Aaron D. Ames

Solving nonlinear model predictive control problems in real time is still an important challenge despite of recent advances in computing hardware, optimization algorithms and tailored implementations. This challenge is even greater when…

Systems and Control · Electrical Eng. & Systems 2021-09-23 Benjamin Karg , Teodoro Alamo , Sergio Lucia

With neural networks being used to control safety-critical systems, they increasingly have to be both accurate (in the sense of matching inputs to outputs) and robust. However, these two properties are often at odds with each other and a…

Systems and Control · Electrical Eng. & Systems 2024-05-30 Ross Drummond , Chris Guiver , Matthew C. Turner

Model Predictive Control (MPC) is an optimal control algorithm with strong stability and robustness guarantees. Despite its popularity in robotics and industrial applications, the main challenge in deploying MPC is its high computation…

Systems and Control · Electrical Eng. & Systems 2024-12-31 Camilo Gonzalez , Houshyar Asadi , Lars Kooijman , Chee Peng Lim

Model predictive control (MPC) provides a useful means for controlling systems with constraints, but suffers from the computational burden of repeatedly solving an optimization problem in real time. Offline (explicit) solutions for MPC…

Systems and Control · Electrical Eng. & Systems 2022-09-14 Daniel Tabas , Baosen Zhang

Deep reinforcement learning has been successfully applied to many control tasks, but the application of such agents in safety-critical scenarios has been limited due to safety concerns. Rigorous testing of these controllers is challenging,…

Artificial Intelligence · Computer Science 2020-07-09 Edoardo Bacci , David Parker

Safety-critical applications require controllers/policies that can guarantee safety with high confidence. The control barrier function is a useful tool to guarantee safety if we have access to the ground-truth system dynamics. In practice,…

Machine Learning · Computer Science 2021-12-30 Athindran Ramesh Kumar , Sulin Liu , Jaime F. Fisac , Ryan P. Adams , Peter J. Ramadge

We consider controller synthesis for stochastic and partially unknown environments in which safety is essential. Specifically, we abstract the problem as a Markov decision process in which the expected performance is measured using a cost…

Software Engineering · Computer Science 2015-10-21 Sebastian Junges , Nils Jansen , Christian Dehnert , Ufuk Topcu , Joost-Pieter Katoen

Neural networks are becoming increasingly prevalent in software, and it is therefore important to be able to verify their behavior. Because verifying the correctness of neural networks is extremely challenging, it is common to focus on the…

Machine Learning · Computer Science 2019-02-19 Ravi Mangal , Aditya V. Nori , Alessandro Orso

The Neural Network (NN), as a black-box function approximator, has been considered in many control and robotics applications. However, difficulties in verifying the overall system safety in the presence of uncertainties hinder the…

Robotics · Computer Science 2024-05-21 Xiao Li , Yutong Li , Anouck Girard , Ilya Kolmanovsky

Path-tracking control of self-driving vehicles can benefit from deep learning for tackling longstanding challenges such as nonlinearity and uncertainty. However, deep neural controllers lack safety guarantees, restricting their practical…

Robotics · Computer Science 2022-08-09 Zhizhen Qin , Tsui-Wei Weng , Sicun Gao

A supervised learning framework is proposed to approximate a model predictive controller (MPC) with reduced computational complexity and guarantees on stability and constraint satisfaction. The framework can be used for a wide class of…

Systems and Control · Computer Science 2018-06-13 Michael Hertneck , Johannes Köhler , Sebastian Trimpe , Frank Allgöwer

Certifying the safety or robustness of neural networks against input uncertainties and adversarial attacks is an emerging challenge in the area of safe machine learning and control. To provide such a guarantee, one must be able to bound the…

Optimization and Control · Mathematics 2021-09-16 Mahyar Fazlyab , Manfred Morari , George J. Pappas

Safety in stochastic control systems, which are subject to random noise with a known probability distribution, aims to compute policies that satisfy predefined operational constraints with high confidence throughout the uncertain evolution…

Systems and Control · Electrical Eng. & Systems 2025-11-12 Saber Omidi , Marek Petrik , Se Young Yoon , Momotaz Begum

This work investigates the challenge of ensuring safety guarantees in the presence of uncontrollable agents, whose behaviors are stochastic and depend on both their own and the system's states. We present a neural model predictive control…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Shuqi Wang , Mingyang Feng , Yu Chen , Yue Gao , Xiang Yin

We present an approach for designing correct-by-construction neural networks (and other machine learning models) that are guaranteed to be consistent with a collection of input-output specifications before, during, and after algorithm…

Machine Learning · Computer Science 2020-01-31 Stephen Mell , Olivia Brown , Justin Goodwin , Sung-Hyun Son