English
Related papers

Related papers: Case Study: Runtime Safety Verification of Neural …

200 papers

Neural networks serve as effective controllers in a variety of complex settings due to their ability to represent expressive policies. The complex nature of neural networks, however, makes their output difficult to verify and predict, which…

Artificial Intelligence · Computer Science 2021-10-22 Sydney M. Katz , Kyle D. Julian , Christopher A. Strong , Mykel J. Kochenderfer

Existing machine learning-based surrogate modeling methods for transient stability constrained-optimal power flow (TSC-OPF) lack certifications in the presence of unseen disturbances or uncertainties. This may lead to divergence of TSC-OPF…

Systems and Control · Electrical Eng. & Systems 2025-06-12 Tong Su , Junbo Zhao

Safety has been of paramount importance in motion planning and control techniques and is an active area of research in the past few years. Most safety research for mobile robots target at maintaining safety with the notion of collision…

Robotics · Computer Science 2025-08-05 Manas Gupta , Xuesu Xiao

While neural networks (NNs) have potential as autonomous controllers for Cyber-Physical Systems, verifying the safety of NN based control systems (NNCSs) poses significant challenges for the practical use of NNs, especially when safety is…

Systems and Control · Electrical Eng. & Systems 2025-03-06 Samuel Teuber , Stefan Mitsch , André Platzer

Recent advances in deep learning have provided new data-driven ways of controller design to replace the traditional manual synthesis and certification approaches. Employing neural network (NN) as controllers however, presents its own…

Systems and Control · Electrical Eng. & Systems 2025-03-25 Sanghyoup Gu , Ratnesh Kumar

In recent years, artificial neural networks have been increasingly studied as feedback controllers for guidance problems. While effective in complex scenarios, they lack the verification guarantees found in classical guidance policies.…

Systems and Control · Electrical Eng. & Systems 2026-02-13 Adam Evans , Roberto Armellin

Autonomous robots must utilize rich sensory data to make safe control decisions. To process this data, compute-constrained robots often require assistance from remote computation, or the cloud, that runs compute-intensive deep neural…

Robotics · Computer Science 2024-12-05 Sai Shankar Narasimhan , Sharachchandra Bhat , Sandeep P. Chinchali

Reinforcement learning (RL) algorithms can achieve state-of-the-art performance in decision-making and continuous control tasks. However, applying RL algorithms on safety-critical systems still needs to be well justified due to the…

Robotics · Computer Science 2022-11-22 Mahmoud Selim , Amr Alanwar , M. Watheq El-Kharashi , Hazem M. Abbas , Karl H. Johansson

Formal verification provides strong safety guarantees but only for models of cyber-physical systems. Hybrid system models describe the required interplay of computation and physical dynamics, which is crucial to guarantee what computations…

Logic in Computer Science · Computer Science 2019-02-26 Stefan Mitsch , André Platzer

We study the problem of policy repair for learning-based control policies in safety-critical settings. We consider an architecture where a high-performance learning-based control policy (e.g. one trained as a neural network) is paired with…

Artificial Intelligence · Computer Science 2020-08-19 Weichao Zhou , Ruihan Gao , BaekGyu Kim , Eunsuk Kang , Wenchao Li

In this paper, we consider the problem of synthesizing a controller in the presence of uncertainty such that the resulting closed-loop system satisfies certain hard constraints while optimizing certain (soft) performance objectives. We…

Systems and Control · Electrical Eng. & Systems 2022-10-17 Navid Hashemi , Xin Qin , Jyotirmoy V. Deshmukh , Georgios Fainekos , Bardh Hoxha , Danil Prokhorov , Tomoya Yamaguchi

Learning-based methods provide a promising approach to solving highly non-linear control tasks that are often challenging for classical control methods. To ensure the satisfaction of a safety property, learning-based methods jointly learn a…

Machine Learning · Computer Science 2024-12-18 Emily Yu , Đorđe Žikelić , Thomas A. Henzinger

In this paper, we present a novel information processing architecture for safe deep learning-based visual navigation of autonomous systems. The proposed information processing architecture is used to support a perceptual attention-based…

Robotics · Computer Science 2019-10-17 Keuntaek Lee , Gabriel Nakajima An , Viacheslav Zakharov , Evangelos A. Theodorou

For active intervention tasks in underwater environments, the use of autonomous vehicles is just now emerging as an active area of research. During operation, for various reasons, the robot might find itself on a collision course with an…

Robotics · Computer Science 2026-01-28 Ioannis G. Polyzos , Konstantinos J. Kyriakopoulos

As the number of spacecraft on orbit continues to grow, it is challenging for human operators to constantly monitor and plan for all missions. Autonomous control methods such as reinforcement learning (RL) have the power to solve complex…

Systems and Control · Electrical Eng. & Systems 2024-05-14 Kyle Dunlap , Nathaniel Hamilton , Francisco Viramontes , Derrek Landauer , Evan Kain , Kerianne L. Hobbs

UAV control system is a huge and complex system, and to design and test a UAV control system is time-cost and money-cost. This paper considered the simulation of identification of a nonlinear system dynamics using artificial neural networks…

Systems and Control · Computer Science 2016-10-04 Bhaskar Prasad Rimal , Idris E. Putro , Agus Budiyono , Dugki Min , Eunmi Choi

Deep Reinforcement Learning (DRL) has achieved impressive performance in robotics and autonomous systems (RAS). A key challenge to its deployment in real-life operations is the presence of spuriously unsafe DRL policies. Unexplored states…

Robotics · Computer Science 2024-01-31 Yi Dong , Xingyu Zhao , Sen Wang , Xiaowei Huang

We present a new interface for controlling a navigation robot in novel environments using coordinated gesture and language. We use a TurtleBot3 robot with a LIDAR and a camera, an embodied simulation of what the robot has encountered while…

Dynamic formal verification is a key tool for providing ongoing confidence that a system is meeting its requirements while in use, especially when paired with static formal verification before the system is in use. This paper presents a…

Robotics · Computer Science 2021-05-26 Matt Luckcuck

The vulnerability of artificial intelligence (AI) and machine learning (ML) against adversarial disturbances and attacks significantly restricts their applicability in safety-critical systems including cyber-physical systems (CPS) equipped…

Systems and Control · Electrical Eng. & Systems 2020-04-28 Weiming Xiang , Hoang-Dung Tran , Xiaodong Yang , Taylor T. Johnson