English
Related papers

Related papers: Verified Safe Reinforcement Learning for Neural Ne…

200 papers

Model mismatches prevail in real-world applications. Ensuring safety for systems with uncertain dynamic models is critical. However, existing robust safe controllers may not be realizable when control limits exist. And existing methods use…

Robotics · Computer Science 2023-03-08 Tianhao Wei , Shucheng Kang , Weiye Zhao , Changliu Liu

The large-scale integration of intermittent renewable energy resources introduces increased uncertainty and volatility to the supply side of power systems, thereby complicating system operation and control. Recently, data-driven approaches,…

Systems and Control · Electrical Eng. & Systems 2024-07-02 Peipei Yu , Zhenyi Wang , Hongcai Zhang , Yonghua Song

This paper introduces differentiable higher-order control barrier functions (CBF) that are end-to-end trainable together with learning systems. CBFs are usually overly conservative, while guaranteeing safety. Here, we address their…

Machine Learning · Computer Science 2021-11-23 Wei Xiao , Ramin Hasani , Xiao Li , Daniela Rus

The last decade's research in artificial intelligence had a significant impact on the advance of autonomous driving. Yet, safety remains a major concern when it comes to deploying such systems in high-risk environments. The objective of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Charles Corbière

Reach-avoid optimal control problems, in which the system must reach certain goal conditions while staying clear of unacceptable failure modes, are central to safety and liveness assurance for autonomous robotic systems, but their exact…

Machine Learning · Computer Science 2022-01-25 Kai-Chieh Hsu , Vicenç Rubies-Royo , Claire J. Tomlin , Jaime F. Fisac

Deep neural networks have become widely used, obtaining remarkable results in domains such as computer vision, speech recognition, natural language processing, audio recognition, social network filtering, machine translation, and…

Neural and Evolutionary Computing · Computer Science 2020-02-03 Divya Gopinath , Guy Katz , Corina S. Pasareanu , Clark Barrett

We present Revel, a partially neural reinforcement learning (RL) framework for provably safe exploration in continuous state and action spaces. A key challenge for provably safe deep RL is that repeatedly verifying neural networks within a…

Machine Learning · Computer Science 2020-10-27 Greg Anderson , Abhinav Verma , Isil Dillig , Swarat Chaudhuri

Trustworthy verifiers are essential for the success of reinforcement learning with verifiable reward (RLVR), which is the core methodology behind various large reasoning models such as DeepSeek-R1. In complex domains like mathematical…

Machine Learning · Computer Science 2025-10-08 Yuzhen Huang , Weihao Zeng , Xingshan Zeng , Qi Zhu , Junxian He

Despite the numerous advances, reinforcement learning remains away from widespread acceptance for autonomous controller design as compared to classical methods due to lack of ability to effectively tackle the reality gap. The reliance on…

Machine Learning · Computer Science 2024-09-23 Narendra Patwardhan , Zequn Wang

Autonomous drone racing has attracted increasing interest as a research topic for exploring the limits of agile flight. However, existing studies primarily focus on obstacle-free racetracks, while the perception and dynamic challenges…

Robotics · Computer Science 2026-03-02 Fangyu Sun , Fanxing Li , Yu Hu , Linzuo Zhang , Yueqian Liu , Wenxian Yu , Danping Zou

Neural networks hold great potential to act as approximate models of nonlinear dynamical systems, with the resulting neural approximations enabling verification and control of such systems. However, in safety-critical contexts, the use of…

Machine Learning · Computer Science 2025-09-30 Frederik Baymler Mathiesen , Nikolaus Vertovec , Francesco Fabiano , Luca Laurenti , Alessandro Abate

Providing safety guarantees for Autonomous Vehicle (AV) systems with machine-learning-based controllers remains a challenging issue. In this work, we propose Simplex-Drive, a framework that can achieve runtime safety assurance for…

Robotics · Computer Science 2021-09-29 Shengduo Chen , Yaowei Sun , Dachuan Li , Qiang Wang , Qi Hao , Joseph Sifakis

This paper presents Verisig, a hybrid system approach to verifying safety properties of closed-loop systems using neural networks as controllers. Although techniques exist for verifying input/output properties of the neural network itself,…

Systems and Control · Computer Science 2018-11-06 Radoslav Ivanov , James Weimer , Rajeev Alur , George J. Pappas , Insup Lee

We present an approach for safe trajectory planning, where a strategic task related to autonomous racing is learned sample-efficient within a simulation environment. A high-level policy, represented as a neural network, outputs a reward…

Robotics · Computer Science 2022-12-06 Rudolf Reiter , Jasper Hoffmann , Joschka Boedecker , Moritz Diehl

Stability certification and identifying a safe and stabilizing initial set are two important concerns in ensuring operational safety, stability, and robustness of dynamical systems. With the advent of machine-learning tools, these issues…

Machine Learning · Computer Science 2022-09-01 Soumyabrata Talukder , Ratnesh Kumar

The decision logic for the ACAS X family of aircraft collision avoidance systems is represented as a large numeric table. Due to storage constraints of certified avionics hardware, neural networks have been suggested as a way to…

Systems and Control · Electrical Eng. & Systems 2020-05-07 Kyle D. Julian , Mykel J. Kochenderfer

Neural networks (NNs) are increasingly applied in safety-critical systems such as autonomous vehicles. However, they are fragile and are often ill-behaved. Consequently, their behaviors should undergo rigorous guarantees before deployment…

Artificial Intelligence · Computer Science 2022-10-11 Zhen Liang , Dejin Ren , Wanwei Liu , Ji Wang , Wenjing Yang , Bai Xue

Reinforcement learning (RL) is a promising approach. However, success is limited to real-world applications, because ensuring safe exploration and facilitating adequate exploitation is a challenge for controlling robotic systems with…

Robotics · Computer Science 2022-08-29 Mingyu Cai , Cristian-Ioan Vasile

Reinforcement learning (RL) has emerged as a promising paradigm in complex and continuous robotic tasks, however, safe exploration has been one of the main challenges, especially in contact-rich manipulation tasks in unstructured…

Robotics · Computer Science 2024-06-21 Heng Zhang , Gokhan Solak , Gustavo J. G. Lahr , Arash Ajoudani

Control Barrier Functions (CBFs) have been used to enforce safety and task specifications expressed in Signal Temporal Logic (STL). However, existing CBF-STL approaches typically rely on fixed hyperparameters and per-step optimization,…

Systems and Control · Electrical Eng. & Systems 2026-01-29 Wenliang Liu , Shuo Liu , Wei Xiao , Calin A. Belta