English
Related papers

Related papers: Safe Exploration in Model-based Reinforcement Lear…

200 papers

Model information can be used to predict future trajectories, so it has huge potential to avoid dangerous region when implementing reinforcement learning (RL) on real-world tasks, like autonomous driving. However, existing studies mostly…

Robotics · Computer Science 2021-03-08 Haitong Ma , Jianyu Chen , Shengbo Eben Li , Ziyu Lin , Yang Guan , Yangang Ren , Sifa Zheng

Reinforcement learning (RL) agents need to explore their environment to learn optimal behaviors and achieve maximum rewards. However, exploration can be risky when training RL directly on real systems, while simulation-based training…

Robotics · Computer Science 2024-10-10 Dvij Kalaria , Qin Lin , John M. Dolan

Reinforcement learning (RL) is a promising approach. However, success is limited to real-world applications, because ensuring safe exploration and facilitating adequate exploitation is a challenge for controlling robotic systems with…

Robotics · Computer Science 2022-08-29 Mingyu Cai , Cristian-Ioan Vasile

Reinforcement Learning (RL) and continuous nonlinear control have been successfully deployed in multiple domains of complicated sequential decision-making tasks. However, given the exploration nature of the learning process and the presence…

Robotics · Computer Science 2022-08-01 Wenhao Luo , Wen Sun , Ashish Kapoor

This paper proposes tackling safety-critical stochastic Reinforcement Learning (RL) tasks with a sample-based, model-based approach. At the core of the method lies a Model Predictive Control (MPC) scheme that acts as function approximation,…

Systems and Control · Electrical Eng. & Systems 2025-07-30 Filippo Airaldi , Bart De Schutter , Azita Dabiri

In this work, we consider the problem of designing a safety filter for a nonlinear uncertain control system. Our goal is to augment an arbitrary controller with a safety filter such that the overall closed-loop system is guaranteed to stay…

Robotics · Computer Science 2022-04-11 Lukas Brunke , Siqi Zhou , Angela P. Schoellig

We consider the problem of safely exploring a static and unknown environment while learning valid control barrier functions (CBFs) from sensor data. Existing works either assume known environments, target specific dynamics models, or use…

Systems and Control · Electrical Eng. & Systems 2025-04-03 Paul Lutkus , Deepika Anantharaman , Stephen Tu , Lars Lindemann

Safety is of great importance in multi-robot navigation problems. In this paper, we propose a control barrier function (CBF) based optimizer that ensures robot safety with both high probability and flexibility, using only sensor…

Robotics · Computer Science 2021-09-17 Yuxiang Cui , Longzhong Lin , Xiaolong Huang , Dongkun Zhang , Yue Wang , Rong Xiong

Achieving safe autonomous navigation systems is critical for deploying robots in dynamic and uncertain real-world environments. In this paper, we propose a hierarchical control framework leveraging neural network verification techniques to…

Artificial Intelligence · Computer Science 2025-05-01 Luca Marzari , Francesco Trotti , Enrico Marchesini , Alessandro Farinelli

Optimal control methods provide solutions to safety-critical problems but easily become intractable. Control Barrier Functions (CBFs) have emerged as a popular technique that facilitates their solution by provably guaranteeing safety,…

Systems and Control · Electrical Eng. & Systems 2025-02-21 Ehsan Sabouni , H. M. Sabbir Ahmad , Vittorio Giammarino , Christos G. Cassandras , Ioannis Ch. Paschalidis , Wenchao Li

Merely pursuing performance may adversely affect the safety, while a conservative policy for safe exploration will degrade the performance. How to balance the safety and performance in learning-based control problems is an interesting yet…

Systems and Control · Electrical Eng. & Systems 2025-01-28 Xinyang Wang , Hongwei Zhang , Shimin Wang , Wei Xiao , Martin Guay

Reinforcement Learning (RL) uses rewards to guide learning, yet reward design is typically hand-crafted using heuristics that can be difficult to tune. We propose a Control Barrier Function (CBF)-informed reward design for Multi-Agent RL…

Robotics · Computer Science 2026-05-19 Jianye Xu , Bassam Alrifaee

Reinforcement learning (RL) has demonstrated impressive performance in various areas such as video games and robotics. However, ensuring safety and stability, which are two critical properties from a control perspective, remains a…

Systems and Control · Electrical Eng. & Systems 2023-10-02 Liqun Zhao , Konstantinos Gatsis , Antonis Papachristodoulou

Learning-based control with safety guarantees usually requires real-time safety certification and modifications of possibly unsafe learning-based policies. The control barrier function (CBF) method uses a safety filter containing a…

Systems and Control · Electrical Eng. & Systems 2024-10-25 Kanghui He , Shengling Shi , Ton van den Boom , Bart De Schutter

This paper addresses the target-pursuit problem, aiming to ensure each pursuer's safety regarding collision avoidance, sensing range, and input saturation. An input-constrained CBF is proposed to dynamically regulate the pursuer's control,…

Systems and Control · Electrical Eng. & Systems 2024-12-11 Yaosheng Deng , Junjie Gao , Jiaping Xiao , Mir Feroskhan

Control barrier functions (CBFs) are widely used in safety-critical controllers. However, constructing a valid CBF is challenging, especially under nonlinear or non-convex constraints and for high relative degree systems. Meanwhile, finding…

Systems and Control · Electrical Eng. & Systems 2022-10-12 Bolun Dai , Prashanth Krishnamurthy , Farshad Khorrami

Safety filters leveraging control barrier functions (CBFs) are highly effective for enforcing safe behavior on complex systems. It is often easier to synthesize CBFs for a Reduced order Model (RoM), and track the resulting safe behavior on…

Systems and Control · Electrical Eng. & Systems 2024-12-09 William D. Compton , Max H. Cohen , Aaron D. Ames

Multi-robot systems (MRS) are essential for large-scale applications such as disaster response, material transport, and warehouse logistics, yet ensuring robust, safety-aware formation control in cluttered and dynamic environments remains a…

Robotics · Computer Science 2026-05-06 Qintong Xie , Weishu Zhan , Peter Chin

Control barrier functions (CBF) have become popular as a safety filter to guarantee the safety of nonlinear dynamical systems for arbitrary inputs. However, it is difficult to construct functions that satisfy the CBF constraints for high…

Optimization and Control · Mathematics 2023-12-06 Oswin So , Zachary Serlin , Makai Mann , Jake Gonzales , Kwesi Rutledge , Nicholas Roy , Chuchu Fan

Autonomous navigation and obstacle avoidance remain a core challenge of modern Unmanned Aerial Vehicles (UAVs). While traditional control methods struggle with the complexity and variability of the environment, reinforcement learning (RL)…

Systems and Control · Electrical Eng. & Systems 2026-05-05 Ashik Abrar Naeem , Mohammad Ariful Haque