English
Related papers

Related papers: Safe model-based Reinforcement Learning via Model …

200 papers

Reinforcement learning (RL)-based adaptive cruise control systems (ACC) that learn and adapt to road, traffic and vehicle conditions are attractive for enhancing vehicle energy efficiency and traffic flow. However, the application of RL in…

Systems and Control · Electrical Eng. & Systems 2023-01-04 Habtamu Hailemichael , Beshah Ayalew , Lindsey Kerbel , Andrej Ivanco , Keith Loiselle

Determining the optimal cost function parameters of Model Predictive Control (MPC) to optimize multiple control objectives is a challenging and time-consuming task. Multiobjective Bayesian Optimization (BO) techniques solve this problem by…

Robotics · Computer Science 2024-02-06 Baha Zarrouki , Marios Spanakakis , Johannes Betz

Safety in reinforcement learning (RL) is a key property in both training and execution in many domains such as autonomous driving or finance. In this paper, we formalize it with a constrained RL formulation in the distributional RL setting.…

Machine Learning · Computer Science 2021-03-01 Jianyi Zhang , Paul Weng

Guaranteeing safe behaviour of reinforcement learning (RL) policies poses significant challenges for safety-critical applications, despite RL's generality and scalability. To address this, we propose a new approach to apply verification…

Machine Learning · Computer Science 2023-12-06 Daniel C. H. Tan , Fernando Acero , Robert McCarthy , Dimitrios Kanoulas , Zhibin Li

This paper addresses learning safe output feedback control laws from partial observations of expert demonstrations. We assume that a model of the system dynamics and a state estimator are available along with corresponding error bounds,…

Systems and Control · Electrical Eng. & Systems 2024-04-04 Lars Lindemann , Alexander Robey , Lejun Jiang , Satyajeet Das , Stephen Tu , Nikolai Matni

Reinforcement learning (RL) exhibits impressive performance when managing complicated control tasks for robots. However, its wide application to physical robots is limited by the absence of strong safety guarantees. To overcome this…

Robotics · Computer Science 2023-05-18 Desong Du , Shaohang Han , Naiming Qi , Haitham Bou Ammar , Jun Wang , Wei Pan

Controller design faces a trade-off between robustness and performance, and the reliability of linear controllers has caused many practitioners to focus on the former. However, there is renewed interest in improving system performance to…

Optimization and Control · Mathematics 2012-08-07 Anil Aswani , Humberto Gonzalez , S. Shankar Sastry , Claire Tomlin

Reinforcement Learning (RL) applications in real-world scenarios must prioritize safety and reliability, which impose strict constraints on agent behavior. Model-based RL leverages predictive world models for action planning and policy…

Artificial Intelligence · Computer Science 2025-06-06 Artem Latyshev , Gregory Gorbov , Aleksandr I. Panov

In this paper, we establish a connection between model predictive control (MPC) techniques and Control Barrier Functions (CBFs). Recognizing the similarity between CBFs and Control Lyapunov Functions (CLFs), we propose a MPC formulation…

Optimization and Control · Mathematics 2025-07-03 Jingyi Huang , Han Wang , Kostas Margellos , Paul Goulart

In safe Reinforcement Learning (RL), safety cost is typically defined as a function dependent on the immediate state and actions. In practice, safety constraints can often be non-Markovian due to the insufficient fidelity of state…

Machine Learning · Computer Science 2024-05-07 Siow Meng Low , Akshat Kumar

Safety filters leveraging control barrier functions (CBFs) are highly effective for enforcing safe behavior on complex systems. It is often easier to synthesize CBFs for a Reduced order Model (RoM), and track the resulting safe behavior on…

Systems and Control · Electrical Eng. & Systems 2024-12-09 William D. Compton , Max H. Cohen , Aaron D. Ames

Optimal control for safety-critical systems is often dependent on the conservativeness of constraints. Control Barrier Functions (CBFs) serve as a medium to represent such constraints, but constructing a minimally conservative CBF is a…

Systems and Control · Electrical Eng. & Systems 2026-05-08 Tanmay Dokania , Yashwanth Kumar Nakka

Learning-based control has recently shown great efficacy in performing complex tasks for various applications. However, to deploy it in real systems, it is of vital importance to guarantee the system will stay safe. Control Barrier…

Systems and Control · Electrical Eng. & Systems 2024-09-05 Fernando Castañeda , Jason J. Choi , Wonsuhk Jung , Bike Zhang , Claire J. Tomlin , Koushil Sreenath

Safe reinforcement learning (RL) aims to learn policies that satisfy certain constraints before deploying them to safety-critical applications. Previous primal-dual style approaches suffer from instability issues and lack optimality…

Machine Learning · Computer Science 2022-06-20 Zuxin Liu , Zhepeng Cen , Vladislav Isenbaev , Wei Liu , Zhiwei Steven Wu , Bo Li , Ding Zhao

Reinforcement learning (RL) has shown a promising performance in learning optimal policies for a variety of sequential decision-making tasks. However, in many real-world RL problems, besides optimizing the main objectives, the agent is…

Machine Learning · Computer Science 2021-07-30 Ashkan B. Jeddi , Nariman L. Dehghani , Abdollah Shafieezadeh

Reinforcement learning (RL) methods have demonstrated their efficiency in simulation environments. However, many applications for which RL offers great potential, such as autonomous driving, are also safety critical and require a certified…

Systems and Control · Electrical Eng. & Systems 2021-01-19 Kim P. Wabersich , Lukas Hewing , Andrea Carron , Melanie N. Zeilinger

Safety is critical when applying reinforcement learning (RL) to real-world problems. As a result, safe RL has emerged as a fundamental and powerful paradigm for optimizing an agent's policy while incorporating notions of safety. A prevalent…

Machine Learning · Computer Science 2024-05-09 Akifumi Wachi , Xun Shen , Yanan Sui

Reinforcement learning (RL) and model predictive control (MPC) offer a wealth of distinct approaches for automatic decision-making under uncertainty. Given the impact both fields have had independently across numerous domains, there is…

Systems and Control · Electrical Eng. & Systems 2025-10-13 Nathan P. Lawrence , Philip D. Loewen , Michael G. Forbes , R. Bhushan Gopaluni , Ali Mesbah

Safety remains a central challenge in control of dynamical systems, particularly when the boundaries of unsafe sets are complex (e.g., nonconvex, nonsmooth) or unknown. This paper proposes a learning-enabled framework for safety-critical…

Systems and Control · Electrical Eng. & Systems 2025-09-16 Shuo Liu , Zhe Huang , Jun Zeng , Koushil Sreenath , Calin A. Belta

Trial-and-error based reinforcement learning (RL) has seen rapid advancements in recent times, especially with the advent of deep neural networks. However, the majority of autonomous RL algorithms require a large number of interactions with…

Systems and Control · Computer Science 2018-02-23 Sanket Kamthe , Marc Peter Deisenroth