English
Related papers

Related papers: Model-based Constrained Reinforcement Learning usi…

200 papers

This paper introduces a predictive control barrier function (PCBF) framework for enforcing state constraints in discrete-time systems with unknown relative degree, which can be caused by input delays or unmodeled input dynamics. Existing…

Systems and Control · Electrical Eng. & Systems 2025-10-02 Juan Augusto Paredes Salazar , James Usevitch , Ankit Goel

In standard reinforcement learning (RL), a learning agent seeks to optimize the overall reward. However, many key aspects of a desired behavior are more naturally expressed as constraints. For instance, the designer may want to limit the…

Machine Learning · Computer Science 2021-01-29 Sobhan Miryoosefi , Kianté Brantley , Hal Daumé , Miroslav Dudik , Robert Schapire

Safety constraints of nonlinear control systems are commonly enforced through the use of control barrier functions (CBFs). Uncertainties in the dynamic model can disrupt forward invariance guarantees or cause the state to be restricted to…

Systems and Control · Electrical Eng. & Systems 2025-01-30 Hannah M. Sweatland , Omkar Sudhir Patil , Warren E. Dixon

This work addresses the challenge of safe and efficient mobile robot navigation in complex dynamic environments with concave moving obstacles. Reactive safe controllers like Control Barrier Functions (CBFs) design obstacle avoidance…

Robotics · Computer Science 2026-02-12 Yifan Xue , Ze Zhang , Knut Åkesson , Nadia Figueroa

Safe reinforcement learning (RL) seeks to mitigate unsafe behaviors that arise from exploration during training by reducing constraint violations while maintaining task performance. Existing approaches typically rely on a single policy to…

Robotics · Computer Science 2026-05-12 Murad Dawood , Usama Ahmed Siddiquie , Shahram Khorshidi , Maren Bennewitz

Safe reinforcement learning (RL) aims to learn policies that satisfy certain constraints before deploying them to safety-critical applications. Previous primal-dual style approaches suffer from instability issues and lack optimality…

Machine Learning · Computer Science 2022-06-20 Zuxin Liu , Zhepeng Cen , Vladislav Isenbaev , Wei Liu , Zhiwei Steven Wu , Bo Li , Ding Zhao

Recent breakthroughs both in reinforcement learning and trajectory optimization have made significant advances towards real world robotic system deployment. Reinforcement learning (RL) can be applied to many problems without needing any…

Robotics · Computer Science 2019-10-23 Guillaume Bellegarda , Katie Byl

Sampling-based algorithms, such as Rapidly Exploring Random Trees (RRT) and its variants, have been used extensively for motion planning. Control barrier functions (CBFs) have been recently proposed to synthesize controllers for…

Robotics · Computer Science 2022-06-03 Ahmad Ahmad , Calin Belta , Roberto Tron

We propose a novel class of risk-aware control barrier functions (RA-CBFs) for the control of stochastic safety-critical systems. Leveraging a result from the stochastic level-crossing literature, we deviate from the martingale theory that…

Systems and Control · Electrical Eng. & Systems 2023-08-22 Mitchell Black , Georgios Fainekos , Bardh Hoxha , Danil Prokhorov , Dimitra Panagou

We present an approach for satisfying state constraints in systems with nonparametric uncertainty by estimating this uncertainty with a real-time-update Gaussian process (GP) model. Notably, new data is incorporated into the model in real…

Systems and Control · Electrical Eng. & Systems 2025-05-13 Ricardo Gutierrez , Jesse B. Hoagg

Reinforcement Learning (RL) applications in real-world scenarios must prioritize safety and reliability, which impose strict constraints on agent behavior. Model-based RL leverages predictive world models for action planning and policy…

Artificial Intelligence · Computer Science 2025-06-06 Artem Latyshev , Gregory Gorbov , Aleksandr I. Panov

Control Barrier Functions (CBFs) have become powerful tools for ensuring safety in nonlinear systems. However, finding valid CBFs that guarantee persistent safety and feasibility remains an open challenge, especially in systems with input…

Robotics · Computer Science 2025-03-05 Taekyung Kim , Robin Inho Kee , Dimitra Panagou

Applying reinforcement learning to autonomous driving entails particular challenges, primarily due to dynamically changing traffic flows. To address such challenges, it is necessary to quickly determine response strategies to the changing…

Robotics · Computer Science 2022-12-12 Se-Wook Yoo , Chan Kim , Jin-Woo Choi , Seong-Woo Kim , Seung-Woo Seo

Action-constrained reinforcement learning (RL) is a widely-used approach in various real-world applications, such as scheduling in networked systems with resource constraints and control of a robot with kinematic constraints. While the…

Machine Learning · Computer Science 2021-08-03 Jyun-Li Lin , Wei Hung , Shang-Hsuan Yang , Ping-Chun Hsieh , Xi Liu

As autonomous systems become more ubiquitous in daily life, ensuring high performance with guaranteed safety is crucial. However, safety and performance could be competing objectives, which makes their co-optimization difficult.…

Robotics · Computer Science 2025-05-29 Manan Tayal , Aditya Singh , Shishir Kolathaya , Somil Bansal

Control barrier functions (CBFs) have recently been introduced as a systematic tool to ensure safety by establishing set invariance. When combined with a control Lyapunov function (CLF), they form a safety-critical control mechanism.…

Systems and Control · Electrical Eng. & Systems 2024-04-22 Mohammad Aali , Jun Liu

Lane-change maneuvers are commonly executed by drivers to follow a certain routing plan, overtake a slower vehicle, adapt to a merging lane ahead, etc. However, improper lane change behaviors can be a major cause of traffic flow disruptions…

Machine Learning · Computer Science 2020-05-22 Fei Ye , Xuxin Cheng , Pin Wang , Ching-Yao Chan , Jiucai Zhang

A model used for velocity control during car following was proposed based on deep reinforcement learning (RL). To fulfil the multi-objectives of car following, a reward function reflecting driving safety, efficiency, and comfort was…

Machine Learning · Computer Science 2020-07-14 Meixin Zhu , Yinhai Wang , Ziyuan Pu , Jingyun Hu , Xuesong Wang , Ruimin Ke

Lane change in dense traffic typically requires the recognition of an appropriate opportunity for maneuvers, which remains a challenging problem in self-driving. In this work, we propose a chance-aware lane-change strategy with high-level…

Robotics · Computer Science 2024-02-19 Yubin Wang , Yulin Li , Zengqi Peng , Hakim Ghazzai , Jun Ma

In the field of autonomous robots, reinforcement learning (RL) is an increasingly used method to solve the task of dynamic obstacle avoidance for mobile robots, autonomous ships, and drones. A common practice to train those agents is to use…

Robotics · Computer Science 2022-12-09 Fabian Hart , Ostap Okhrin