English
Related papers

Related papers: Lyapunov-based uncertainty-aware safe reinforcemen…

200 papers

One of the key challenges to deep reinforcement learning (deep RL) is to ensure safety at both training and testing phases. In this work, we propose a novel technique of unsupervised action planning to improve the safety of on-policy…

Robotics · Computer Science 2021-09-30 Hao-Lun Hsu , Qiuhua Huang , Sehoon Ha

This paper presents a risk-aware safe reinforcement learning (RL) control design for stochastic discrete-time linear systems. Rather than using a safety certifier to myopically intervene with the RL controller, a risk-informed safe…

Systems and Control · Electrical Eng. & Systems 2025-05-16 Babak Esmaeili , Nariman Niknejad , Hamidreza Modares

In this paper, we study a joint detection, mapping and navigation problem for a single unmanned aerial vehicle (UAV) equipped with a low complexity radar and flying in an unknown environment. The goal is to optimize its trajectory with the…

Robotics · Computer Science 2020-07-23 Anna Guerra , Francesco Guidi , Davide Dardari , Petar M. Djuric

Reinforcement Learning (RL) serves as a versatile framework for sequential decision-making, finding applications across diverse domains such as robotics, autonomous driving, recommendation systems, supply chain optimization, biology,…

Machine Learning · Computer Science 2024-08-26 Vaneet Aggarwal , Washim Uddin Mondal , Qinbo Bai

Deep Reinforcement Learning is quickly becoming a popular method for training autonomous Unmanned Aerial Vehicles (UAVs). Our work analyzes the effects of measurement uncertainty on the performance of Deep Reinforcement Learning (DRL) based…

Robotics · Computer Science 2023-03-14 Bhaskar Joshi , Dhruv Kapur , Harikumar Kandath

Control Lyapunov functions are traditionally used to design a controller which ensures convergence to a desired state, yet deriving these functions for nonlinear systems remains a complex challenge. This paper presents a novel,…

Robotics · Computer Science 2025-03-21 Luc McCutcheon , Bahman Gharesifard , Saber Fallah

Reinforcement learning (RL) enables agents to learn optimal behaviors through interaction with their environment and has been increasingly deployed in safety-critical applications, including autonomous driving. Despite its promise, RL is…

Safe reinforcement learning (RL) trains a constraint satisfaction policy by interacting with the environment. We aim to tackle a more challenging problem: learning a safe policy from an offline dataset. We study the offline safe RL problem…

Machine Learning · Computer Science 2023-06-22 Zuxin Liu , Zijian Guo , Yihang Yao , Zhepeng Cen , Wenhao Yu , Tingnan Zhang , Ding Zhao

As more inverter-connected renewable resources are integrated into the grid, frequency stability may degrade because of the reduction in mechanical inertia and damping. A common approach to mitigate this degradation in performance is to use…

Systems and Control · Electrical Eng. & Systems 2021-12-30 Wenqi Cui , Yan Jiang , Baosen Zhang

Unmanned autonomous vehicles (UAVs) rely on effective path planning and tracking control to accomplish complex tasks in various domains. Reinforcement Learning (RL) methods are becoming increasingly popular in control applications, as they…

Systems and Control · Electrical Eng. & Systems 2023-08-29 Angela Chen , Konstantinos Mitsopoulos , Raffaele Romagnoli

In traffic signal control, flow-based (optimizing the overall flow) and pressure-based methods (equalizing and alleviating congestion) are commonly used but often considered separately. This study introduces a unified framework using…

Systems and Control · Electrical Eng. & Systems 2024-01-18 Chaolun Ma , Bruce Wang , Zihao Li , Ahmadreza Mahmoudzadeh , Yunlong Zhang

Reinforcement Learning (RL) has been shown to be effective and convenient for a number of tasks in robotics. However, it requires the exploration of a sufficiently large number of state-action pairs, many of which may be unsafe or…

Model-based reinforcement learning (RL) is anticipated to exhibit higher sample efficiency compared to model-free RL by utilizing a virtual environment model. However, it is challenging to obtain sufficiently accurate representations of the…

Artificial Intelligence · Computer Science 2026-01-19 Zihao Sheng , Zilin Huang , Sikai Chen

Automated driving at unsignalized intersections is challenging due to complex multi-vehicle interactions and the need to balance safety and efficiency. Model Predictive Control (MPC) offers structured constraint handling through…

Robotics · Computer Science 2026-04-16 Saeed Rahmani , Gözde Körpe , Zhenlin , Xu , Bruno Brito , Simeon Craig Calvert , Bart van Arem

Safe reinforcement learning tasks are a challenging domain despite being very common in the real world. The widely adopted CMDP model constrains the risks in expectation, which makes room for dangerous behaviors in long-tail states. In…

Machine Learning · Computer Science 2024-08-30 Zihan Zhou , Jonathan Booher , Khashayar Rohanimanesh , Wei Liu , Aleksandr Petiushko , Animesh Garg

Reinforcement Learning (RL) is a promising approach for achieving autonomous driving due to robust decision-making capabilities. RL learns a driving policy through trial and error in traffic scenarios, guided by a reward function that…

Multi-robot navigation and path planning in continuous state and action spaces with uncertain environments remains an open challenge. Deep Reinforcement Learning (RL) is one of the most popular paradigms for solving this task, but its…

Robotics · Computer Science 2025-08-21 Jahid Chowdhury Choton , John Woods , William Hsu

Offline reinforcement learning (RL) provides a framework for learning decision-making from offline data and therefore constitutes a promising approach for real-world applications as automated driving. Self-driving vehicles (SDV) learn a…

Robotics · Computer Science 2022-06-29 Christopher Diehl , Timo Sievernich , Martin Krüger , Frank Hoffmann , Torsten Bertram

Online reinforcement learning (RL) has been widely applied in information processing scenarios, which usually exhibit much uncertainty due to the intrinsic randomness of channels and service demands. In this paper, we consider an…

Machine Learning · Computer Science 2021-06-17 Rongpeng Li

The transfer of reinforcement learning (RL) techniques into real-world applications is challenged by safety requirements in the presence of physical limitations. Most RL methods, in particular the most popular algorithms, do not support…

Systems and Control · Computer Science 2021-05-18 Kim P. Wabersich , Melanie N. Zeilinger