English
Related papers

Related papers: Safe Reinforcement Learning with Dual Robustness

200 papers

Deep Reinforcement Learning (DRL) is a subfield of machine learning for training autonomous agents that take sequential actions across complex environments. Despite its significant performance in well-known environments, it remains…

Reinforcement learning (RL) enables agents to learn optimal behaviors through interaction with their environment and has been increasingly deployed in safety-critical applications, including autonomous driving. Despite its promise, RL is…

The goal of robust constrained reinforcement learning (RL) is to optimize an agent's performance under the worst-case model uncertainty while satisfying safety or resource constraints. In this paper, we demonstrate that strong duality does…

Machine Learning · Computer Science 2025-09-23 Shaocong Ma , Ziyi Chen , Yi Zhou , Heng Huang

Reinforcement learning (RL) has been successfully applied to a variety of robotics applications, where it outperforms classical methods. However, the safety aspect of RL and the transfer to the real world remain an open challenge. A…

Robotics · Computer Science 2025-04-21 Murad Dawood , Ahmed Shokry , Maren Bennewitz

Although reinforcement learning (RL) is considered the gold standard for policy design, it may not always provide a robust solution in various scenarios. This can result in severe performance degradation when the environment is exposed to…

Machine Learning · Computer Science 2023-06-14 Juncheng Dong , Hao-Lun Hsu , Qitong Gao , Vahid Tarokh , Miroslav Pajic

Deep reinforcement learning (DRL) has gained widespread adoption in control and decision-making tasks due to its strong performance in dynamic environments. However, DRL agents are vulnerable to noisy observations and adversarial attacks,…

Machine Learning · Computer Science 2025-04-01 Derui Wang , Kristen Moore , Diksha Goel , Minjune Kim , Gang Li , Yang Li , Robin Doss , Minhui Xue , Bo Li , Seyit Camtepe , Liming Zhu

Recently, empowered with the powerful capabilities of neural networks, reinforcement learning (RL) has successfully tackled numerous challenging tasks. However, while these models demonstrate enhanced decision-making abilities, they are…

Machine Learning · Computer Science 2025-10-09 Zhengpeng Xie , Yulong Zhang

With the wide application of deep reinforcement learning (DRL) techniques in complex fields such as autonomous driving, intelligent manufacturing, and smart healthcare, how to improve its security and robustness in dynamic and changeable…

Cryptography and Security · Computer Science 2025-10-24 Wu Yichao , Wang Yirui , Ding Panpan , Wang Hailong , Zhu Bingqian , Liu Chun

Reinforcement learning (RL) involves performing exploratory actions in an unknown system. This can place a learning agent in dangerous and potentially catastrophic system states. Current approaches for tackling safe learning in RL…

Machine Learning · Computer Science 2023-03-02 David Mguni , Usman Islam , Yaqi Sun , Xiuling Zhang , Joel Jennings , Aivar Sootla , Changmin Yu , Ziyan Wang , Jun Wang , Yaodong Yang

In safety-critical robotic tasks, potential failures must be reduced, and multiple constraints must be met, such as avoiding collisions, limiting energy consumption, and maintaining balance. Thus, applying safe reinforcement learning (RL)…

Machine Learning · Computer Science 2023-12-27 Dohyeong Kim , Kyungjae Lee , Songhwai Oh

We present a reinforcement learning (RL) approach for robust optimisation of risk-aware performance criteria. To allow agents to express a wide variety of risk-reward profiles, we assess the value of a policy using rank dependent expected…

Machine Learning · Computer Science 2021-12-16 Sebastian Jaimungal , Silvana Pesenti , Ye Sheng Wang , Hariom Tatsat

Recent studies reveal that a well-trained deep reinforcement learning (RL) policy can be particularly vulnerable to adversarial perturbations on input observations. Therefore, it is crucial to train RL agents that are robust against any…

Machine Learning · Computer Science 2022-10-13 Yongyuan Liang , Yanchao Sun , Ruijie Zheng , Furong Huang

Recent studies have shown that deep reinforcement learning agents are vulnerable to small adversarial perturbations on the agent's inputs, which raises concerns about deploying such agents in the real world. To address this issue, we…

Machine Learning · Computer Science 2021-11-12 Tuomas Oikarinen , Wang Zhang , Alexandre Megretski , Luca Daniel , Tsui-Wei Weng

A deep reinforcement learning (DRL) agent observes its states through observations, which may contain natural measurement errors or adversarial noises. Since the observations deviate from the true states, they can mislead the agent into…

Machine Learning · Computer Science 2021-07-15 Huan Zhang , Hongge Chen , Chaowei Xiao , Bo Li , Mingyan Liu , Duane Boning , Cho-Jui Hsieh

Deep reinforcement learning agents achieve state-of-the-art performance in a wide range of simulated control tasks. However, successful applications to real-world problems remain limited. One reason for this dichotomy is because the learnt…

Machine Learning · Computer Science 2024-11-27 Rory Young , Nicolas Pugeault

In this paper, we consider the problem of learning safe policies for probabilistic-constrained reinforcement learning (RL). Specifically, a safe policy or controller is one that, with high probability, maintains the trajectory of the agent…

Machine Learning · Computer Science 2024-03-14 Weiqin Chen , Dharmashankar Subramanian , Santiago Paternain

Learning a risk-aware policy is essential but rather challenging in unstructured robotic tasks. Safe reinforcement learning methods open up new possibilities to tackle this problem. However, the conservative policy updates make it…

Machine Learning · Computer Science 2022-12-15 Linrui Zhang , Zichen Yan , Li Shen , Shoujie Li , Xueqian Wang , Dacheng Tao

Recently, robust reinforcement learning (RL) methods against input observation have garnered significant attention and undergone rapid evolution due to RL's potential vulnerability. Although these advanced methods have achieved reasonable…

Machine Learning · Computer Science 2024-09-04 Kosuke Nakanishi , Akihiro Kubo , Yuji Yasui , Shin Ishii

Deep reinforcement learning has made significant progress in robotic manipulation tasks and it works well in the ideal disturbance-free environment. However, in a real-world environment, both internal and external disturbances are…

Robotics · Computer Science 2020-11-09 Pingcheng Jian , Chao Yang , Di Guo , Huaping Liu , Fuchun Sun

Robust reinforcement learning (RRL) aims at seeking a robust policy to optimize the worst case performance over an uncertainty set of Markov decision processes (MDPs). This set contains some perturbed MDPs from a nominal MDP (N-MDP) that…

Machine Learning · Computer Science 2023-11-21 Ukjo Hwang , Songnam Hong