中文
相关论文

相关论文: Learning to Recover for Safe Reinforcement Learnin…

200 篇论文

Reinforcement learning algorithms typically necessitate extensive exploration of the state space to find optimal policies. However, in safety-critical applications, the risks associated with such exploration can lead to catastrophic…

机器学习 · 计算机科学 2025-02-28 Kaustubh Mani , Vincent Mai , Charlie Gauthier , Annie Chen , Samer Nashed , Liam Paull

Reinforcement learning (RL) in real-world safety-critical target settings like urban driving is hazardous, imperiling the RL agent, other agents, and the environment. To overcome this difficulty, we propose a "safety-critical adaptation"…

机器学习 · 计算机科学 2021-01-19 Jesse Zhang , Brian Cheung , Chelsea Finn , Sergey Levine , Dinesh Jayaraman

There have been numerous advances in reinforcement learning, but the typically unconstrained exploration of the learning process prevents the adoption of these methods in many safety critical applications. Recent work in safe reinforcement…

机器学习 · 计算机科学 2019-10-02 David Isele , Alireza Nakhaei , Kikuo Fujimura

Reinforcement learning (RL) has been widely used in decision-making and control tasks, but the risk is very high for the agent in the training process due to the requirements of interaction with the environment, which seriously limits its…

机器学习 · 计算机科学 2024-09-13 Xuemin Hu , Pan Chen , Yijun Wen , Bo Tang , Long Chen

Soft robotic manipulators offer operational advantage due to their compliant and deformable structures. However, their inherently nonlinear dynamics presents substantial challenges. Traditional analytical methods often depend on simplifying…

机器人学 · 计算机科学 2024-10-28 Uljad Berdica , Matthew Jackson , Niccolò Enrico Veronese , Jakob Foerster , Perla Maiolino

Learning auxiliary tasks, such as multiple predictions about the world, can provide many benefits to reinforcement learning systems. A variety of off-policy learning algorithms have been developed to learn such predictions, but as yet there…

Goals for reinforcement learning problems are typically defined through hand-specified rewards. To design such problems, developers of learning algorithms must inherently be aware of what the task goals are, yet we often require agents to…

机器学习 · 计算机科学 2018-03-29 Ashley D. Edwards , Laura Downs , James C. Davidson

Safety-critical robot systems need thorough testing to expose design flaws and software bugs which could endanger humans. Testing in simulation is becoming increasingly popular, as it can be applied early in the development process and does…

机器人学 · 计算机科学 2023-11-07 Tom P. Huck , Martin Kaiser , Constantin Cronrath , Bengt Lennartson , Torsten Kröger , Tamim Asfour

Self-driving vehicles must be able to act intelligently in diverse and difficult environments, marked by high-dimensional state spaces, a myriad of optimization objectives and complex behaviors. Traditionally, classical optimization and…

机器人学 · 计算机科学 2020-11-11 Josiah Coad , Zhiqian Qiao , John M. Dolan

Novice pilots find it difficult to operate and land unmanned aerial vehicles (UAVs), due to the complex UAV dynamics, challenges in depth perception, lack of expertise with the control interface and additional disturbances from the ground…

机器人学 · 计算机科学 2023-10-24 Kal Backman , Dana Kulić , Hoam Chung

The growing trend of fledgling reinforcement learning systems making their way into real-world applications has been accompanied by growing concerns for their safety and robustness. In recent years, a variety of approaches have been put…

机器学习 · 计算机科学 2023-03-03 Chloe He , Borja G. Leon , Francesco Belardinelli

Ensuring safety is important for the practical deployment of reinforcement learning (RL). Various challenges must be addressed, such as handling stochasticity in the environments, providing rigorous guarantees of persistent state-wise…

机器学习 · 计算机科学 2023-09-26 Milan Ganai , Zheng Gong , Chenning Yu , Sylvia Herbert , Sicun Gao

Artificial intelligence (AI) systems possess significant potential to drive societal progress. However, their deployment often faces obstacles due to substantial safety concerns. Safe reinforcement learning (SafeRL) emerges as a solution to…

Reinforcement learning has been successfully used to solve difficult tasks in complex unknown environments. However, these methods typically do not provide any safety guarantees during the learning process. This is particularly problematic,…

系统与控制 · 电气工程与系统科学 2019-07-02 Torsten Koller , Felix Berkenkamp , Matteo Turchetta , Joschka Boedecker , Andreas Krause

This paper investigates policy resilience to training-environment poisoning attacks on reinforcement learning (RL) policies, with the goal of recovering the deployment performance of a poisoned RL policy. Due to the fact that the policy…

机器学习 · 计算机科学 2023-04-25 Hang Xu , Xinghua Qu , Zinovi Rabinovich

In this paper, we consider the problem of learning safe policies for probabilistic-constrained reinforcement learning (RL). Specifically, a safe policy or controller is one that, with high probability, maintains the trajectory of the agent…

机器学习 · 计算机科学 2024-03-14 Weiqin Chen , Dharmashankar Subramanian , Santiago Paternain

This paper presents a constrained policy gradient algorithm. We introduce constraints for safe learning with the following steps. First, learning is slowed down (lazy learning) so that the episodic policy change can be computed with the…

机器学习 · 计算机科学 2022-01-24 Balázs Varga , Balázs Kulcsár , Morteza Haghir Chehreghani

Recently, there has been a surge in interest in safe and robust techniques within reinforcement learning (RL). Current notions of risk in RL fail to capture the potential for systemic failures such as abrupt stoppages from system failures…

系统与控制 · 计算机科学 2019-10-09 David Mguni

Safety is a critical concern when deploying reinforcement learning agents for realistic tasks. Recently, safe reinforcement learning algorithms have been developed to optimize the agent's performance while avoiding violations of safety…

机器学习 · 计算机科学 2021-01-05 Baiming Chen , Zuxin Liu , Jiacheng Zhu , Mengdi Xu , Wenhao Ding , Ding Zhao

Deep reinforcement learning has enabled robots to learn motor skills from environmental interactions with minimal to no prior knowledge. However, existing reinforcement learning algorithms assume an episodic setting, in which the agent…

机器学习 · 计算机科学 2022-05-27 Jigang Kim , J. hyeon Park , Daesol Cho , H. Jin Kim