中文
相关论文

相关论文: Kernel-Based Safe Exploration in Deep Reinforcemen…

200 篇论文

Ensuring safe exploration in high-dimensional systems with unknown dynamics remains a significant challenge. Existing safe reinforcement learning methods often provide safety guarantees only in expectation, which can still lead to safety…

机器学习 · 计算机科学 2026-04-28 Rahul Narava , Siddharth Verma , Ojas Jain , Shashi Shekhar Jha , Mayank Shekhar Jha

Achieving safe autonomous navigation systems is critical for deploying robots in dynamic and uncertain real-world environments. In this paper, we propose a hierarchical control framework leveraging neural network verification techniques to…

人工智能 · 计算机科学 2025-05-01 Luca Marzari , Francesco Trotti , Enrico Marchesini , Alessandro Farinelli

Safe exploration is essential for the practical use of reinforcement learning (RL) in many real-world scenarios. In this paper, we present a generalized safe exploration (GSE) problem as a unified formulation of common safe exploration…

机器学习 · 计算机科学 2023-10-06 Akifumi Wachi , Wataru Hashimoto , Xun Shen , Kazumune Hashimoto

In this paper, we consider the important problem of safe exploration in reinforcement learning. While reinforcement learning is well-suited to domains with complex transition dynamics and high-dimensional state-action spaces, an additional…

机器学习 · 计算机科学 2014-02-05 Javier Garcia , Fernando Fernandez

We consider the problem of safely exploring a static and unknown environment while learning valid control barrier functions (CBFs) from sensor data. Existing works either assume known environments, target specific dynamics models, or use…

系统与控制 · 电气工程与系统科学 2025-04-03 Paul Lutkus , Deepika Anantharaman , Stephen Tu , Lars Lindemann

Reinforcement learning algorithms need exploration to learn. However, unsupervised exploration prevents the deployment of such algorithms on safety-critical tasks and limits real-world deployment. In this paper, we propose a new algorithm…

机器学习 · 计算机科学 2024-02-07 Sven Gronauer , Tom Haider , Felippe Schmoeller da Roza , Klaus Diepold

Safe reinforcement learning (SafeRL) extends standard reinforcement learning with the idea of safety, where safety is typically defined through the constraint of the expected cost return of a trajectory being below a set limit. However,…

机器学习 · 计算机科学 2024-09-04 David Eckel , Baohe Zhang , Joschka Bödecker

Control barrier functions are widely used to enforce safety properties in robot motion planning and control. However, the problem of constructing barrier functions online and synthesizing safe controllers that can deal with the associated…

机器人学 · 计算机科学 2021-02-12 Kehan Long , Cheng Qian , Jorge Cortés , Nikolay Atanasov

This paper presents a constrained policy gradient algorithm. We introduce constraints for safe learning with the following steps. First, learning is slowed down (lazy learning) so that the episodic policy change can be computed with the…

机器学习 · 计算机科学 2022-01-24 Balázs Varga , Balázs Kulcsár , Morteza Haghir Chehreghani

Reinforcement learning is a widely used approach to autonomous navigation, showing potential in various tasks and robotic setups. Still, it often struggles to reach distant goals when safety constraints are imposed (e.g., the wheeled robot…

机器人学 · 计算机科学 2024-08-27 Brian Angulo , Gregory Gorbov , Aleksandr Panov , Konstantin Yakovlev

This paper investigates the automatic exploration problem under the unknown environment, which is the key point of applying the robotic system to some social tasks. The solution to this problem via stacking decision rules is impossible to…

机器人学 · 计算机科学 2020-07-24 Haoran Li , Qichao Zhang , Dongbin Zhao

We consider the problem of reinforcement learning under safety requirements, in which an agent is trained to complete a given task, typically formalized as the maximization of a reward signal over time, while concurrently avoiding…

Safety filters, particularly those based on control barrier functions, have gained increased interest as effective tools for safe control of dynamical systems. Existing correct-by-construction synthesis algorithms for such filters, however,…

机器学习 · 计算机科学 2025-09-19 Ihab Tabbara , Hussein Sibai

This paper introduces the reinforcement learning backup shield (RLBUS), an algorithm that guarantees safe exploration in reinforcement learning (RL) by incorporating backup control barrier functions (BCBFs). RLBUS constructs an implicit…

系统与控制 · 电气工程与系统科学 2024-12-10 Pedram Rabiee , Amirsaeid Safari

Reinforcement learning is a powerful technique for developing new robot behaviors. However, typical lack of safety guarantees constitutes a hurdle for its practical application on real robots. To address this issue, safe reinforcement…

机器学习 · 计算机科学 2024-04-29 Maeva Guerrier , Hassan Fouad , Giovanni Beltrame

Safe exploration aims at addressing the limitations of Reinforcement Learning (RL) in safety-critical scenarios, where failures during trial-and-error learning may incur high costs. Several methods exist to incorporate external knowledge or…

机器学习 · 计算机科学 2023-07-13 Xiaotong Ji , Antonio Filieri

A key challenge in applying reinforcement learning to safety-critical domains is understanding how to balance exploration (needed to attain good performance on the task) with safety (needed to avoid catastrophic failure). Although a growing…

机器学习 · 计算机科学 2021-03-23 Melrose Roderick , Vaishnavh Nagarajan , J. Zico Kolter

Autonomous exploration of cluttered environments requires efficient exploration strategies that guarantee safety against potential collisions with unknown random obstacles. This paper presents a novel approach combining a graph neural…

机器人学 · 计算机科学 2025-04-23 Gabriele Calzolari , Vidya Sumathy , Christoforos Kanellakis , George Nikolakopoulos

This paper studies safe Reinforcement Learning (safe RL) with linear function approximation and under hard instantaneous constraints where unsafe actions must be avoided at each step. Existing studies have considered safe RL with hard…

机器学习 · 计算机科学 2023-12-25 Honghao Wei , Xin Liu , Lei Ying

Safe reinforcement learning (RL) with assured satisfaction of hard state constraints during training has recently received a lot of attention. Safety filters, e.g., based on control barrier functions (CBFs), provide a promising way for safe…

机器人学 · 计算机科学 2023-08-30 Yikun Cheng , Pan Zhao , Naira Hovakimyan