中文
相关论文

相关论文: Oracle-Guided Soft Shielding for Safe Move Predict…

200 篇论文

For flexible yet safe imitation learning (IL), we propose theory and a modular method, with a safety layer that enables a closed-form probability density/gradient of the safe generative continuous policy, end-to-end generative adversarial…

机器学习 · 计算机科学 2023-07-31 Philipp Geiger , Christoph-Nikolas Straehle

Reinforcement learning is a powerful technique for learning from trial and error, but it often requires a large number of interactions to achieve good performance. In some domains, such as sparse-reward tasks, an oracle that can provide…

人工智能 · 计算机科学 2023-09-22 Zhourui Guo , Meng Yao , Yang Yu , Qiyue Yin

In recent years, Deep Reinforcement Learning (DRL) has emerged as an effective approach to solving real-world tasks. However, despite their successes, DRL-based policies suffer from poor reliability, which limits their deployment in…

机器学习 · 计算机科学 2024-06-24 Davide Corsi , Guy Amir , Andoni Rodriguez , Cesar Sanchez , Guy Katz , Roy Fox

It is challenging to use reinforcement learning (RL) in cyber-physical systems due to the lack of safety guarantees during learning. Although there have been various proposals to reduce undesired behaviors during learning, most of these…

When applying offline reinforcement learning (RL) in healthcare scenarios, the out-of-distribution (OOD) issues pose significant risks, as inappropriate generalization beyond clinical expertise can result in potentially harmful…

机器学习 · 计算机科学 2025-05-23 Runze Yan , Xun Shen , Akifumi Wachi , Sebastien Gros , Anni Zhao , Xiao Hu

Safe exploration aims at addressing the limitations of Reinforcement Learning (RL) in safety-critical scenarios, where failures during trial-and-error learning may incur high costs. Several methods exist to incorporate external knowledge or…

机器学习 · 计算机科学 2023-07-13 Xiaotong Ji , Antonio Filieri

In this paper, we consider the important problem of safe exploration in reinforcement learning. While reinforcement learning is well-suited to domains with complex transition dynamics and high-dimensional state-action spaces, an additional…

机器学习 · 计算机科学 2014-02-05 Javier Garcia , Fernando Fernandez

Modern navigation algorithms based on deep reinforcement learning (RL) show promising efficiency and robustness. However, most deep RL algorithms operate in a risk-neutral manner, making no special attempt to shield users from relatively…

机器学习 · 计算机科学 2021-04-12 Jinyoung Choi , Christopher R. Dance , Jung-eun Kim , Seulbin Hwang , Kyung-sik Park

The deployment of robots in uncontrolled environments requires them to operate robustly under previously unseen scenarios, like irregular terrain and wind conditions. Unfortunately, while rigorous safety frameworks from robust optimal…

机器学习 · 计算机科学 2024-06-11 Kai-Chieh Hsu , Duy Phuong Nguyen , Jaime Fernández Fisac

Autonomous exploration of cluttered environments requires efficient exploration strategies that guarantee safety against potential collisions with unknown random obstacles. This paper presents a novel approach combining a graph neural…

机器人学 · 计算机科学 2025-04-23 Gabriele Calzolari , Vidya Sumathy , Christoforos Kanellakis , George Nikolakopoulos

Multi-Agent Reinforcement Learning (MARL) discovers policies that maximize reward but do not have safety guarantees during the learning and deployment phases. Although shielding with Linear Temporal Logic (LTL) is a promising formal method…

机器学习 · 计算机科学 2023-04-14 Wenli Xiao , Yiwei Lyu , John Dolan

Soft robotic manipulators offer operational advantage due to their compliant and deformable structures. However, their inherently nonlinear dynamics presents substantial challenges. Traditional analytical methods often depend on simplifying…

机器人学 · 计算机科学 2024-10-28 Uljad Berdica , Matthew Jackson , Niccolò Enrico Veronese , Jakob Foerster , Perla Maiolino

In safe reinforcement learning, agent needs to balance between exploration actions and safety constraints. Following this paradigm, domain transfer approaches learn a prior Q-function from the related environments to prevent unsafe actions.…

机器学习 · 计算机科学 2025-04-29 Duc Kien Doan , Bang Giang Le , Viet Cuong Ta

Unseen shifts in environment dynamics, driven by hidden parameters such as friction or gravity, create a challenge for maintaining safety. We address this challenge by proposing Adaptive Shielding, a framework for safe reinforcement…

机器学习 · 计算机科学 2026-02-03 Minjae Kwon , Tyler Ingebrand , Ufuk Topcu , Lu Feng

Safety is one of the biggest concerns to applying reinforcement learning (RL) to the physical world. In its core part, it is challenging to ensure RL agents persistently satisfy a hard state constraint without white-box or black-box…

机器人学 · 计算机科学 2023-10-19 Weiye Zhao , Tairan He , Changliu Liu

Offline safe reinforcement learning (RL) aims to train a policy that satisfies constraints using a pre-collected dataset. Most current methods struggle with the mismatch between imperfect demonstrations and the desired safe and rewarding…

机器学习 · 计算机科学 2024-07-23 Yihang Yao , Zhepeng Cen , Wenhao Ding , Haohong Lin , Shiqi Liu , Tingnan Zhang , Wenhao Yu , Ding Zhao

Efficient exploration remains a major challenge for reinforcement learning. One reason is that the variability of the returns often depends on the current state and action, and is therefore heteroscedastic. Classical exploration strategies…

机器学习 · 计算机科学 2019-03-26 Nikolay Nikolov , Johannes Kirschner , Felix Berkenkamp , Andreas Krause

Shielding is a popular technique for achieving safe reinforcement learning (RL). However, classical shielding approaches come with quite restrictive assumptions making them difficult to deploy in complex environments, particularly those…

机器学习 · 计算机科学 2024-02-02 Alexander W. Goodall , Francesco Belardinelli

The applicability of reinforcement learning (RL) algorithms in real-world domains often requires adherence to safety constraints, a need difficult to address given the asymptotic nature of the classic RL optimization objective. In contrast…

机器学习 · 计算机科学 2021-04-15 Moritz A. Zanger , Karam Daaboul , J. Marius Zöllner

Black-box adversarial attacks that minimize only the ground-truth confidence suffer from class drift: perturbations wander through the feature space without committing to a specific adversarial class, wasting queries on diffuse, undirected…

机器学习 · 计算机科学 2026-05-26 Florent Tariolle , Florian Yger