中文
相关论文

相关论文: Guiding Safe Exploration with Weakest Precondition…

200 篇论文

Policy search reinforcement learning allows robots to acquire skills by themselves. However, the learning procedure is inherently unsafe as the robot has no a-priori way to predict the consequences of the exploratory actions it takes.…

机器人学 · 计算机科学 2018-10-09 Jens Lundell , Robert Krug , Erik Schaffernicht , Todor Stoyanov , Ville Kyrki

Designing Reinforcement Learning (RL) solutions for real-life problems remains a significant challenge. A major area of concern is safety. "Shielding" is a popular technique to enforce safety in RL by turning user-defined safety…

机器学习 · 计算机科学 2024-05-31 Alexander Politowicz , Sahisnu Mazumder , Bing Liu

Safe exploration is essential for the practical use of reinforcement learning (RL) in many real-world scenarios. In this paper, we present a generalized safe exploration (GSE) problem as a unified formulation of common safe exploration…

机器学习 · 计算机科学 2023-10-06 Akifumi Wachi , Wataru Hashimoto , Xun Shen , Kazumune Hashimoto

We consider the problem of reinforcement learning under safety requirements, in which an agent is trained to complete a given task, typically formalized as the maximization of a reward signal over time, while concurrently avoiding…

The similarity among samples and the discrepancy between clusters are two crucial aspects of image clustering. However, current deep clustering methods suffer from the inaccurate estimation of either feature similarity or semantic…

计算机视觉与模式识别 · 计算机科学 2022-11-23 Chuang Niu , Hongming Shan , Ge Wang

In safe reinforcement learning, agent needs to balance between exploration actions and safety constraints. Following this paradigm, domain transfer approaches learn a prior Q-function from the related environments to prevent unsafe actions.…

机器学习 · 计算机科学 2025-04-29 Duc Kien Doan , Bang Giang Le , Viet Cuong Ta

Autonomous exploration of cluttered environments requires efficient exploration strategies that guarantee safety against potential collisions with unknown random obstacles. This paper presents a novel approach combining a graph neural…

机器人学 · 计算机科学 2025-04-23 Gabriele Calzolari , Vidya Sumathy , Christoforos Kanellakis , George Nikolakopoulos

Reinforcement learning agents naturally learn from extensive exploration. Exploration is costly and can be unsafe in $\textit{safety-critical}$ domains. This paper proposes a novel framework for incorporating domain knowledge to help guide…

机器学习 · 计算机科学 2023-04-25 Fazl Barez , Hosien Hasanbieg , Alesandro Abbate

Prompt-based models have demonstrated impressive prompt-following capability at image editing tasks. However, the models still struggle with following detailed editing prompts or performing local edits. Specifically, global image quality…

图形学 · 计算机科学 2025-10-20 Kenan Tang , Yanhong Li , Yao Qin

Safe exploration is a key to applying reinforcement learning (RL) in safety-critical systems. Existing safe exploration methods guaranteed safety under the assumption of regularity, and it has been difficult to apply them to large-scale…

机器学习 · 计算机科学 2021-11-10 Akifumi Wachi , Yunyue Wei , Yanan Sui

Balancing exploration and conservatism in the constrained setting is an important problem if we are to use reinforcement learning for meaningful tasks in the real world. In this paper, we propose a principled algorithm for safe exploration…

人工智能 · 计算机科学 2023-04-24 Alexander W. Goodall , Francesco Belardinelli

We study the problem of learning worst-case-safe parameters for programs that use neural networks as well as symbolic, human-written code. Such neurosymbolic programs arise in many safety-critical domains. However, because they can use…

机器学习 · 计算机科学 2022-03-28 Chenxi Yang , Swarat Chaudhuri

A key challenge in applying reinforcement learning to safety-critical domains is understanding how to balance exploration (needed to attain good performance on the task) with safety (needed to avoid catastrophic failure). Although a growing…

机器学习 · 计算机科学 2021-03-23 Melrose Roderick , Vaishnavh Nagarajan , J. Zico Kolter

Obtaining safety guarantees for reinforcement learning is a major challenge to achieve applicability for real-world tasks. Safety shields extend standard reinforcement learning and achieve hard safety guarantees. However, existing safety…

机器学习 · 计算机科学 2025-11-27 Jin Pin , Krasowski Hanna , Vanneaux Elena

Unsupervised pretraining has been transformative in many supervised domains. However, applying such ideas to reinforcement learning (RL) presents a unique challenge in that fine-tuning does not involve mimicking task-specific data, but…

机器学习 · 计算机科学 2025-07-15 Max Wilcoxson , Qiyang Li , Kevin Frans , Sergey Levine

Safe exploration presents a major challenge in reinforcement learning (RL): when active data collection requires deploying partially trained policies, we must ensure that these policies avoid catastrophically unsafe regions, while still…

机器学习 · 计算机科学 2021-04-27 Homanga Bharadhwaj , Aviral Kumar , Nicholas Rhinehart , Sergey Levine , Florian Shkurti , Animesh Garg

This paper addresses the problem of maintaining safety during training in Reinforcement Learning (RL), such that the safety constraint violations are bounded at any point during learning. In a variety of RL applications the safety of the…

机器学习 · 计算机科学 2023-12-19 Rohan Mitta , Hosein Hasanbeig , Jun Wang , Daniel Kroening , Yiannis Kantaros , Alessandro Abate

Designing hierarchical reinforcement learning algorithms that exhibit safe behaviour is not only vital for practical applications but also, facilitates a better understanding of an agent's decisions. We tackle this problem in the options…

人工智能 · 计算机科学 2021-07-01 Arushi Jain , Khimya Khetarpal , Doina Precup

In this paper, we consider the important problem of safe exploration in reinforcement learning. While reinforcement learning is well-suited to domains with complex transition dynamics and high-dimensional state-action spaces, an additional…

机器学习 · 计算机科学 2014-02-05 Javier Garcia , Fernando Fernandez

Exploration in environments with sparse rewards remains a fundamental challenge in reinforcement learning (RL). Existing approaches such as curriculum learning and Go-Explore often rely on hand-crafted heuristics, while curiosity-driven…

机器学习 · 计算机科学 2026-02-03 Georgios Sotirchos , Zlatan Ajanović , Jens Kober