中文
相关论文

相关论文: Safe Reinforcement Learning in Black-Box Environme…

200 篇论文

Reinforcement Learning (RL) is essentially a trial-and-error learning procedure which may cause unsafe behavior during the exploration-and-exploitation process. This hinders the application of RL to real-world control problems, especially…

机器学习 · 计算机科学 2021-05-03 Yutong Li , Nan Li , H. Eric Tseng , Anouck Girard , Dimitar Filev , Ilya Kolmanovsky

Reinforcement learning (RL) is a machine learning paradigm where an autonomous agent learns to make an optimal sequence of decisions by interacting with the underlying environment. The promise demonstrated by RL-guided workflows in…

密码学与安全 · 计算机科学 2022-08-31 Satwik Patnaik , Vasudev Gohil , Hao Guo , Jeyavijayan , Rajendran

In safe offline reinforcement learning (RL), the objective is to develop a policy that maximizes cumulative rewards while strictly adhering to safety constraints, utilizing only offline data. Traditional methods often face difficulties in…

机器学习 · 计算机科学 2026-02-11 Prajwal Koirala , Zhanhong Jiang , Soumik Sarkar , Cody Fleming

Ensuring reliability in modern software systems requires rigorous pre-production testing across highly heterogeneous and evolving environments. Because exhaustive evaluation is infeasible, practitioners must decide how to allocate limited…

软件工程 · 计算机科学 2025-10-08 Yu Zhu

Reinforcement learning (RL) agents with pre-specified reward functions cannot provide guaranteed safety across variety of circumstances that an uncertain system might encounter. To guarantee performance while assuring satisfaction of safety…

人工智能 · 计算机科学 2021-04-20 Aquib Mustafa , Majid Mazouchi , Subramanya Nageshrao , Hamidreza Modares

We study black-box reward poisoning attacks against reinforcement learning (RL), in which an adversary aims to manipulate the rewards to mislead a sequence of RL agents with unknown algorithms to learn a nefarious policy in an environment…

机器学习 · 计算机科学 2021-02-18 Amin Rakhsha , Xuezhou Zhang , Xiaojin Zhu , Adish Singla

Real-world autonomous decision-making systems, from robots to recommendation engines, must operate in environments that change over time. While deep reinforcement learning (RL) has shown an impressive ability to learn optimal policies in…

机器学习 · 计算机科学 2025-05-16 Jonathan Clifford Balloch

Reinforcement learning (RL) agents need to explore their environments in order to learn optimal policies. In many environments and tasks, safety is of critical importance. The widespread use of simulators offers a number of advantages,…

机器人学 · 计算机科学 2024-03-01 Luka Kovač , Igor Farkaš

Reinforcement learning (RL)-based driver assistance systems seek to improve fuel consumption via continual improvement of powertrain control actions considering experiential data from the field. However, the need to explore diverse…

机器人学 · 计算机科学 2023-01-04 Habtamu Hailemichael , Beshah Ayalew , Lindsey Kerbel , Andrej Ivanco , Keith Loiselle

This paper addresses the problem of maintaining safety during training in Reinforcement Learning (RL), such that the safety constraint violations are bounded at any point during learning. In a variety of RL applications the safety of the…

机器学习 · 计算机科学 2023-12-19 Rohan Mitta , Hosein Hasanbeig , Jun Wang , Daniel Kroening , Yiannis Kantaros , Alessandro Abate

This paper targets the efficient construction of a safety shield for decision making in scenarios that incorporate uncertainty. Markov decision processes (MDPs) are prominent models to capture such planning problems. Reinforcement learning…

人工智能 · 计算机科学 2019-11-26 Nils Jansen , Bettina Könighofer , Sebastian Junges , Alexandru C. Serban , Roderick Bloem

Safe Reinforcement Learning (RL) plays an important role in applying RL algorithms to safety-critical real-world applications, addressing the trade-off between maximizing rewards and adhering to safety constraints. This work introduces a…

机器人学 · 计算机科学 2024-07-16 Fan Yang , Wenxuan Zhou , Zuxin Liu , Ding Zhao , David Held

While safe reinforcement learning (RL) holds great promise for many practical applications like robotics or autonomous cars, current approaches require specifying constraints in mathematical form. Such specifications demand domain…

计算与语言 · 计算机科学 2021-08-05 Tsung-Yen Yang , Michael Hu , Yinlam Chow , Peter J. Ramadge , Karthik Narasimhan

Reinforcement learning (RL) offers a compelling data-driven paradigm for synthesizing controllers for complex systems when accurate physical models are unavailable; however, most existing control-oriented RL methods assume stationarity and,…

机器学习 · 计算机科学 2026-04-22 Austin Coursey , Abel Diaz-Gonzalez , Marcos Quinones-Grueiro , Gautam Biswas

Recently, robust reinforcement learning (RL) methods designed to handle adversarial input observations have received significant attention, motivated by RL's inherent vulnerabilities. While existing approaches have demonstrated reasonable…

机器学习 · 计算机科学 2025-06-23 Kosuke Nakanishi , Akihiro Kubo , Yuji Yasui , Shin Ishii

Adversarial examples can be useful for identifying vulnerabilities in AI systems before they are deployed. In reinforcement learning (RL), adversarial policies can be developed by training an adversarial agent to minimize a target agent's…

人工智能 · 计算机科学 2023-10-17 Stephen Casper , Taylor Killian , Gabriel Kreiman , Dylan Hadfield-Menell

This paper studies safe Reinforcement Learning (safe RL) with linear function approximation and under hard instantaneous constraints where unsafe actions must be avoided at each step. Existing studies have considered safe RL with hard…

机器学习 · 计算机科学 2023-12-25 Honghao Wei , Xin Liu , Lei Ying

Autonomous vehicles inevitably encounter a vast array of scenarios in real-world environments. Addressing long-tail scenarios, particularly those involving intensive interactions with numerous traffic participants, remains one of the most…

机器人学 · 计算机科学 2024-12-16 Guanzhou Li , Jianping Wu , Yujing He

Advancements in reinforcement learning (RL) have been remarkable in recent years. However, the limitations of traditional training methods have become increasingly evident, particularly in meta-RL settings where agents face new, unseen…

机器学习 · 计算机科学 2023-02-07 Ramnath Kumar , Tristan Deleu , Yoshua Bengio

Deep neural networks coupled with fast simulation and improved computation have led to recent successes in the field of reinforcement learning (RL). However, most current RL-based approaches fail to generalize since: (a) the gap between…

机器学习 · 计算机科学 2017-03-09 Lerrel Pinto , James Davidson , Rahul Sukthankar , Abhinav Gupta