English
Related papers

Related papers: Safe Exploration in Reinforcement Learning: A Gene…

200 papers

The increasing use of Machine Learning (ML) components embedded in autonomous systems -- so-called Learning-Enabled Systems (LESs) -- has resulted in the pressing need to assure their functional safety. As for traditional functional safety,…

Software Engineering · Computer Science 2023-01-16 Yi Dong , Wei Huang , Vibhav Bharti , Victoria Cox , Alec Banks , Sen Wang , Xingyu Zhao , Sven Schewe , Xiaowei Huang

Learning from diverse offline datasets is a promising path towards learning general purpose robotic agents. However, a core challenge in this paradigm lies in collecting large amounts of meaningful data, while not depending on a human in…

Robotics · Computer Science 2021-04-27 Annie S. Chen , HyunJi Nam , Suraj Nair , Chelsea Finn

As reinforcement learning algorithms are being applied to increasingly complicated and realistic tasks, it is becoming increasingly difficult to solve such problems within a practical time frame. Hence, we focus on a \textit{satisficing}…

Artificial Intelligence · Computer Science 2025-04-16 Akihiro Tamatsukuri , Tatsuji Takahashi

Building generally capable agents is a grand challenge for deep reinforcement learning (RL). To approach this challenge practically, we outline two key desiderata: 1) to facilitate generalization, exploration should be task agnostic; 2) to…

Generalization in reinforcement learning (RL) is of importance for real deployment of RL algorithms. Various schemes are proposed to address the generalization issues, including transfer learning, multi-task learning and meta learning, as…

Machine Learning · Computer Science 2022-10-07 Chang Yang , Ruiyu Wang , Xinrun Wang , Zhen Wang

Ensuring the safe exploration of reinforcement learning (RL) agents is critical for deployment in real-world systems. Yet existing approaches struggle to strike the right balance: methods that tightly enforce safety often cripple task…

Machine Learning · Computer Science 2026-02-19 Daniel Bethell , Simos Gerasimou , Radu Calinescu , Calum Imrie

We present Revel, a partially neural reinforcement learning (RL) framework for provably safe exploration in continuous state and action spaces. A key challenge for provably safe deep RL is that repeatedly verifying neural networks within a…

Machine Learning · Computer Science 2020-10-27 Greg Anderson , Abhinav Verma , Isil Dillig , Swarat Chaudhuri

Planning safe trajectories under model uncertainty is a fundamental challenge. Robust planning ensures safety by considering worst-case realizations, yet ignores uncertainty reduction and leads to overly conservative behavior. Actively…

Robotics · Computer Science 2026-05-26 Kaleb Ben Naveed , Devansh R. Agrawal , Dimitra Panagou

A trustworthy reinforcement learning algorithm should be competent in solving challenging real-world problems, including {robustly} handling uncertainties, satisfying {safety} constraints to avoid catastrophic failures, and {generalizing}…

Machine Learning · Computer Science 2022-09-19 Mengdi Xu , Zuxin Liu , Peide Huang , Wenhao Ding , Zhepeng Cen , Bo Li , Ding Zhao

Reinforcement Learning has emerged as a strong alternative to solve optimization tasks efficiently. The use of these algorithms highly depends on the feedback signals provided by the environment in charge of informing about how good (or…

Machine Learning · Computer Science 2022-12-01 Alain Andres , Esther Villar-Rodriguez , Javier Del Ser

With the increasing need for handling large state and action spaces, general function approximation has become a key technique in reinforcement learning (RL). In this paper, we propose a general framework that unifies model-based and…

Machine Learning · Computer Science 2022-10-03 Zixiang Chen , Chris Junchi Li , Angela Yuan , Quanquan Gu , Michael I. Jordan

Designing hierarchical reinforcement learning algorithms that exhibit safe behaviour is not only vital for practical applications but also, facilitates a better understanding of an agent's decisions. We tackle this problem in the options…

Artificial Intelligence · Computer Science 2021-07-01 Arushi Jain , Khimya Khetarpal , Doina Precup

Driving safely requires multiple capabilities from human and intelligent agents, such as the generalizability to unseen environments, the safety awareness of the surrounding traffic, and the decision-making in complex multi-agent settings.…

Machine Learning · Computer Science 2022-07-19 Quanyi Li , Zhenghao Peng , Lan Feng , Qihang Zhang , Zhenghai Xue , Bolei Zhou

Reinforcement learning has been successfully used to solve difficult tasks in complex unknown environments. However, these methods typically do not provide any safety guarantees during the learning process. This is particularly problematic,…

Systems and Control · Electrical Eng. & Systems 2019-07-02 Torsten Koller , Felix Berkenkamp , Matteo Turchetta , Joschka Boedecker , Andreas Krause

Safety is a critical component of autonomous systems and remains a challenge for learning-based policies to be utilized in the real world. In particular, policies learned using reinforcement learning often fail to generalize to novel…

Robotics · Computer Science 2023-04-04 Kai-Chieh Hsu , Allen Z. Ren , Duy Phuong Nguyen , Anirudha Majumdar , Jaime F. Fisac

We consider the problem of learning the optimal policy for Markov decision processes with safety constraints. We formulate the problem in a reach-avoid setup. Our goal is to design online reinforcement learning algorithms that ensure safety…

Machine Learning · Computer Science 2026-01-21 Abhijit Mazumdar , Rafal Wisniewski , Manuela L. Bujorianu

Conveying complex objectives to reinforcement learning (RL) agents often requires meticulous reward engineering. Preference-based RL methods are able to learn a more flexible reward model based on human preferences by actively incorporating…

Machine Learning · Computer Science 2022-05-26 Xinran Liang , Katherine Shu , Kimin Lee , Pieter Abbeel

Online model-free reinforcement learning (RL) methods with continuous actions are playing a prominent role when dealing with real-world applications such as Robotics. However, when confronted to non-stationary environments, these methods…

Machine Learning · Computer Science 2016-10-07 Mehdi Khamassi , Costas Tzafestas

Safety is critical to broadening the application of reinforcement learning (RL). Often, we train RL agents in a controlled environment, such as a laboratory, before deploying them in the real world. However, the real-world target task might…

Machine Learning · Computer Science 2024-03-22 Qisong Yang , Thiago D. Simão , Nils Jansen , Simon H. Tindemans , Matthijs T. J. Spaan

Advancements in reinforcement learning (RL) have inspired new directions in intelligent automation of network defense. However, many of these advancements have either outpaced their application to network security or have not considered the…