English
Related papers

Related papers: Guiding Safe Exploration with Weakest Precondition…

200 papers

Safely exploring an unknown dynamical system is critical to the deployment of reinforcement learning (RL) in physical systems where failures may have catastrophic consequences. In scenarios where one knows little about the dynamics, diverse…

Machine Learning · Computer Science 2017-12-01 Tyler Lu , Martin Zinkevich , Craig Boutilier , Binz Roy , Dale Schuurmans

A recent body of work addresses safety constraints in explore-and-exploit systems. Such constraints arise where, for example, exploration is carried out by individuals whose welfare should be balanced with overall welfare. In this paper, we…

Computer Science and Game Theory · Computer Science 2020-06-09 Gal Bahar , Omer Ben-Porat , Kevin Leyton-Brown , Moshe Tennenholtz

In an offline reinforcement learning setting, the safe policy improvement (SPI) problem aims to improve the performance of a behavior policy according to which sample data has been generated. State-of-the-art approaches to SPI require a…

Machine Learning · Computer Science 2023-05-16 Patrick Wienhöft , Marnix Suilen , Thiago D. Simão , Clemens Dubslaff , Christel Baier , Nils Jansen

Safe reinforcement learning (RL) is crucial for deploying RL agents in real-world applications, as it aims to maximize long-term rewards while satisfying safety constraints. However, safe RL often suffers from sample inefficiency, requiring…

Machine Learning · Computer Science 2024-06-03 Shangding Gu , Laixi Shi , Yuhao Ding , Alois Knoll , Costas Spanos , Adam Wierman , Ming Jin

Safe landing is essential in robotics applications, from industrial settings to space exploration. As artificial intelligence advances, we have developed PEACE (Prompt Engineering Automation for CLIPSeg Enhancement), a system that…

Robotics · Computer Science 2025-07-01 Haechan Mark Bong , Rongge Zhang , Antoine Robillard , Giovanni Beltrame

Safe Reinforcement Learning (Safe RL) aims to ensure safety when an RL agent conducts learning by interacting with real-world environments where improper actions can induce high costs or lead to severe consequences. In this paper, we…

Machine Learning · Computer Science 2025-05-06 Hanping Zhang , Yuhong Guo

Sparse autoencoders (SAEs) enable interpretability research by decomposing entangled model activations into monosemantic features. However, under what circumstances SAEs derive most fine-grained latent features for safety, a low-frequency…

Machine Learning · Computer Science 2026-04-15 Jiaqi Weng , Han Zheng , Hanyu Zhang , Ej Zhou , Qinqin He , Jialing Tao , Hui Xue , Zhixuan Chu , Xiting Wang

Real-world reinforcement learning (RL) problems often demand that agents behave safely by obeying a set of designed constraints. We address the challenge of safe RL by coupling a safety guide based on model predictive control (MPC) with a…

Machine Learning · Computer Science 2022-03-30 Samuel Pfrommer , Tanmay Gautam , Alec Zhou , Somayeh Sojoudi

Tabular reinforcement learning methods cannot operate directly on continuous state spaces. One solution for this problem is to partition the state space. A good partitioning enables generalization during learning and more efficient…

Machine Learning · Computer Science 2025-02-05 Mohsen Ghaffari , Mahsa Varshosaz , Einar Broch Johnsen , Andrzej Wąsowski

An inherent problem of reinforcement learning is performing exploration of an environment through random actions, of which a large portion can be unproductive. Instead, exploration can be improved by initializing the learning policy with an…

Machine Learning · Computer Science 2023-08-22 Jun Jet Tai , Jordan K. Terry , Mauro S. Innocente , James Brusey , Nadjim Horri

Statistical learning methods are widely utilized in tackling complex problems due to their flexibility, good predictive performance and its ability to capture complex relationships among variables. Additionally, recently developed automatic…

Methodology · Statistics 2023-11-14 Natalia da Silva , Ignacio Alvarez-Castro , Leonardo Moreno , Andrés Sosa

In safe reinforcement learning (RL), auxiliary safety costs are used to align the agent to safe decision making. In practice, safety constraints, including cost functions and budgets, are unknown or hard to specify, as it requires…

Machine Learning · Computer Science 2025-04-24 Siow Meng Low , Akshat Kumar

Numerous heuristics and advanced approaches have been proposed for exploration in different settings for deep reinforcement learning. Noise-based exploration generally fares well with dense-shaped rewards and bonus-based exploration with…

Machine Learning · Computer Science 2025-10-22 Sebastian Griesbach , Carlo D'Eramo

Safe reinforcement learning (Safe RL) aims to ensure policy performance while satisfying safety constraints. However, most existing Safe RL methods assume benign environments, making them vulnerable to adversarial perturbations commonly…

Machine Learning · Computer Science 2026-02-19 Jialiang Fan , Shixiong Jiang , Mengyu Liu , Fanxin Kong

In high stakes environments, agents relying purely on imitation learning or reinforcement learning often struggle to avoid safety-critical errors during exploration. Existing reinforcement learning approaches for environments such as chess…

Machine Learning · Computer Science 2026-03-10 Prajit T Rajendran , Fabio Arnez , Huascar Espinoza , Agnes Delaborde , Chokri Mraidha

Real-world robot manipulation in dynamic unstructured environments requires lifelong adaptability to evolving objects, scenes and tasks. Traditional imitation learning relies on static training paradigms, which are ill-suited for lifelong…

Robotics · Computer Science 2025-04-23 Jingkai Xu , Xiangli Nie

Reinforcement learning is an appropriate and successful method to robustly perform low-level robot control under noisy conditions. Symbolic action planning is useful to resolve causal dependencies and to break a causally complex problem…

Machine Learning · Computer Science 2019-12-10 Manfred Eppe , Phuong D. H. Nguyen , Stefan Wermter

We address policy learning with logged data in contextual bandits. Current offline-policy learning algorithms are mostly based on inverse propensity score (IPS) weighting requiring the logging policy to have \emph{full support} i.e. a…

Machine Learning · Statistics 2021-07-27 Hung Tran-The , Sunil Gupta , Thanh Nguyen-Tang , Santu Rana , Svetha Venkatesh

Reinforcement learning (RL) agents improve through trial-and-error, but when reward is sparse and the agent cannot discover successful action sequences, learning stagnates. This has been a notable problem in training deep RL agents to…

Artificial Intelligence · Computer Science 2018-02-27 Evan Zheran Liu , Kelvin Guu , Panupong Pasupat , Tianlin Shi , Percy Liang

We present SafeLife, a publicly available reinforcement learning environment that tests the safety of reinforcement learning agents. It contains complex, dynamic, tunable, procedurally generated levels with many opportunities for unsafe…

Artificial Intelligence · Computer Science 2021-03-01 Carroll L. Wainwright , Peter Eckersley