English
Related papers

Related papers: Oracle-Guided Soft Shielding for Safe Move Predict…

200 papers

Reinforcement learning (RL) is a powerful framework for optimal decision-making and control but often lacks provable guarantees for safety-critical applications. In this paper, we introduce a novel recovery-based shielding framework that…

Machine Learning · Computer Science 2026-02-18 Alexander W. Goodall , Francesco Belardinelli

This paper addresses the problem of maintaining safety during training in Reinforcement Learning (RL), such that the safety constraint violations are bounded at any point during learning. In a variety of RL applications the safety of the…

Machine Learning · Computer Science 2023-12-19 Rohan Mitta , Hosein Hasanbeig , Jun Wang , Daniel Kroening , Yiannis Kantaros , Alessandro Abate

Reinforcement learning (RL) is ubiquitous in the development of modern AI systems. However, state-of-the-art RL agents require extensive, and potentially unsafe, interactions with their environments to learn effectively. These limitations…

Machine Learning · Computer Science 2025-08-01 Yarden As , Bhavya Sukhija , Lenart Treven , Carmelo Sferrazza , Stelian Coros , Andreas Krause

Among approaches for provably safe reinforcement learning, Model Predictive Shielding (MPS) has proven effective at complex tasks in continuous, high-dimensional state spaces, by leveraging a backup policy to ensure safety when the learned…

Artificial Intelligence · Computer Science 2024-12-24 Arko Banerjee , Kia Rahmani , Joydeep Biswas , Isil Dillig

Safe Reinforcement learning (Safe RL) aims at learning optimal policies while staying safe. A popular solution to Safe RL is shielding, which uses a logical safety specification to prevent an RL agent from taking unsafe actions. However,…

Artificial Intelligence · Computer Science 2023-03-07 Wen-Chi Yang , Giuseppe Marra , Gavin Rens , Luc De Raedt

Reinforcement learning is a promising approach to synthesizing policies for challenging robotics tasks. A key problem is how to ensure safety of the learned policy---e.g., that a walking robot does not fall over or that an autonomous car…

Machine Learning · Computer Science 2020-10-22 Osbert Bastani

In mobile robotics and autonomous driving, it is natural to model agent interactions as the Nash equilibrium of a noncooperative, dynamic game. These methods inherently rely on observations from sensors such as lidars and cameras to…

Multiagent Systems · Computer Science 2026-04-02 Tianyu Qiu , David Fridovich-Keil

Safety is a crucial property of every robotic platform: any control policy should always comply with actuator limits and avoid collisions with the environment and humans. In reinforcement learning, safety is even more fundamental for…

Robotics · Computer Science 2023-03-02 Puze Liu , Kuo Zhang , Davide Tateo , Snehal Jauhri , Zhiyuan Hu , Jan Peters , Georgia Chalvatzaki

Dynamic loco-manipulation calls for effective whole-body control and contact-rich interactions with the object and the environment. Existing learning-based control synthesis relies on training low-level skill policies and explicitly…

Robotics · Computer Science 2025-10-10 Prashanth Ravichandar , Lokesh Krishna , Nikhil Sobanbabu , Quan Nguyen

In this work, we adapt a training approach inspired by the original AlphaGo system to play the imperfect information game of Reconnaissance Blind Chess. Using only the observations instead of a full description of the game state, we first…

Artificial Intelligence · Computer Science 2022-08-04 Timo Bertram , Johannes Fürnkranz , Martin Müller

We propose an exploration method that incorporates look-ahead search over basic learnt skills and their dynamics, and use it for reinforcement learning (RL) of manipulation policies . Our skills are multi-goal policies learned in isolation…

Robotics · Computer Science 2018-11-21 Arpit Agarwal , Katharina Muelling , Katerina Fragkiadaki

Reinforcement learning has been successfully used to solve difficult tasks in complex unknown environments. However, these methods typically do not provide any safety guarantees during the learning process. This is particularly problematic,…

Systems and Control · Electrical Eng. & Systems 2019-07-02 Torsten Koller , Felix Berkenkamp , Matteo Turchetta , Joschka Boedecker , Andreas Krause

A prevailing approach for learning visuomotor policies is to employ reinforcement learning to map high-dimensional visual observations directly to action commands. However, the combination of high-dimensional visual inputs and agile…

Robotics · Computer Science 2025-10-08 Yuhang Zhang , Jiaping Xiao , Chao Yan , Mir Feroskhan

Goal-Conditioned Reinforcement Learning (GCRL) provides a versatile framework for developing unified controllers capable of handling wide ranges of tasks, exploring environments, and adapting behaviors. However, its reliance on…

Machine Learning · Computer Science 2025-02-20 Charly Pecqueux-Guézénec , Stéphane Doncieux , Nicolas Perrin-Gilbert

Imitation learning is a data-driven approach to learning policies from expert behavior, but it is prone to unreliable outcomes in out-of-sample (OOS) regions. While previous research relying on stable dynamical systems guarantees…

Machine Learning · Computer Science 2025-03-27 Amin Abyaneh , Mahrokh G. Boroujeni , Hsiu-Chin Lin , Giancarlo Ferrari-Trecate

Safe reinforcement learning (RL) is crucial for real-world applications, and multi-agent interactions introduce additional safety challenges. While Probabilistic Logic Shields (PLS) has been a powerful proposal to enforce safety in…

Artificial Intelligence · Computer Science 2025-08-28 Satchit Chatterji , Erman Acar

Modern decision-making systems, from robots to web recommendation engines, are expected to adapt: to user preferences, changing circumstances or even new tasks. Yet, it is still uncommon to deploy a dynamically learning agent (rather than a…

Machine Learning · Computer Science 2022-11-15 Shengpu Tang , Felipe Vieira Frujeri , Dipendra Misra , Alex Lamb , John Langford , Paul Mineiro , Sebastian Kochman

Identifying uncertainty and taking mitigating actions is crucial for safe and trustworthy reinforcement learning agents, especially when deployed in high-risk environments. In this paper, risk sensitivity is promoted in a model-based…

Machine Learning · Computer Science 2021-11-10 Stefan Radic Webster , Peter Flach

Closed-loop decision-making systems (e.g., lending, screening, or recidivism risk assessment) often operate under fairness and service constraints while inducing feedback effects: decisions change who appears in the future, yielding…

Machine Learning · Computer Science 2025-12-30 Wenzhang Du

Reinforcement learning is a promising approach to learning control policies for performing complex multi-agent robotics tasks. However, a policy learned in simulation often fails to guarantee even simple safety properties such as obstacle…

Systems and Control · Electrical Eng. & Systems 2020-01-01 Wenbo Zhang , Osbert Bastani , Vijay Kumar