English
Related papers

Related papers: Safe reinforcement learning in uncertain contexts

200 papers

One of the great promises of robot learning systems is that they will be able to learn from their mistakes and continuously adapt to ever-changing environments. Despite this potential, most of the robot learning systems today are deployed…

Machine Learning · Computer Science 2020-08-03 Ryan Julian , Benjamin Swanson , Gaurav S. Sukhatme , Sergey Levine , Chelsea Finn , Karol Hausman

Reinforcement Learning (RL) algorithms show amazing performance in recent years, but placing RL in real-world applications such as self-driven vehicles may suffer safety problems. A self-driven vehicle moving to a target position following…

Systems and Control · Electrical Eng. & Systems 2022-07-05 Huanhui Cao , Zhiyuan Cai , Hairuo Wei , Wenjie Lu , Lin Zhang , Hao Xiong

Multi-armed bandit algorithms have become a reference solution for handling the explore/exploit dilemma in recommender systems, and many other important real-world problems, such as display advertisement. However, such algorithms usually…

Machine Learning · Computer Science 2018-05-25 Qingyun Wu , Naveen Iyer , Hongning Wang

Designing reliable decision strategies for autonomous urban driving is challenging. Reinforcement learning (RL) has been used to automatically derive suitable behavior in uncertain environments, but it does not provide any guarantee on the…

Deep reinforcement learning has shown remarkable success in the past few years. Highly complex sequential decision making problems from game playing and robotics have been solved with deep model-free methods. Unfortunately, the sample…

Machine Learning · Computer Science 2021-07-20 Aske Plaat , Walter Kosters , Mike Preuss

Real-world reinforcement learning (RL) problems often demand that agents behave safely by obeying a set of designed constraints. We address the challenge of safe RL by coupling a safety guide based on model predictive control (MPC) with a…

Machine Learning · Computer Science 2022-03-30 Samuel Pfrommer , Tanmay Gautam , Alec Zhou , Somayeh Sojoudi

Real-world applications require a robot operating in the physical world with awareness of potential risks besides accomplishing the task. A large part of risky behaviors arises from interacting with objects in ignorance of affordance. To…

Robotics · Computer Science 2022-06-28 Meng Song , Yuhan Liu , Zhengqin Li , Manmohan Chandraker

Regression models often fail to generalize effectively in regions characterized by highly imbalanced label distributions. Previous methods for deep imbalanced regression rely on gradient-based weight updates, which tend to overfit in…

Machine Learning · Computer Science 2024-11-21 Ismail Nejjar , Faez Ahmed , Olga Fink

Questions remain on the robustness of data-driven learning methods when crossing the gap from simulation to reality. We utilize weight anchoring, a method known from continual learning, to cultivate and fixate desired behavior in Neural…

Machine Learning · Computer Science 2023-04-21 Steffen Gracla , Edgar Beck , Carsten Bockelmann , Armin Dekorsy

Ensuring safe exploration in high-dimensional systems with unknown dynamics remains a significant challenge. Existing safe reinforcement learning methods often provide safety guarantees only in expectation, which can still lead to safety…

Machine Learning · Computer Science 2026-04-28 Rahul Narava , Siddharth Verma , Ojas Jain , Shashi Shekhar Jha , Mayank Shekhar Jha

Obtaining safety guarantees for reinforcement learning is a major challenge to achieve applicability for real-world tasks. Safety shields extend standard reinforcement learning and achieve hard safety guarantees. However, existing safety…

Machine Learning · Computer Science 2025-11-27 Jin Pin , Krasowski Hanna , Vanneaux Elena

With an increasing use of data-driven models to control robotic systems, it has become important to develop a methodology for validating such models before they can be deployed to design a controller for the actual system. Specifically, it…

Systems and Control · Computer Science 2018-03-28 Somil Bansal , Shromona Ghosh , Alberto Sangiovanni-Vincentelli , Sanjit A. Seshia , Claire J. Tomlin

We consider learning from labeled data collected across multiple environments, where the data distribution may vary across these environments. This problem is commonly approached from a causal perspective, seeking invariant representations…

Machine Learning · Statistics 2026-04-30 Yuli Slavutsky , David M. Blei

As safety violations can lead to severe consequences in real-world robotic applications, the increasing deployment of Reinforcement Learning (RL) in robotic domains has propelled the study of safe exploration for reinforcement learning…

Artificial Intelligence · Computer Science 2022-09-21 Hanping Zhang , Yuhong Guo

In recent years, advanced model-based and data-driven control methods are unlocking the potential of complex robotics systems, and we can expect this trend to continue at an exponential rate in the near future. However, ensuring safety with…

Robotics · Computer Science 2024-08-29 Gianni Lunardi , Asia La Rocca , Matteo Saveriano , Andrea Del Prete

Multi-agent systems are prevalent in a wide range of domains including power systems, vehicular networks, and robotics. Two important problems to solve in these types of systems are how the intentions of non-coordinating agents can be…

Multiagent Systems · Computer Science 2025-09-30 Benjamin Alcorn , Eman Hammad

Recent research has turned to Reinforcement Learning (RL) to solve challenging decision problems, as an alternative to hand-tuned heuristics. RL can learn good policies without the need for modeling the environment's dynamics. Despite this…

Machine Learning · Computer Science 2023-01-30 Pouya Hamadanian , Malte Schwarzkopf , Siddartha Sen , Mohammad Alizadeh

Learning to make decisions from observed data in dynamic environments remains a problem of fundamental importance in a number of fields, from artificial intelligence and robotics, to medicine and finance. This paper concerns the problem of…

Machine Learning · Statistics 2018-06-04 Jack Umenberger , Thomas B. Schön

Zero-shot learning methods typically assume that the new, unseen classes encountered during deployment come from the same distribution as the the classes in the training set. However, real-world scenarios often involve class distribution…

Machine Learning · Computer Science 2024-12-11 Yuli Slavutsky , Yuval Benjamini

Risk assessment of a robot in controlled environments, such as laboratories and proving grounds, is a common means to assess, certify, validate, verify, and characterize the robots' safety performance before, during, and even after their…

Robotics · Computer Science 2025-01-29 Linda Capito , Guillermo A. Castillo , Bowen Weng