English
Related papers

Related papers: Safe Exploration in Reinforcement Learning: Traini…

200 papers

While reinforcement learning produces very promising results for many applications, its main disadvantage is the lack of safety guarantees, which prevents its use in safety-critical systems. In this work, we address this issue by a safety…

Robotics · Computer Science 2023-03-15 Niklas Kochdumper , Hanna Krasowski , Xiao Wang , Stanley Bak , Matthias Althoff

Guaranteeing the safety of controllers is vital for real-world applications, but is markedly difficult when the states are not perfectly known and when the control inputs are bounded. Backup control barrier functions (bCBFs) use predictions…

Systems and Control · Electrical Eng. & Systems 2026-04-23 David E. J. van Wijk , Tamas G. Molnar , Samuel Coogan , Manoranjan Majji , Aaron D. Ames , Joel W. Burdick

Reinforcement learning algorithms discover policies that maximize reward, but do not necessarily guarantee safety during learning or execution phases. We introduce a new approach to learn optimal policies while enforcing properties…

Logic in Computer Science · Computer Science 2017-09-05 Mohammed Alshiekh , Roderick Bloem , Ruediger Ehlers , Bettina Könighofer , Scott Niekum , Ufuk Topcu

Control tasks with safety requirements under high levels of model uncertainty are increasingly common. Machine learning techniques are frequently used to address such tasks, typically by leveraging model error bounds to specify robust…

Robotics · Computer Science 2025-06-13 Alexandre Capone , Ryan Cosner , Aaaron Ames , Sandra Hirche

In recent years, semi-supervised learning (SSL) has gained significant attention due to its ability to leverage both labeled and unlabeled data to improve model performance, especially when labeled data is scarce. However, most current SSL…

Machine Learning · Computer Science 2024-05-06 Marzi Heidari , Hanping Zhang , Yuhong Guo

A longstanding goal in safe reinforcement learning (RL) is a method to ensure the safety of a policy throughout the entire process, from learning to operation. However, existing safe RL paradigms inherently struggle to achieve this…

Machine Learning · Computer Science 2025-05-29 Akifumi Wachi , Kohei Miyaguchi , Takumi Tanabe , Rei Sato , Youhei Akimoto

In real-life scenarios, a Reinforcement Learning (RL) agent aiming to maximise their reward, must often also behave in a safe manner, including at training time. Thus, much attention in recent years has been given to Safe RL, where an agent…

Machine Learning · Statistics 2025-03-26 Edwin Hamel-De le Court , Francesco Belardinelli , Alexander W. Goodall

This paper introduces a learning-based visual planner for agile drone flight in cluttered environments. The proposed planner generates collision-free waypoints in milliseconds, enabling drones to perform agile maneuvers in complex…

Robotics · Computer Science 2025-11-21 Minwoo Kim , Geunsik Bae , Jinwoo Lee , Woojae Shin , Changseung Kim , Myong-Yol Choi , Heejung Shin , Hyondong Oh

Reinforcement Learning with verifiable rewards (RLVR) has emerged as a primary learning paradigm for enhancing the reasoning capabilities of multi-modal large language models (MLLMs). However, during RL training, the enormous state space of…

Machine Learning · Computer Science 2026-03-13 Zhuoxu Huang , Mengxi Jia , Hao Sun , Xuelong Li , Jungong Han

We propose a computationally efficient approach to safe reinforcement learning (RL) for frequency regulation in power systems with high levels of variable renewable energy resources. The approach draws on set-theoretic control techniques to…

Systems and Control · Electrical Eng. & Systems 2022-03-24 Daniel Tabas , Baosen Zhang

Emerging applications in robotics and autonomous systems, such as autonomous driving and robotic surgery, often involve critical safety constraints that must be satisfied even when information about system models is limited. In this regard,…

Robotics · Computer Science 2020-02-25 Subin Huh , Insoon Yang

Fine-tuning large language models (LLMs) for downstream tasks typically exhibit a fundamental safety-capability tradeoff, where improving task performance degrades safety alignment even on benign datasets. This degradation persists across…

Deep reinforcement learning (RL) has shown promising results in the motion planning of manipulators. However, no method guarantees the safety of highly dynamic obstacles, such as humans, in RL-based manipulator control. This lack of formal…

Robotics · Computer Science 2022-05-16 Jakob Thumm , Matthias Althoff

Reinforcement learning (RL) has shown impressive success in exploring high-dimensional environments to learn complex tasks, but can often exhibit unsafe behaviors and require extensive environment interaction when exploration is…

Machine Learning · Computer Science 2021-09-22 Albert Wilcox , Ashwin Balakrishna , Brijen Thananjeyan , Joseph E. Gonzalez , Ken Goldberg

We consider the problem of safely exploring a static and unknown environment while learning valid control barrier functions (CBFs) from sensor data. Existing works either assume known environments, target specific dynamics models, or use…

Systems and Control · Electrical Eng. & Systems 2025-04-03 Paul Lutkus , Deepika Anantharaman , Stephen Tu , Lars Lindemann

Model-based Reinforcement Learning (MBRL) has shown many desirable properties for intelligent control tasks. However, satisfying safety and stability constraints during training and rollout remains an open question. We propose a new…

Systems and Control · Electrical Eng. & Systems 2024-05-28 Harry Zhang

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

Machine Learning · Computer Science 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

Deep Reinforcement Learning (RL) has shown promise in addressing complex robotic challenges. In real-world applications, RL is often accompanied by failsafe controllers as a last resort to avoid catastrophic events. While necessary for…

Robotics · Computer Science 2023-09-26 Jakob Thumm , Guillaume Pelat , Matthias Althoff

In this note, a new reciprocal resistance-based control barrier function (RRCBF) is developed to enhance the robustness of control barrier functions for disturbed affine nonlinear systems, without requiring explicit knowledge of disturbance…

Systems and Control · Electrical Eng. & Systems 2025-07-28 Xinming Wang , Zongyi Guo , Jianguo Guo , Jun Yang , Yunda Yan

In recent years, Deep Reinforcement Learning (DRL) has emerged as an effective approach to solving real-world tasks. However, despite their successes, DRL-based policies suffer from poor reliability, which limits their deployment in…

Machine Learning · Computer Science 2024-06-24 Davide Corsi , Guy Amir , Andoni Rodriguez , Cesar Sanchez , Guy Katz , Roy Fox