English
Related papers

Related papers: Model-based Chance-Constrained Reinforcement Learn…

200 papers

In safe reinforcement learning (SRL) problems, an agent explores the environment to maximize an expected total reward and meanwhile avoids violation of certain constraints on a number of expected total costs. In general, such SRL problems…

Machine Learning · Computer Science 2021-06-01 Tengyu Xu , Yingbin Liang , Guanghui Lan

Modern approaches to autonomous driving rely heavily on learned components trained with large amounts of human driving data via imitation learning. However, these methods require large amounts of expensive data collection and even then face…

Inverse Reinforcement Learning (IRL) aims to facilitate a learner's ability to imitate expert behavior by acquiring reward functions that explain the expert's decisions. Regularized IRL applies strongly convex regularizers to the learner's…

Machine Learning · Computer Science 2020-12-04 Wonseok Jeon , Chen-Yang Su , Paul Barde , Thang Doan , Derek Nowrouzezahrai , Joelle Pineau

Risk-aware control, though with promise to tackle unexpected events, requires a known exact dynamical model. In this work, we propose a model-free framework to learn a risk-aware controller with a focus on the linear system. We formulate it…

Systems and Control · Electrical Eng. & Systems 2021-06-01 Feiran Zhao , Keyou You

Many autonomous systems face safety challenges, requiring robust closed-loop control to handle physical limitations and safety constraints. Real-world systems, like autonomous ships, encounter nonlinear dynamics and environmental…

Robotics · Computer Science 2024-04-03 Aksel Vaaler , Svein Jostein Husa , Daniel Menges , Thomas Nakken Larsen , Adil Rasheed

Reinforcement Learning (RL) has demonstrated a huge potential in learning optimal policies without any prior knowledge of the process to be controlled. Model Predictive Control (MPC) is a popular control technique which is able to deal with…

Systems and Control · Computer Science 2019-04-10 Mario Zanon , Sébastien Gros , Alberto Bemporad

Safety-critical applications require controllers/policies that can guarantee safety with high confidence. The control barrier function is a useful tool to guarantee safety if we have access to the ground-truth system dynamics. In practice,…

Machine Learning · Computer Science 2021-12-30 Athindran Ramesh Kumar , Sulin Liu , Jaime F. Fisac , Ryan P. Adams , Peter J. Ramadge

Reinforcement learning (RL) has been successfully applied to a variety of robotics applications, where it outperforms classical methods. However, the safety aspect of RL and the transfer to the real world remain an open challenge. A…

Robotics · Computer Science 2025-04-21 Murad Dawood , Ahmed Shokry , Maren Bennewitz

Robotic insertion tasks are characterized by contact and friction mechanics, making them challenging for conventional feedback control methods due to unmodeled physical effects. Reinforcement learning (RL) is a promising approach for…

Machine Learning · Computer Science 2020-05-26 Gerrit Schoettler , Ashvin Nair , Juan Aparicio Ojea , Sergey Levine , Eugen Solowjow

A longstanding goal in safe reinforcement learning (RL) is a method to ensure the safety of a policy throughout the entire process, from learning to operation. However, existing safe RL paradigms inherently struggle to achieve this…

Machine Learning · Computer Science 2025-05-29 Akifumi Wachi , Kohei Miyaguchi , Takumi Tanabe , Rei Sato , Youhei Akimoto

We consider the safe reinforcement learning (RL) problem of maximizing utility with extremely low constraint violation rates. Assuming no prior knowledge or pre-training of the environment safety model given a task, an agent has to learn,…

Machine Learning · Computer Science 2022-10-12 Haonan Yu , Wei Xu , Haichao Zhang

Inverse reinforcement learning (IRL) aims to explain observed strategic behavior by fitting reinforcement learning models to behavioral data. However, traditional IRL methods are only applicable when the observations are in the form of…

Machine Learning · Computer Science 2018-06-26 Antti Kangasrääsiö , Samuel Kaski

Imitation learning (IL) has shown great success in learning complex robot manipulation tasks. However, there remains a need for practical safety methods to justify widespread deployment. In particular, it is important to certify that a…

Control applications present hard operational constraints. A violation of these can result in unsafe behavior. This paper introduces Safe Interactive Model Based Learning (SiMBL), a framework to refine an existing controller and a system…

Systems and Control · Electrical Eng. & Systems 2019-11-19 Marco Gallieri , Seyed Sina Mirrazavi Salehian , Nihat Engin Toklu , Alessio Quaglino , Jonathan Masci , Jan Koutník , Faustino Gomez

Safe reinforcement learning (RL) studies problems where an intelligent agent has to not only maximize reward but also avoid exploring unsafe areas. In this study, we propose CUP, a novel policy optimization method based on Constrained…

Machine Learning · Computer Science 2022-11-10 Long Yang , Jiaming Ji , Juntao Dai , Linrui Zhang , Binbin Zhou , Pengfei Li , Yaodong Yang , Gang Pan

Continuous reinforcement learning such as DDPG and A3C are widely used in robot control and autonomous driving. However, both methods have theoretical weaknesses. While DDPG cannot control noises in the control process, A3C does not satisfy…

Machine Learning · Computer Science 2019-08-09 Tianhao Chen , Limei Cheng , Yang Liu , Wenchuan Jia , Shugen Ma

Imitation Learning has provided a promising approach to learning complex robot behaviors from expert demonstrations. However, learned policies can make errors that lead to safety violations, which limits their deployment in safety-critical…

Robotics · Computer Science 2025-08-06 Le Qiu , Yusuf Umut Ciftci , Somil Bansal

Most reinforcement learning (RL) approaches for the decision-making of autonomous driving consider safety as a reward instead of a cost, which makes it hard to balance the tradeoff between safety and other objectives. Human risk preference…

Robotics · Computer Science 2025-03-05 Yang Li , Shijie Yuan , Yuan Chang , Xiaolong Chen , Qisong Yang , Zhiyuan Yang , Hongmao Qin

Constrained Reinforcement Learning (CRL) is a subset of machine learning that introduces constraints into the traditional reinforcement learning (RL) framework. Unlike conventional RL which aims solely to maximize cumulative rewards, CRL…

Artificial Intelligence · Computer Science 2024-12-02 Xiaoshan Lin , Sadık Bera Yüksel , Yasin Yazıcıoğlu , Derya Aksaray

This paper studies the constrained/safe reinforcement learning (RL) problem with sparse indicator signals for constraint violations. We propose a model-based approach to enable RL agents to effectively explore the environment with unknown…

Artificial Intelligence · Computer Science 2021-03-09 Zuxin Liu , Hongyi Zhou , Baiming Chen , Sicheng Zhong , Martial Hebert , Ding Zhao