English
Related papers

Related papers: Safe Inverse Reinforcement Learning via Control Ba…

200 papers

How well do reward functions learned with inverse reinforcement learning (IRL) generalize? We illustrate that state-of-the-art IRL algorithms, which maximize a maximum-entropy objective, learn rewards that overfit to the demonstrations.…

Machine Learning · Computer Science 2023-03-29 Andrew Szot , Amy Zhang , Dhruv Batra , Zsolt Kira , Franziska Meier

Reinforcement Learning (RL) methods have been proven successful in solving manipulation tasks autonomously. However, RL is still not widely adopted on real robotic systems because working with real hardware entails additional challenges,…

Inverse reinforcement learning (IRL) is the problem of inferring the reward function of an agent, given its policy or observed behavior. Analogous to RL, IRL is perceived both as a problem and as a class of methods. By categorically…

Machine Learning · Computer Science 2020-11-19 Saurabh Arora , Prashant Doshi

This paper addresses the problem of learning a task from demonstration. We adopt the framework of inverse reinforcement learning, where tasks are represented in the form of a reward function. Our contribution is a novel active learning…

Machine Learning · Computer Science 2013-01-24 Francisco Melo , Manuel Lopes

Breaking safety constraints in control systems can lead to potential risks, resulting in unexpected costs or catastrophic damage. Nevertheless, uncertainty is ubiquitous, even among similar tasks. In this paper, we develop a novel adaptive…

Systems and Control · Electrical Eng. & Systems 2023-07-17 Shengbo Wang , Ke Li , Yin Yang , Yuting Cao , Tingwen Huang , Shiping Wen

Methods for learning from demonstration (LfD) have shown success in acquiring behavior policies by imitating a user. However, even for a single task, LfD may require numerous demonstrations. For versatile agents that must learn many tasks…

Machine Learning · Computer Science 2022-07-04 Jorge A. Mendez , Shashank Shivkumar , Eric Eaton

Learning from Demonstration (LfD) is a promising approach to enable Multi-Robot Systems (MRS) to acquire complex skills and behaviors. However, the intricate interactions and coordination challenges in MRS pose significant hurdles for…

Robotics · Computer Science 2024-04-04 Vishnunandan L. N. Venkatesh , Byung-Cheol Min

Groundbreaking successes have been achieved by Deep Reinforcement Learning (DRL) in solving practical decision-making problems. Robotics, in particular, can involve high-cost hardware and human interactions. Hence, scrupulous evaluations of…

Artificial Intelligence · Computer Science 2020-10-20 Davide Corsi , Enrico Marchesini , Alessandro Farinelli

High performance, reliability and safety are crucial properties of any Software-Defined-Networking (SDN) system. Although the use of Deep Reinforcement Learning (DRL) algorithms has been widely studied to improve performance, their…

Networking and Internet Architecture · Computer Science 2024-10-23 Lam Dinh , Pham Tran Anh Quang , Jérémie Leguay

Controlling instabilities in complex dynamical systems is challenging in scientific and engineering applications. Deep reinforcement learning (DRL) has seen promising results for applications in different scientific applications. The…

Machine Learning · Computer Science 2025-04-09 Luning Sun , Xin-Yang Liu , Siyan Zhao , Aditya Grover , Jian-Xun Wang , Jayaraman J. Thiagarajan

It is quite challenging to ensure the safety of reinforcement learning (RL) agents in an unknown and stochastic environment under hard constraints that require the system state not to reach certain specified unsafe regions. Many popular…

Systems and Control · Electrical Eng. & Systems 2023-06-14 Yixuan Wang , Simon Sinong Zhan , Ruochen Jiao , Zhilu Wang , Wanxin Jin , Zhuoran Yang , Zhaoran Wang , Chao Huang , Qi Zhu

Learning from Demonstrations (LfD) allows robots to learn skills from human users, but its effectiveness can suffer due to sub-optimal teaching, especially from untrained demonstrators. Active LfD aims to improve this by letting robots…

Robotics · Computer Science 2025-03-05 Muhan Hou , Koen Hindriks , A. E. Eiben , Kim Baraka

Imitation learning (IL) is a framework that learns to imitate expert behavior from demonstrations. Recently, IL shows promising results on high dimensional and control tasks. However, IL typically suffers from sample inefficiency in terms…

Machine Learning · Computer Science 2021-11-24 Lihua Zhang

Reinforcement learning (RL) has become the de facto method for achieving locomotion on humanoid robots in practice, yet stability analysis of the corresponding control policies is lacking. Recent work has attempted to merge control…

Systems and Control · Electrical Eng. & Systems 2026-05-07 Zachary Olkin , William D. Compton , Aaron D. Ames

Safety-critical control tasks with high levels of uncertainty are becoming increasingly common. Typically, techniques that guarantee safety during learning and control utilize constraint-based safety certificates, which can be leveraged to…

Systems and Control · Electrical Eng. & Systems 2023-11-07 Alexandre Capone , Ryan Cosner , Aaron Ames , Sandra Hirche

Reinforcement Learning (RL) is essentially a trial-and-error learning procedure which may cause unsafe behavior during the exploration-and-exploitation process. This hinders the application of RL to real-world control problems, especially…

Machine Learning · Computer Science 2021-05-03 Yutong Li , Nan Li , H. Eric Tseng , Anouck Girard , Dimitar Filev , Ilya Kolmanovsky

As the demand for mobile robots continues to increase, social navigation has emerged as a critical task, driving active research into deep reinforcement learning (RL) approaches. However, because pedestrian dynamics and social conventions…

Robotics · Computer Science 2026-04-10 Haruto Nagahisa , Kohei Matsumoto , Yuki Tomita , Yuki Hyodo , Ryo Kurazume

Learning from human demonstrations can facilitate automation but is risky because the execution of the learned policy might lead to collisions and other failures. Adding explicit constraints to avoid unsafe states is generally not possible…

Robotics · Computer Science 2018-10-17 Jonathan Lee , Michael Laskey , Roy Fox , Ken Goldberg

Learning-based control has recently shown great efficacy in performing complex tasks for various applications. However, to deploy it in real systems, it is of vital importance to guarantee the system will stay safe. Control Barrier…

Systems and Control · Electrical Eng. & Systems 2024-09-05 Fernando Castañeda , Jason J. Choi , Wonsuhk Jung , Bike Zhang , Claire J. Tomlin , Koushil Sreenath

A differential dynamic programming (DDP)-based framework for inverse reinforcement learning (IRL) is introduced to recover the parameters in the cost function, system dynamics, and constraints from demonstrations. Different from existing…

Robotics · Computer Science 2024-07-30 Kun Cao , Xinhang Xu , Wanxin Jin , Karl H. Johansson , Lihua Xie