English
Related papers

Related papers: Learning Constraints from Demonstrations

200 papers

As autonomous systems become more complex and integral in our society, the need to accurately model and safely control these systems has increased significantly. In the past decade, there has been tremendous success in using deep learning…

Robotics · Computer Science 2024-09-10 Hao Wang , Javier Borquez , Somil Bansal

Learning-from-demonstrations is an emerging paradigm to obtain effective robot control policies for complex tasks via reinforcement learning without the need to explicitly design reward functions. However, it is susceptible to imperfections…

Robotics · Computer Science 2021-02-16 Aniruddh G. Puranic , Jyotirmoy V. Deshmukh , Stefanos Nikolaidis

We present a method for learning options from segmented demonstration trajectories. The trajectories are first segmented into skills using nonparametric Bayesian clustering and a reward function for each segment is then learned using…

Machine Learning · Computer Science 2020-01-22 Matthew Cockcroft , Shahil Mawjee , Steven James , Pravesh Ranchod

We propose a control design method for linear time-invariant systems that iteratively learns to satisfy unknown polyhedral state constraints. At each iteration of a repetitive task, the method constructs an estimate of the unknown…

Systems and Control · Electrical Eng. & Systems 2023-06-13 Monimoy Bujarbaruah , Charlott Vallon , Francesco Borrelli

We present a novel method for learning hybrid force/position control from demonstration. We learn a dynamic constraint frame aligned to the direction of desired force using Cartesian Dynamic Movement Primitives. In contrast to approaches…

Robotics · Computer Science 2022-05-05 Adam Conkey , Tucker Hermans

Failures are challenging for learning to control physical systems since they risk damage, time-consuming resets, and often provide little gradient information. Adding safety constraints to exploration typically requires a lot of prior…

Machine Learning · Computer Science 2019-10-08 Steve Heim , Alexander von Rohr , Sebastian Trimpe , Alexander Badri-Spröwitz

We propose a new scheme to learn motion planning constraints from human driving trajectories. Behavioral and motion planning are the key components in an autonomous driving system. The behavioral planning is responsible for high-level…

Robotics · Computer Science 2021-10-05 Kasra Rezaee , Peyman Yadmellat

This paper studies the constrained/safe reinforcement learning (RL) problem with sparse indicator signals for constraint violations. We propose a model-based approach to enable RL agents to effectively explore the environment with unknown…

Artificial Intelligence · Computer Science 2021-03-09 Zuxin Liu , Hongyi Zhou , Baiming Chen , Sicheng Zhong , Martial Hebert , Ding Zhao

With the increase in complexity of robotic systems and the rise in non-expert users, it can be assumed that task constraints are not explicitly known. In tasks where avoiding singularity is critical to its success, this paper provides an…

Robotics · Computer Science 2019-03-27 Jeevan Manavalan , Matthew Howard

In many learning based control methodologies, learning the unknown dynamic model precedes the control phase, while the aim is to control the system such that it remains in some safe region of the state space. In this work, our aim is to…

Machine Learning · Computer Science 2021-05-14 Farhad Farokhi , Alex Leong , Iman Shames , Mohammad Zamani

Existing learning from demonstration algorithms usually assume access to expert demonstrations. However, this assumption is limiting in many real-world applications since the collected demonstrations may be suboptimal or even consist of…

Robotics · Computer Science 2022-03-03 Zhangjie Cao , Zihan Wang , Dorsa Sadigh

Learning near-optimal behaviour from an expert's demonstrations typically relies on the assumption that the learner knows the features that the true reward function depends on. In this paper, we study the problem of learning from…

Machine Learning · Computer Science 2019-03-28 Luis Haug , Sebastian Tschiatschek , Adish Singla

Diversity of environments is a key challenge that causes learned robotic controllers to fail due to the discrepancies between the training and evaluation conditions. Training from demonstrations in various conditions can mitigate---but not…

Robotics · Computer Science 2019-03-15 Sanjay Thakur , Herke van Hoof , Juan Camilo Gamboa Higuera , Doina Precup , David Meger

Many methods in learning from demonstration assume that the demonstrator has knowledge of the full environment. However, in many scenarios, a demonstrator only sees part of the environment and they continuously replan as they gather…

Robotics · Computer Science 2020-05-13 Craig Knuth , Glen Chou , Necmiye Ozay , Dmitry Berenson

We develop a control algorithm that ensures the safety, in terms of confinement in a set, of a system with unknown, 2nd-order nonlinear dynamics. The algorithm establishes novel connections between data-driven and robust, nonlinear control.…

Systems and Control · Electrical Eng. & Systems 2021-05-17 Christos K. Verginis , Franck Djeumou , Ufuk Topcu

Planning for diverse real-world robotic tasks necessitates to know and write all constraints. However, instances exist where these constraints are either unknown or challenging to specify accurately. A possible solution is to infer the…

Robotics · Computer Science 2025-01-17 Baiyu Peng , Aude Billard

When deploying autonomous agents in unstructured environments over sustained periods of time, adaptability and robustness oftentimes outweigh optimality as a primary consideration. In other words, safety and survivability constraints play a…

Systems and Control · Electrical Eng. & Systems 2021-04-08 Motoya Ohnishi , Gennaro Notomista , Masashi Sugiyama , Magnus Egerstedt

Learning from Demonstration is increasingly used for transferring operator manipulation skills to robots. In practice, it is important to cater for limited data and imperfect human demonstrations, as well as underlying safety constraints.…

Robotics · Computer Science 2020-04-03 Ya-Yen Tsai , Bo Xiao , Edward Johns , Guang-Zhong Yang

Control barrier functions have shown great success in addressing control problems with safety guarantees. These methods usually find the next safe control input by solving an online quadratic programming problem. However, model uncertainty…

Systems and Control · Electrical Eng. & Systems 2020-11-24 Chuanzheng Wang , Yinan Li , Yiming Meng , Stephen L. Smith , Jun Liu

We consider robot learning in the context of shared autonomy, where control of the system can switch between a human teleoperator and autonomous control. In this setting we address reinforcement learning, and learning from demonstration,…

Machine Learning · Computer Science 2023-06-16 Marc Rigter , Bruno Lacerda , Nick Hawes