English
Related papers

Related papers: Jointly Learning Cost and Constraints from Demonst…

200 papers

Regardless of the particular task we want them to perform in an environment, there are often shared safety constraints we want our agents to respect. For example, regardless of whether it is making a sandwich or clearing the table, a…

Machine Learning · Computer Science 2023-09-06 Konwoo Kim , Gokul Swamy , Zuxin Liu , Ding Zhao , Sanjiban Choudhury , Zhiwei Steven Wu

In safety-critical RL settings, the inclusion of an additional cost function is often favoured over the arduous task of modifying the reward function to ensure the agent's safe behaviour. However, designing or evaluating such a cost…

Artificial Intelligence · Computer Science 2025-01-14 Shashank Reddy Chirra , Pradeep Varakantham , Praveen Paruchuri

Complex planning and scheduling problems have long been solved using various optimization or heuristic approaches. In recent years, imitation learning that aims to learn from expert demonstrations has been proposed as a viable alternative…

Machine Learning · Computer Science 2024-05-24 Qian Shao , Pradeep Varakantham , Shih-Fen Cheng

Learning from demonstration is widely used for robot navigation, yet it suffers from a fundamental limitation: demonstrations consist predominantly of successful behaviors and provide limited coverage of unsafe states. This limitation leads…

Robotics · Computer Science 2026-04-28 Xianghui Wang , Siwei Cheng , Shanze Wang , Xinming Zhang , Dan Zhang , Wei Zhang

In safe Reinforcement Learning (RL), safety cost is typically defined as a function dependent on the immediate state and actions. In practice, safety constraints can often be non-Markovian due to the insufficient fidelity of state…

Machine Learning · Computer Science 2024-05-07 Siow Meng Low , Akshat Kumar

Many methods in learning from demonstration assume that the demonstrator has knowledge of the full environment. However, in many scenarios, a demonstrator only sees part of the environment and they continuously replan as they gather…

Robotics · Computer Science 2020-05-13 Craig Knuth , Glen Chou , Necmiye Ozay , Dmitry Berenson

Reinforcement learning can acquire complex behaviors from high-level specifications. However, defining a cost function that can be optimized effectively and encodes the correct task is challenging in practice. We explore how inverse optimal…

Machine Learning · Computer Science 2016-05-30 Chelsea Finn , Sergey Levine , Pieter Abbeel

Learning from Demonstration (LfD) has emerged as a crucial method for robots to acquire new skills. However, when given suboptimal task trajectory demonstrations with shape characteristics reflecting human preferences but subpar dynamic…

Robotics · Computer Science 2025-04-21 Chenlin Ming , Zitong Wang , Boxuan Zhang , Zhanxiang Cao , Xiaoming Duan , Jianping He

Learning from demonstration allows for rapid deployment of robot manipulators to a great many tasks, by relying on a person showing the robot what to do rather than programming it. While this approach provides many opportunities, measuring,…

Robotics · Computer Science 2019-05-13 Aran Sena , Matthew J Howard

Reinforcement learning can enable complex, adaptive behavior to be learned automatically for autonomous robotic platforms. However, practical deployment of reinforcement learning methods must contend with the fact that the training process…

Machine Learning · Computer Science 2017-02-07 Gregory Kahn , Adam Villaflor , Vitchyr Pong , Pieter Abbeel , Sergey Levine

In Programming by Demonstration, the robot learns novel skills from human demonstrations. After learning, the robot should be able not only to reproduce the skill, but also to generalize it to shifted domains without collecting new training…

Robotics · Computer Science 2023-11-07 Hector Perez-Villeda , Justus Piater , Matteo Saveriano

In this paper, we propose an uncertainty-aware learning from demonstration method by presenting a novel uncertainty estimation method utilizing a mixture density network appropriate for modeling complex and noisy human behaviors. The…

Computer Vision and Pattern Recognition · Computer Science 2018-12-21 Sungjoon Choi , Kyungjae Lee , Sungbin Lim , Songhwai Oh

Robotic assembly tasks involve complex and low-clearance insertion trajectories with varying contact forces at different stages. While the nominal motion trajectory can be easily obtained from human demonstrations through kinesthetic…

Robotics · Computer Science 2021-03-11 Yan Wang , Cristian C. Beltran-Hernandez , Weiwei Wan , Kensuke Harada

The primary goal of motion planning is to generate safe and efficient trajectories for vehicles. Traditionally, motion planning models are trained using imitation learning to mimic the behavior of human experts. However, these models often…

This paper proposes a method to learn from human demonstration compliant contact motions, which take advantage of interaction forces between workpieces to align them, even when contact force may occur from different directions on different…

Robotics · Computer Science 2018-09-03 Markku Suomalainen , Ville Kyrki

We present a method for learning options from segmented demonstration trajectories. The trajectories are first segmented into skills using nonparametric Bayesian clustering and a reward function for each segment is then learned using…

Machine Learning · Computer Science 2020-01-22 Matthew Cockcroft , Shahil Mawjee , Steven James , Pravesh Ranchod

Learning from demonstration is one of the most promising methods to counteract the challenging long-term trends in repetitive industrial assembly. It offers not only a programming technique that is accessible to workers on the shop floor,…

Robotics · Computer Science 2023-10-03 V. Hernandez Moreno , S. Jansing , M. Polikarpov , M. G. Carmichael , J. Deuse

We present a general, two-stage reinforcement learning approach to create robust policies that can be deployed on real robots without any additional training using a single demonstration generated by trajectory optimization. The…

Robotics · Computer Science 2022-01-25 Miroslav Bogdanovic , Majid Khadiv , Ludovic Righetti

Learning from Demonstration (LfD) is a popular approach for robots to acquire new skills, but most LfD methods suffer from imperfections in human demonstrations. Prior work typically treats these suboptimalities as random noise. In this…

Robotics · Computer Science 2025-12-18 Shijie Fang , Hang Yu , Qidi Fang , Reuben M. Aronson , Elaine S. Short

We present an approach to learn fast and dynamic robot motions without exceeding limits on the position $\theta$, velocity $\dot{\theta}$, acceleration $\ddot{\theta}$ and jerk $\dddot{\theta}$ of each robot joint. Movements are generated…

Robotics · Computer Science 2021-03-30 Jonas C. Kiemel , Torsten Kröger