English
Related papers

Related papers: Human-to-Robot Interaction: Learning from Video De…

200 papers

We introduce a simple new method for visual imitation learning, which allows a novel robot manipulation task to be learned from a single human demonstration, without requiring any prior knowledge of the object being interacted with. Our…

Robotics · Computer Science 2021-06-11 Edward Johns

Learning from Demonstration (LfD) is a framework that allows lay users to easily program robots. However, the efficiency of robot learning and the robot's ability to generalize to task variations hinges upon the quality and quantity of the…

Learning actions from human demonstration is an emerging trend for designing intelligent robotic systems, which can be referred as video to command. The performance of such approach highly relies on the quality of video captioning. However,…

Computer Vision and Pattern Recognition · Computer Science 2019-09-11 Shuo Yang , Wei Zhang , Weizhi Lu , Hesheng Wang , Yibin Li

Learning from human demonstrations has exhibited remarkable achievements in robot manipulation. However, the challenge remains to develop a robot system that matches human capabilities and data efficiency in learning and generalizability,…

Robotics · Computer Science 2024-01-05 Dingkun Guo

Tool use is essential for enabling robots to perform complex real-world tasks, but learning such skills requires extensive datasets. While teleoperation is widely used, it is slow, delay-sensitive, and poorly suited for dynamic tasks. In…

Robotics · Computer Science 2025-09-16 Haonan Chen , Cheng Zhu , Shuijing Liu , Yunzhu Li , Katherine Driggs-Campbell

Learning from Demonstration (LfD) is a popular approach to endowing robots with skills without having to program them by hand. Typically, LfD relies on human demonstrations in clutter-free environments. This prevents the demonstrations from…

Robotics · Computer Science 2018-08-07 Muhammad Asif Rana , Mustafa Mukadam , Seyed Reza Ahmadzadeh , Sonia Chernova , Byron Boots

Eye-in-hand cameras have shown promise in enabling greater sample efficiency and generalization in vision-based robotic manipulation. However, for robotic imitation, it is still expensive to have a human teleoperator collect large amounts…

Robotics · Computer Science 2023-07-13 Moo Jin Kim , Jiajun Wu , Chelsea Finn

Classical policy search algorithms for robotics typically require performing extensive explorations, which are time-consuming and expensive to implement with real physical platforms. To facilitate the efficient learning of robot…

Robotics · Computer Science 2023-04-25 Shengzeng Huo , Anqing Duan , Lijun Han , Luyin Hu , Hesheng Wang , David Navarro-Alarcon

Finding an efficient way to adapt robot trajectory is a priority to improve overall performance of robots. One approach for trajectory planning is through transferring human-like skills to robots by Learning from Demonstrations (LfD). The…

Robotics · Computer Science 2023-04-13 Jayden Hong , Zengjie Zhang , Amir M. Soufi Enayati , Homayoun Najjaran

Learning from demonstration (LfD) is a technique that allows expert teachers to teach task-oriented skills to robotic systems. However, the most effective way of guiding novice teachers to approach expert-level demonstrations quantitatively…

Robotics · Computer Science 2025-05-16 Endong Sun , Yuqing Zhu , Matthew Howard

As robots enter human environments, they will be expected to accomplish a tremendous range of tasks. It is not feasible for robot designers to pre-program these behaviors or know them in advance, so one way to address this is through…

Robotics · Computer Science 2017-04-12 Cory J. Hayes , Maryam Moosaei , Laurel D. Riek

Learning from demonstration allows for rapid deployment of robot manipulators to a great many tasks, by relying on a person showing the robot what to do rather than programming it. While this approach provides many opportunities, measuring,…

Robotics · Computer Science 2019-05-13 Aran Sena , Matthew J Howard

Learning from Demonstration (LfD) systems are commonly used to teach robots new tasks by generating a set of skills from user-provided demonstrations. These skills can then be sequenced by planning algorithms to execute complex tasks.…

Robotics · Computer Science 2024-12-12 Maximilian Diehl , Tathagata Chakraborti , Karinne Ramirez-Amaro

Imitation learning is an effective approach for autonomous systems to acquire control policies when an explicit reward function is unavailable, using supervision provided as demonstrations from an expert, typically a human operator.…

Machine Learning · Computer Science 2018-06-20 YuXuan Liu , Abhishek Gupta , Pieter Abbeel , Sergey Levine

We present a Learning from Demonstration (LfD) framework that achieves one-shot generalization in multi-stage, contact-rich manipulation tasks. Central to our approach is the utilization of environmental constraints as the inductive bias.…

Robotics · Computer Science 2026-05-19 Xing Li , Oliver Brock

We present a novel Learning from Demonstration (LfD) method, Deformable Manipulation from Demonstrations (DMfD), to solve deformable manipulation tasks using states or images as inputs, given expert demonstrations. Our method uses…

Robotics · Computer Science 2022-07-22 Gautam Salhotra , I-Chun Arthur Liu , Marcus Dominguez-Kuhne , Gaurav S. Sukhatme

Robots operating in complex and uncertain environments face considerable challenges. Advanced robotic systems often rely on extensive datasets to learn manipulation tasks. In contrast, when humans are faced with unfamiliar tasks, such as…

Robotics · Computer Science 2025-11-10 Yichen Zhu , Feifei Feng

Robot Learning from Demonstration (RLfD) is a technique for robots to derive policies from instructors' examples. Although the reciprocal effects of student engagement on teacher behavior are widely recognized in the educational community,…

Human-Computer Interaction · Computer Science 2020-05-05 Mingfei Sun , Zhenhui Peng , Meng Xia , Xiaojuan Ma

A critical bottleneck hindering further advancement in embodied AI and robotics is the challenge of scaling robot data. To address this, the field of learning robot manipulation skills from human video data has attracted rapidly growing…

Robotics · Computer Science 2026-05-01 Junyi Ma , Erhang Zhang , Haoran Yang , Ditao Li , Chenyang Xu , Guangming Wang , Hesheng Wang

For assistive robots and virtual agents to achieve ubiquity, machines will need to anticipate the needs of their human counterparts. The field of Learning from Demonstration (LfD) has sought to enable machines to infer predictive models of…

Machine Learning · Computer Science 2019-03-15 Rohan Paleja , Matthew Gombolay