English
Related papers

Related papers: Augmented Reality Demonstrations for Scalable Robo…

200 papers

Generalization to unseen real-world scenarios for robot manipulation requires exposure to diverse datasets during training. However, collecting large real-world datasets is intractable due to high operational costs. For robot learning to…

Robotics · Computer Science 2024-09-04 Zoey Chen , Zhao Mandi , Homanga Bharadhwaj , Mohit Sharma , Shuran Song , Abhishek Gupta , Vikash Kumar

Robot assistants for older adults and people with disabilities need to interact with their users in collaborative tasks. The core component of these systems is an interaction manager whose job is to observe and assess the task, and infer…

Imitation learning (IL) can generate computationally efficient sensorimotor policies from demonstrations provided by computationally expensive model-based sensing and control algorithms. However, commonly employed IL methods are often…

Robotics · Computer Science 2022-10-20 Andrea Tagliabue , Jonathan P. How

Robot programming methods for industrial robots are time consuming and often require operators to have knowledge in robotics and programming. To reduce costs associated with reprogramming, various interfaces using augmented reality have…

Robotics · Computer Science 2021-11-04 Yong Joon Thoo , Jérémy Maceiras , Philip Abbet , Mattia Racca , Hakan Girgin , Sylvain Calinon

In the complex manufacturing sector a considerable amount of resources are focused on developing new skills and training workers. In that context, increasing the effectiveness of those processes and reducing the investment required is an…

Human-Computer Interaction · Computer Science 2016-11-17 Mar Gonzalez-Franco , Julio Cermeron , Katie Li , Rodrigo Pizarro , Jacob Thorn , Windo Hutabarat , Ashutosh Tiwari , Pablo Bermell-Garcia

Imitation learning from human demonstrations is a promising paradigm for teaching robots manipulation skills in the real world. However, learning complex long-horizon tasks often requires an unattainable amount of demonstrations. To reduce…

Robotics · Computer Science 2023-10-16 Chen Wang , Linxi Fan , Jiankai Sun , Ruohan Zhang , Li Fei-Fei , Danfei Xu , Yuke Zhu , Anima Anandkumar

A key challenge in Imitation Learning (IL) is that optimal state actions demonstrations are difficult for the teacher to provide. For example in robotics, providing kinesthetic demonstrations on a robotic manipulator requires the teacher to…

Robotics · Computer Science 2021-04-05 Matthew Schmittle , Sanjiban Choudhury , Siddhartha S. Srinivasa

We introduce a simple new method for visual imitation learning, which allows a novel robot manipulation task to be learned from a single human demonstration, without requiring any prior knowledge of the object being interacted with. Our…

Robotics · Computer Science 2021-06-11 Edward Johns

Robots have been steadily increasing their presence in our daily lives, where they can work along with humans to provide assistance in various tasks on industry floors, in offices, and in homes. Automated assembly is one of the key…

Robotics · Computer Science 2022-12-06 Devesh K. Jha , Siddarth Jain , Diego Romeres , William Yerazunis , Daniel Nikovski

Augmented Reality is a promising technique for human-machine interaction. Especially in robotics, which always considers systems in their environment, it is highly beneficial to display visualizations and receive user input directly in…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Peer Schüett , Max Schwarz , Sven Behnke

Enabling robots to effectively imitate expert skills in longhorizon tasks such as locomotion, manipulation, and more, poses a long-standing challenge. Existing imitation learning (IL) approaches for robots still grapple with sub-optimal…

Robotics · Computer Science 2023-09-29 Zixuan Chen , Ze Ji , Shuyang Liu , Jing Huo , Yiyu Chen , Yang Gao

We consider the problem of learning multi-stage vision-based tasks on a real robot from a single video of a human performing the task, while leveraging demonstration data of subtasks with other objects. This problem presents a number of…

Machine Learning · Computer Science 2018-10-29 Tianhe Yu , Pieter Abbeel , Sergey Levine , Chelsea Finn

Autonomous manipulation in robot arms is a complex and evolving field of study in robotics. This paper introduces an innovative approach to this challenge by focusing on imitation learning (IL). Unlike traditional imitation methods, our…

Robotics · Computer Science 2024-02-06 Masato Kobayashi , Thanpimon Buamanee , Yuki Uranishi , Haruo Takemura

Imitation learning is a popular method for teaching robots new behaviors. However, most existing methods focus on teaching short, isolated skills rather than long, multi-step tasks. To bridge this gap, imitation learning algorithms must not…

Artificial Intelligence · Computer Science 2025-11-04 Leon Keller , Daniel Tanneberg , Jan Peters

Imitation learning allows agents to learn complex behaviors from demonstrations. However, learning a complex vision-based task may require an impractical number of demonstrations. Meta-imitation learning is a promising approach towards…

Effective human-robot collaboration (HRC) requires extensive communication among the human and robot teammates, because their actions can potentially produce conflicts, synergies, or both. We develop a novel augmented reality (AR) interface…

Robotics · Computer Science 2020-03-16 Kishan Chandan , Vidisha Kudalkar , Xiang Li , Shiqi Zhang

Learning visuomotor policies for agile quadrotor flight presents significant difficulties, primarily from inefficient policy exploration caused by high-dimensional visual inputs and the need for precise and low-latency control. To address…

Robotics · Computer Science 2024-11-13 Jiaxu Xing , Angel Romero , Leonard Bauersfeld , Davide Scaramuzza

Humans use semantic concepts such as spatial relations between objects to describe scenes and communicate tasks such as "Put the tea to the right of the cup" or "Move the plate between the fork and the spoon." Just as children, assistive…

Robotics · Computer Science 2023-05-17 Rainer Kartmann , Tamim Asfour

Most prior research in deep imitation learning has predominantly utilized fixed cameras for image input, which constrains task performance to the predefined field of view. However, enabling a robot to actively maneuver its neck can…

Robotics · Computer Science 2025-06-24 Koki Nakagawa , Yoshiyuki Ohmura , Yasuo Kuniyoshi

Incremental Learning (IL) trains models sequentially on new data without full retraining, offering privacy, efficiency, and scalability. IL must balance adaptability to new data with retention of old knowledge. However, evaluations often…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Matthias Neuwirth-Trapp , Maarten Bieshaar , Danda Pani Paudel , Luc Van Gool