English
Related papers

Related papers: RoboCopilot: Human-in-the-loop Interactive Imitati…

200 papers

This paper presents, for the first time, a method for learning in-contact tasks from a teleoperated demonstration with a hydraulic manipulator. Due to the use of extremely powerful hydraulic manipulator, a force-reflected bilateral…

Robotics · Computer Science 2018-09-05 Markku Suomalainen , Janne Koivumäki , Santeri Lampinen , Ville Kyrki , Jouni Mattila

We propose to perform imitation learning for dexterous manipulation with multi-finger robot hand from human demonstrations, and transfer the policy to the real robot hand. We introduce a novel single-camera teleoperation system to collect…

Robotics · Computer Science 2023-01-20 Yuzhe Qin , Hao Su , Xiaolong Wang

Imitating human demonstrations is a promising approach to endow robots with various manipulation capabilities. While recent advances have been made in imitation learning and batch (offline) reinforcement learning, a lack of open-source…

Robot manipulation is an important part of human-robot interaction technology. However, traditional pre-programmed methods can only accomplish simple and repetitive tasks. To enable effective communication between robots and humans, and to…

Robotics · Computer Science 2023-09-12 Haoxu Zhang , Parham M. Kebria , Shady Mohamed , Samson Yu , Saeid Nahavandi

We consider robot learning in the context of shared autonomy, where control of the system can switch between a human teleoperator and autonomous control. In this setting we address reinforcement learning, and learning from demonstration,…

Machine Learning · Computer Science 2023-06-16 Marc Rigter , Bruno Lacerda , Nick Hawes

Bilateral teleoperation provides humanoid robots with human planning intelligence while enabling the human to feel what the robot feels. It has the potential to transform physically capable humanoid robots into dynamically intelligent ones.…

Robotics · Computer Science 2021-09-10 Sunyu Wang , Joao Ramos

[...] With the TelePhysicalOperation interface, the user can teleoperate the different capabilities of a robot (e.g., single/double arm manipulation, wheel/leg locomotion) by applying virtual forces on selected robot body parts. This…

Robotics · Computer Science 2025-05-13 Davide Torielli

Imitation can allow us to quickly gain an understanding of a new task. Through a demonstration, we can gain direct knowledge about which actions need to be performed and which goals they have. In this paper, we introduce a new approach to…

Robotics · Computer Science 2024-06-04 Josua Spisak , Matthias Kerzel , Stefan Wermter

Machine learning is now playing important role in robotic object manipulation. In addition, force control is necessary for manipulating various objects to achieve robustness against perturbations of configurations and stiffness. The…

Robotics · Computer Science 2022-02-14 Sho Sakaino

We present a method for teaching dexterous manipulation tasks to robots from human hand motion demonstrations. Unlike existing approaches that solely rely on kinematics information without taking into account the plausibility of robot and…

Robotics · Computer Science 2025-01-09 Sungjae Park , Seungho Lee , Mingi Choi , Jiye Lee , Jeonghwan Kim , Jisoo Kim , Hanbyul Joo

We present a deep imitation learning framework for robotic bimanual manipulation in a continuous state-action space. A core challenge is to generalize the manipulation skills to objects in different locations. We hypothesize that modeling…

Robotic skill learning has been increasingly studied but the demonstration collections are more challenging compared to collecting images/videos in computer vision and texts in natural language processing. This paper presents a skill…

Robotics · Computer Science 2023-11-14 Xiangyu Chu , Yunxi Tang , Lam Him Kwok , Yuanpei Cai , Kwok Wai Samuel Au

Robotic manipulation is essential for the widespread adoption of robots in industrial and home settings and has long been a focus within the robotics community. Advances in artificial intelligence have introduced promising learning-based…

Robotics · Computer Science 2025-03-04 Kelin Li , Shubham M Wagh , Nitish Sharma , Saksham Bhadani , Wei Chen , Chang Liu , Petar Kormushev

This work developed collaborative bimanual manipulation for reliable and safe human-robot collaboration, which allows remote and local human operators to work interactively for bimanual tasks. We proposed an optimal motion adaptation to…

Robotics · Computer Science 2023-07-19 Ruoshi Wen , Quentin Rouxel , Michael Mistry , Zhibin Li , Carlo Tiseo

Imitation learning is an effective approach for autonomous systems to acquire control policies when an explicit reward function is unavailable, using supervision provided as demonstrations from an expert, typically a human operator.…

Machine Learning · Computer Science 2018-06-20 YuXuan Liu , Abhishek Gupta , Pieter Abbeel , Sergey Levine

Amidst the wide popularity of imitation learning algorithms in robotics, their properties regarding hyperparameter sensitivity, ease of training, data efficiency, and performance have not been well-studied in high-precision…

Robotics · Computer Science 2024-08-27 Michael Drolet , Simon Stepputtis , Siva Kailas , Ajinkya Jain , Jan Peters , Stefan Schaal , Heni Ben Amor

Imitation learning is a powerful paradigm for robot skill acquisition. However, obtaining demonstrations suitable for learning a policy that maps from raw pixels to actions can be challenging. In this paper we describe how consumer-grade…

Machine Learning · Computer Science 2018-03-08 Tianhao Zhang , Zoe McCarthy , Owen Jow , Dennis Lee , Xi Chen , Ken Goldberg , Pieter Abbeel

Humans can naturally learn to execute a new task by seeing it performed by other individuals once, and then reproduce it in a variety of configurations. Endowing robots with this ability of imitating humans from third person is a very…

Robotics · Computer Science 2019-11-05 Alessandro Bonardi , Stephen James , Andrew J. Davison

Imitation learning from human demonstrations is a promising paradigm for teaching robots manipulation skills in the real world. However, learning complex long-horizon tasks often requires an unattainable amount of demonstrations. To reduce…

Robotics · Computer Science 2023-10-16 Chen Wang , Linxi Fan , Jiankai Sun , Ruohan Zhang , Li Fei-Fei , Danfei Xu , Yuke Zhu , Anima Anandkumar

Imitation learning from human motion capture (MoCap) data provides a promising way to train humanoid robots. However, due to differences in morphology, such as varying degrees of joint freedom and force limits, exact replication of human…

Robotics · Computer Science 2024-10-04 Wenshuai Zhao , Yi Zhao , Joni Pajarinen , Michael Muehlebach