English
Related papers

Related papers: Task-grasping from human demonstration

200 papers

Learning from Demonstration (LfD) is a popular method of reproducing and generalizing robot skills from human-provided demonstrations. In this paper, we propose a novel optimization-based LfD method that encodes demonstrations as elastic…

Robotics · Computer Science 2024-07-01 Brendan Hertel , Matthew Pelland , S. Reza Ahmadzadeh

Learning-based approaches to robotic manipulation are limited by the scalability of data collection and accessibility of labels. In this paper, we present a multi-task domain adaptation framework for instance grasping in cluttered scenes by…

Machine Learning · Computer Science 2018-03-06 Kuan Fang , Yunfei Bai , Stefan Hinterstoisser , Silvio Savarese , Mrinal Kalakrishnan

Although, in the task of grasping via a data-driven method, closed-loop feedback and predicting 6 degrees of freedom (DoF) grasp rather than conventionally used 4DoF top-down grasp are demonstrated to improve performance individually, few…

Robotics · Computer Science 2022-06-22 Dongwon Son

Grasping is the process of picking up an object by applying forces and torques at a set of contacts. Recent advances in deep-learning methods have allowed rapid progress in robotic object grasping. In this systematic review, we surveyed the…

Grasping objects of different shapes and sizes - a foundational, effortless skill for humans - remains a challenging task in robotics. Although model-based approaches can predict stable grasp configurations for known object models, they…

Robotics · Computer Science 2022-11-22 Malte Mosbach , Sven Behnke

Robotic grasping under uncertainty remains a fundamental challenge due to its uncertain and contact-rich nature. Traditional rigid robotic hands, with limited degrees of freedom and compliance, rely on complex model-based and heavy feedback…

Robotics · Computer Science 2026-04-06 Liudi Yang , Yang Bai , Yuhao Wang , Ibrahim Alsarraj , Gitta Kutyniok , Zhanchi Wang , Ke Wu

Recently, end-to-end learning frameworks are gaining prevalence in the field of robot control. These frameworks input states/images and directly predict the torques or the action parameters. However, these approaches are often critiqued due…

Robotics · Computer Science 2016-09-29 Lerrel Pinto , Abhinav Gupta

We have been developing a paradigm, which we refer to as Learning-from-observation, for a robot to automatically acquire what-to-do through observation of human performance. Since a simple mimicking method to repeat exact joint angles does…

Robotics · Computer Science 2016-09-20 Katsushi Ikeuchi , Zengqiang Yan , Zhaoyuan Ma , Yoshihiro Sato , Minako Nakamura , Shunsuke Kudoh

We address the problem of robotic grasping of known and unknown objects using implicit behavior cloning. We train a grasp evaluation model from a small number of demonstrations that outputs higher values for grasp candidates that are more…

Robotics · Computer Science 2024-01-17 Gergely Sóti , Xi Huang , Christian Wurll , Björn Hein

Humans generally teach their fellow collaborators to perform tasks through a small number of demonstrations. The learnt task is corrected or extended to meet specific task goals by means of coaching. Adopting a similar framework for…

Observing a human demonstrator manipulate objects provides a rich, scalable and inexpensive source of data for learning robotic policies. However, transferring skills from human videos to a robotic manipulator poses several challenges, not…

Robotics · Computer Science 2023-03-08 Minttu Alakuijala , Gabriel Dulac-Arnold , Julien Mairal , Jean Ponce , Cordelia Schmid

The progressive prevalence of robots in human-suited environments has given rise to a myriad of object manipulation techniques, in which dexterity plays a paramount role. It is well-established that humans exhibit extraordinary dexterity…

Imitation learning for robot dexterous manipulation, especially with a real robot setup, typically requires a large number of demonstrations. In this paper, we present a data-efficient learning from demonstration framework which exploits…

Imitation learning and world models have shown significant promise in advancing generalizable robotic learning, with robotic grasping remaining a critical challenge for achieving precise manipulation. Existing methods often rely heavily on…

Robotics · Computer Science 2025-02-06 Yiqi Huang , Travis Davies , Jiahuan Yan , Xiang Chen , Yu Tian , Luhui Hu

A robot operating in unstructured environments must be able to discriminate between different grasping styles depending on the prospective manipulation task. Having a system that allows learning from remote non-expert demonstrations can…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Furkan Kaynar , Sudarshan Rajagopalan , Shaobo Zhou , Eckehard Steinbach

Imitation learning is an effective approach for autonomous systems to acquire control policies when an explicit reward function is unavailable, using supervision provided as demonstrations from an expert, typically a human operator.…

Machine Learning · Computer Science 2018-06-20 YuXuan Liu , Abhishek Gupta , Pieter Abbeel , Sergey Levine

Imitation can allow us to quickly gain an understanding of a new task. Through a demonstration, we can gain direct knowledge about which actions need to be performed and which goals they have. In this paper, we introduce a new approach to…

Robotics · Computer Science 2024-06-04 Josua Spisak , Matthias Kerzel , Stefan Wermter

Intelligent manipulation benefits from the capacity to flexibly control an end-effector with high degrees of freedom (DoF) and dynamically react to the environment. However, due to the challenges of collecting effective training data and…

Computer Vision and Pattern Recognition · Computer Science 2020-06-19 Shuran Song , Andy Zeng , Johnny Lee , Thomas Funkhouser

For humans, the process of grasping an object relies heavily on rich tactile feedback. Most recent robotic grasping work, however, has been based only on visual input, and thus cannot easily benefit from feedback after initiating contact.…

Learning from Demonstration (LfD) is a promising approach to enable Multi-Robot Systems (MRS) to acquire complex skills and behaviors. However, the intricate interactions and coordination challenges in MRS pose significant hurdles for…

Robotics · Computer Science 2024-04-04 Vishnunandan L. N. Venkatesh , Byung-Cheol Min