English
Related papers

Related papers: Learning Hand-Eye Coordination for Robotic Graspin…

200 papers

Fast grasping is critical for mobile robots in logistics, manufacturing, and service applications. Existing methods face fundamental challenges in impact stabilization under high-speed motion, real-time whole-body coordination, and…

Robotics · Computer Science 2026-04-15 Heng Tao , Yiming Zhong , Zemin Yang , Yuexin Ma

Robotic dexterous grasping is the first step to enable human-like dexterous object manipulation and thus a crucial robotic technology. However, dexterous grasping is much more under-explored than object grasping with parallel grippers,…

Robotics · Computer Science 2023-03-09 Ruicheng Wang , Jialiang Zhang , Jiayi Chen , Yinzhen Xu , Puhao Li , Tengyu Liu , He Wang

While traditional methods relies on depth sensors, the current trend leans towards utilizing cost-effective RGB images, despite their absence of depth cues. This paper introduces an interesting approach to detect grasping pose from a single…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Zhaocong Li

Learning Based Robot Grasping currently involves the use of labeled data. This approach has two major disadvantages. Firstly, labeling data for grasp points and angles is a strenuous process, so the dataset remains limited. Secondly, human…

Robotics · Computer Science 2024-10-21 Danyal Saqib , Wajahat Hussain

This paper aims to improve robots' versatility and adaptability by allowing them to use a large variety of end-effector tools and quickly adapt to new tools. We propose AdaGrasp, a method to learn a single grasping policy that generalizes…

Robotics · Computer Science 2021-03-16 Zhenjia Xu , Beichun Qi , Shubham Agrawal , Shuran Song

Accurate depth estimation remains an open problem for robotic manipulation; even state of the art techniques including structured light and LiDAR sensors fail on reflective or transparent surfaces. We address this problem by training a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-17 Ben Goodrich , Alex Kuefler , William D. Richards

Humans can steadily and gently grasp unfamiliar objects based on tactile perception. Robots still face challenges in achieving similar performance due to the difficulty of learning accurate grasp-force predictions and force control…

Robotics · Computer Science 2025-02-05 Mingxuan Li , Lunwei Zhang , Tiemin Li , Yao Jiang

Functional grasp is essential for enabling dexterous multi-finger robot hands to manipulate objects effectively. However, most prior work either focuses on power grasping, which simply involves holding an object still, or relies on costly…

Computer Vision and Pattern Recognition · Computer Science 2025-05-14 Hongyi Chen , Yunchao Yao , Yufei Ye , Zhixuan Xu , Homanga Bharadhwaj , Jiashun Wang , Shubham Tulsiani , Zackory Erickson , Jeffrey Ichnowski

We present GazeGrasp, a gaze-based manipulation system enabling individuals with motor impairments to control collaborative robots using eye-gaze. The system employs an ESP32 CAM for eye tracking, MediaPipe for gaze detection, and YOLOv8…

In planar grasp detection, the goal is to learn a function from an image of a scene onto a set of feasible grasp poses in $\mathrm{SE}(2)$. In this paper, we recognize that the optimal grasp function is $\mathrm{SE}(2)$-equivariant and can…

Robotics · Computer Science 2022-02-22 Xupeng Zhu , Dian Wang , Ondrej Biza , Guanang Su , Robin Walters , Robert Platt

In recent times, object detection and pose estimation have gained significant attention in the context of robotic vision applications. Both the identification of objects of interest as well as the estimation of their pose remain important…

Robotics · Computer Science 2021-01-20 S. K. Paul , M. T. Chowdhury , M. Nicolescu , M. Nicolescu

The problem of grasping objects using a multi-finger hand has received significant attention in recent years. However, it remains challenging to handle a large number of unfamiliar objects in real and cluttered environments. In this work,…

Robotics · Computer Science 2024-08-06 Hengxu Yan , Hao-Shu Fang , Cewu Lu

In this paper, we propose a novel representation for grasping using contacts between multi-finger robotic hands and objects to be manipulated. This representation significantly reduces the prediction dimensions and accelerates the learning…

Robots in the real world frequently come across identical objects in dense clutter. When evaluating grasp poses in these scenarios, a target-driven grasping system requires knowledge of spatial relations between scene objects (e.g.,…

Robotics · Computer Science 2022-03-03 Xibai Lou , Yang Yang , Changhyun Choi

Human-to-Robot handovers are useful for many Human-Robot Interaction scenarios. It is important to recognize when a human intends to initiate handovers, so that the robot does not try to take objects from humans when a handover is not…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Jun Kwan , Chinkye Tan , Akansel Cosgun

Learning-based approaches to robotic manipulation are limited by the scalability of data collection and accessibility of labels. In this paper, we present a multi-task domain adaptation framework for instance grasping in cluttered scenes by…

Machine Learning · Computer Science 2018-03-06 Kuan Fang , Yunfei Bai , Stefan Hinterstoisser , Silvio Savarese , Mrinal Kalakrishnan

We consider the task of object grasping with a prosthetic hand capable of multiple grasp types. In this setting, communicating the intended grasp type often requires a high user cognitive load which can be reduced adopting shared autonomy…

In this work, we focus on improving the robot's dexterous capability by exploiting visual sensing and adaptive force control. TeachNet, a vision-based teleoperation learning framework, is exploited to map human hand postures to a…

Robotics · Computer Science 2021-07-22 Chao Zeng , Shuang Li , Yiming Jiang , Qiang Li , Zhaopeng Chen , Chenguang Yang , Jianwei Zhang

In the context of deep learning for robotics, we show effective method of training a real robot to grasp a tiny sphere (1.37cm of diameter), with an original combination of system design choices. We decompose the end-to-end system into a…

Robotics · Computer Science 2017-12-21 Mengyuan Yan , Iuri Frosio , Stephen Tyree , Jan Kautz

We present a benchmarking study of vision-based robotic grasping algorithms with distinct approaches, and provide a comparative analysis. In particular, we compare two machine-learning-based and two analytical algorithms using an existing…