English
Related papers

Related papers: Vision-based Robotic Grasping From Object Localiza…

200 papers

We describe a learning-based approach to hand-eye coordination for robotic grasping from monocular images. To learn hand-eye coordination for grasping, we trained a large convolutional neural network to predict the probability that…

Machine Learning · Computer Science 2016-08-30 Sergey Levine , Peter Pastor , Alex Krizhevsky , Deirdre Quillen

This paper introduces key machine learning operations that allow the realization of robust, joint 6D pose estimation of multiple instances of objects either densely packed or in unstructured piles from RGB-D data. The first objective is to…

Robotics · Computer Science 2019-10-14 Chaitanya Mitash , Bowen Wen , Kostas Bekris , Abdeslam Boularias

Robotic grasping faces new challenges in human-robot-interaction scenarios. We consider the task that the robot grasps a target object designated by human's language directives. The robot not only needs to locate a target based on…

Robotics · Computer Science 2023-08-02 Yuhao Lu , Yixuan Fan , Beixing Deng , Fangfu Liu , Yali Li , Shengjin Wang

Reliably planning fingertip grasps for multi-fingered hands lies as a key challenge for many tasks including tool use, insertion, and dexterous in-hand manipulation. This task becomes even more difficult when the robot lacks an accurate…

Robotics · Computer Science 2022-12-19 Martin Matak , Tucker Hermans

Grasp planning and estimation have been a longstanding research problem in robotics, with two main approaches to find graspable poses on the objects: 1) geometric approach, which relies on 3D models of objects and the gripper to estimate…

Robotics · Computer Science 2025-04-11 Xun Tu , Karthik Desingh

Robotic grasping is an essential and fundamental task and has been studied extensively over the past several decades. Traditional work analyzes physical models of the objects and computes force-closure grasps. Such methods require…

Robotics · Computer Science 2023-05-25 Yuwei Wu , Weixiao Liu , Zhiyang Liu , Gregory S. Chirikjian

6D pose estimation of textureless objects is a valuable but challenging task for many robotic applications. In this work, we propose a framework to address this challenge using only RGB images acquired from multiple viewpoints. The core…

Robotics · Computer Science 2023-02-23 Jun Yang , Wenjie Xue , Sahar Ghavidel , Steven L. Waslander

Single-view RGB model-based object pose estimation methods achieve strong generalization but are fundamentally limited by depth ambiguity, clutter, and occlusions. Multi-view pose estimation methods have the potential to solve these issues,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Anna Šárová Mikeštíková , Médéric Fourmy , Martin Cífka , Josef Sivic , Vladimir Petrik

This paper presents a new method for parallel-jaw grasping of isolated objects from depth images, under large gripper pose uncertainty. Whilst most approaches aim to predict the single best grasp pose from an image, our method first…

Robotics · Computer Science 2016-09-14 Edward Johns , Stefan Leutenegger , Andrew J. Davison

Learning robotic grasps from visual observations is a promising yet challenging task. Recent research shows its great potential by preparing and learning from large-scale synthetic datasets. For the popular, 6 degree-of-freedom (6-DOF)…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Chaozheng Wu , Jian Chen , Qiaoyu Cao , Jianchi Zhang , Yunxin Tai , Lin Sun , Kui Jia

We focus on the generalization ability of the 6-DoF grasp detection method in this paper. While learning-based grasp detection methods can predict grasp poses for unseen objects using the grasp distribution learned from the training set,…

Robotics · Computer Science 2024-04-03 Haoxiang Ma , Modi Shi , Boyang Gao , Di Huang

Robotic grasping plays an important role in the field of robotics. The current state-of-the-art robotic grasping detection systems are usually built on the conventional vision, such as RGB-D camera. Compared to traditional frame-based…

Computer Vision and Pattern Recognition · Computer Science 2020-05-04 Bin Li , Hu Cao , Zhongnan Qu , Yingbai Hu , Zhenke Wang , Zichen Liang

In real life, grasping is one of the fundamental and effective forms of interaction when manipulating objects. This holds true in the physical and virtual world; however, unlike the physical world, virtual reality (VR) is grasped in a…

Human-Computer Interaction · Computer Science 2024-11-12 Mingzhao Zhou , Nadine Aburumman

Vision-based robotic object grasping is typically investigated in the context of isolated objects or unstructured object sets in bin picking scenarios. However, there are several settings, such as construction or warehouse automation, where…

This paper proposes a iterative visual recognition system for learning based randomized bin-picking. Since the configuration on randomly stacked objects while executing the current picking trial is just partially different from the…

Robotics · Computer Science 2016-08-02 Kensuke Harada , Weiwei Wan , Tokuo Tsuji , Kohei Kikuchi , Kazuyuki Nagata , Hiromu Onda

A human hand can grasp a desired number of objects at once from a pile based solely on tactile sensing. To do so, a robot needs to grasp within a pile, sense the number of objects in the grasp before lifting, and predict the number of…

Robotics · Computer Science 2021-12-03 Tianze Chen , Adheesh Shenoy , Anzhelika Kolinko , Syed Shah , Yu Sun

A challenge in robot grasping is to achieve task-grasping which is to select a grasp that is advantageous to the success of tasks before and after grasps. One of the frameworks to address this difficulty is Learning-from-Observation (LfO),…

Robotics · Computer Science 2022-03-03 Daichi Saito , Kazuhiro Sasabuchi , Naoki Wake , Jun Takamatsu , Hideki Koike , Katsushi Ikeuchi

Autonomous robotic grasping plays an important role in intelligent robotics. However, how to help the robot grasp specific objects in object stacking scenes is still an open problem, because there are two main challenges for autonomous…

Robotics · Computer Science 2019-03-05 Hanbo Zhang , Xuguang Lan , Site Bai , Lipeng Wan , Chenjie Yang , Nanning Zheng

In this work, we present a deep reinforcement learning based method to solve the problem of robotic grasping using visio-motor feedback. The use of a deep learning based approach reduces the complexity caused by the use of hand-designed…

Robotics · Computer Science 2020-07-10 Shirin Joshi , Sulabh Kumra , Ferat Sahin

For certain manipulation tasks, object pose estimation from head-mounted cameras may not be sufficiently accurate. This is at least in part due to our inability to perfectly calibrate the coordinate frames of today's high degree of freedom…

Robotics · Computer Science 2022-04-12 Patrick Lancaster , Boling Yang , Joshua R. Smith