English
Related papers

Related papers: On-Policy Pixel-Level Grasping Across the Gap Betw…

200 papers

Training a deep network policy for robot manipulation is notoriously costly and time consuming as it depends on collecting a significant amount of real world data. To work well in the real world, the policy needs to see many instances of…

Robotics · Computer Science 2019-06-24 Xinchen Yan , Mohi Khansari , Jasmine Hsu , Yuanzheng Gong , Yunfei Bai , Sören Pirk , Honglak Lee

Despite significant advancements in robotic manipulation, achieving consistent and stable grasping remains a fundamental challenge, often limiting the successful execution of complex tasks. Our analysis reveals that even state-of-the-art…

Artificial Intelligence · Computer Science 2025-03-20 Sungjae Lee , Yeonjoo Hong , Kwang In Kim

Robots often face situations where grasping a goal object is desirable but not feasible due to other present objects preventing the grasp action. We present a deep Reinforcement Learning approach to learn grasping and pushing policies for…

Robotics · Computer Science 2024-03-19 Yongliang Wang , Kamal Mokhtar , Cock Heemskerk , Hamidreza Kasaei

In this paper, we present Segmentation-Based Grasp Detection Network (SGDN) to predict a feasible robotic grasping for a unsymmetrical three-finger robotic gripper using RGB images. The feasible grasping of a target should be a collection…

Robotics · Computer Science 2020-05-20 Dexin Wang

We propose a method at the intersection of Computer Vision and Computer Graphics fields, which automatically generates RGBD images using neural networks, based on previously seen and synchronized video, depth and pose signals. Since the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Mihai Cristian Pîrvu

Intelligent vision control systems for surgical robots should adapt to unknown and diverse objects while being robust to system disturbances. Previous methods did not meet these requirements due to mainly relying on pose estimation and…

Robotics · Computer Science 2024-05-29 Hongbin Lin , Bin Li , Chun Wai Wong , Juan Rojas , Xiangyu Chu , Kwok Wai Samuel Au

Recently, deep learning has been successfully applied to robotic grasp detection. Based on convolutional neural networks (CNNs), there have been lots of end-to-end detection approaches. But end-to-end approaches have strict requirements for…

Robotics · Computer Science 2020-12-01 Zhe Chu , Mengkai Hu , Xiangyu Chen

Robots operating in human-centric environments require the integration of visual grounding and grasping capabilities to effectively manipulate objects based on user instructions. This work focuses on the task of referring grasp synthesis,…

Robotics · Computer Science 2023-11-13 Georgios Tziafas , Yucheng Xu , Arushi Goel , Mohammadreza Kasaei , Zhibin Li , Hamidreza Kasaei

Diffusion policies generate robot motions by learning to denoise action-space trajectories conditioned on observations. These observations are commonly streams of RGB images, whose high dimensionality includes substantial task-irrelevant…

Robotics · Computer Science 2025-09-18 Xiatao Sun , Yinxing Chen , Daniel Rakita

Using simulation to train robot manipulation policies holds the promise of an almost unlimited amount of training data, generated safely out of harm's way. One of the key challenges of using simulation, to date, has been to bridge the…

Robotics · Computer Science 2019-11-26 Visak Kumar , Tucker Hermans , Dieter Fox , Stan Birchfield , Jonathan Tremblay

This paper considers the problem of grasp pose detection in point clouds. We follow a general algorithmic structure that first generates a large set of 6-DOF grasp candidates and then classifies each of them as a good or a bad grasp. Our…

Robotics · Computer Science 2017-06-23 Marcus Gualtieri , Andreas ten Pas , Kate Saenko , Robert Platt

Dexterous robotic hands have the capability to interact with a wide variety of household objects to perform tasks like grasping. However, learning robust real world grasping policies for arbitrary objects has proven challenging due to the…

Robotics · Computer Science 2022-10-26 Zoey Qiuyu Chen , Karl Van Wyk , Yu-Wei Chao , Wei Yang , Arsalan Mousavian , Abhishek Gupta , Dieter Fox

We introduce a Cable Grasping-Convolutional Neural Network designed to facilitate robust cable grasping in cluttered environments. Utilizing physics simulations, we generate an extensive dataset that mimics the intricacies of cable…

Robotics · Computer Science 2024-03-05 Lei Zhang , Kaixin Bai , Qiang Li , Zhaopeng Chen , Jianwei Zhang

Recent 3D-based manipulation methods either directly predict the grasp pose using 3D neural networks, or solve the grasp pose using similar objects retrieved from shape databases. However, the former faces generalizability challenges when…

Robotics · Computer Science 2023-10-03 Luobin Wang , Runlin Guo , Quan Vuong , Yuzhe Qin , Hao Su , Henrik Christensen

Humans grasp unfamiliar objects by combining an initial visual estimate with tactile and proprioceptive feedback during interaction. We present ShapeGrasp, a robotic implementation of this approach. The proposed method is an iterative…

Robotics · Computer Science 2026-05-05 Lukas Rustler , Matej Hoffmann

This paper presents a new method for parallel-jaw grasping of isolated objects from depth images, under large gripper pose uncertainty. Whilst most approaches aim to predict the single best grasp pose from an image, our method first…

Robotics · Computer Science 2016-09-14 Edward Johns , Stefan Leutenegger , Andrew J. Davison

Robotic grasping is a fundamental capability for autonomous manipulation, yet remains highly challenging in cluttered environments where occlusion, poor perception quality, and inconsistent 3D reconstructions often lead to unstable or…

Robotics · Computer Science 2025-11-07 Shenglin Wang , Mingtong Dai , Jingxuan Su , Lingbo Liu , Chunjie Chen , Xinyu Wu , Liang Lin

In this work a system for recognizing grasp points in RGB-D images is proposed. This system is intended to be used by a domestic robot when deploying clothes lying at a random position on a table. By taking into consideration that the grasp…

Computer Vision and Pattern Recognition · Computer Science 2017-06-22 Luz María Martínez , Javier Ruiz-del-Solar

Grasp detection with consideration of the affiliations between grasps and their owner in object overlapping scenes is a necessary and challenging task for the practical use of the robotic grasping approach. In this paper, a robotic grasp…

Robotics · Computer Science 2019-03-15 Hanbo Zhang , Xuguang Lan , Site Bai , Xinwen Zhou , Zhiqiang Tian , Nanning Zheng

Our way of grasping objects is challenging for efficient, intelligent and optimal grasp by COBOTs. To streamline the process, here we use deep learning techniques to help robots learn to generate and execute appropriate grasps quickly. We…

Robotics · Computer Science 2021-07-16 Priya Shukla , Nilotpal Pramanik , Deepesh Mehta , G. C. Nandi