English
Related papers

Related papers: When Transformer Meets Robotic Grasping: Exploits …

200 papers

Intelligent service robots require the ability to perform a variety of tasks in dynamic environments. Despite the significant progress in robotic grasping, it is still a challenge for robots to decide grasping position when given different…

Robotics · Computer Science 2021-11-30 Ming Sun , Yue Gao

Perception-for-grasping is a challenging problem in robotics. Inexpensive range sensors such as the Microsoft Kinect provide sensing capabilities that have given new life to the effort of developing robust and accurate perception methods…

Robotics · Computer Science 2013-11-14 Andreas ten Pas , Robert Platt

Humans can quickly determine the force required to grasp a deformable object to prevent its sliding or excessive deformation through vision and touch, which is still a challenging task for robots. To address this issue, we propose a novel…

Robotics · Computer Science 2020-06-24 Shaowei Cui , Rui Wang , Junhang Wei , Fanrong Li , Shuo Wang

The paradigm of Transformers using the self-attention mechanism has manifested its advantage in learning graph-structured data. Yet, Graph Transformers are capable of modeling full range dependencies but are often deficient in extracting…

Machine Learning · Computer Science 2024-09-11 Minhong Zhu , Zhenhao Zhao , Weiran Cai

We present an attention based visual analysis framework to compute grasp-relevant information in order to guide grasp planning using a multi-fingered robotic hand. Our approach uses a computational visual attention model to locate regions…

Robotics · Computer Science 2018-09-13 Zhen Deng , Ge Gao , Simone Frintrop , Jianwei Zhang

We propose VISO-Grasp, a novel vision-language-informed system designed to systematically address visibility constraints for grasping in severely occluded environments. By leveraging Foundation Models (FMs) for spatial reasoning and active…

Robotics · Computer Science 2025-08-07 Yitian Shi , Di Wen , Guanqi Chen , Edgar Welte , Sheng Liu , Kunyu Peng , Rainer Stiefelhagen , Rania Rayyes

A deep learning architecture is proposed to predict graspable locations for robotic manipulation. It considers situations where no, one, or multiple object(s) are seen. By defining the learning problem to be classification with null…

Robotics · Computer Science 2018-07-24 Fu-Jen Chu , Ruinian Xu , Patricio A. Vela

Grasping objects is one of the most important abilities that a robot needs to master in order to interact with its environment. Current state-of-the-art methods rely on deep neural networks trained to jointly predict a graspability score…

Robotics · Computer Science 2021-04-01 Amaury Depierre , Emmanuel Dellandréa , Liming Chen

Robotic grasping plays an important role in the field of robotics. The current state-of-the-art robotic grasping detection systems are usually built on the conventional vision, such as RGB-D camera. Compared to traditional frame-based…

Computer Vision and Pattern Recognition · Computer Science 2020-05-04 Bin Li , Hu Cao , Zhongnan Qu , Yingbai Hu , Zhenke Wang , Zichen Liang

Transformer architecture has been showing its great strength in visual object tracking, for its effective attention mechanism. Existing transformer-based approaches adopt the pixel-to-pixel attention strategy on flattened image features and…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Zikai Song , Junqing Yu , Yi-Ping Phoebe Chen , Wei Yang

The reliability of grasp detection for target objects in complex scenes is a challenging task and a critical problem that needs to be solved urgently in practical application. At present, the grasp detection location comes from searching…

Robotics · Computer Science 2021-01-21 Mingshuai Dong , Shimin Wei , Xiuli Yu , Jianqin Yin

Grasping is a fundamental skill in robotics with diverse applications across medical, industrial, and domestic domains. However, current approaches for predicting valid grasps are often tailored to specific grippers, limiting their…

Robotics · Computer Science 2024-10-25 Roman Freiberg , Alexander Qualmann , Ngo Anh Vien , Gerhard Neumann

Grasp pose estimation is an important issue for robots to interact with the real world. However, most of existing methods require exact 3D object models available beforehand or a large amount of grasp annotations for training. To avoid…

Robotics · Computer Science 2022-07-26 Hongtao Wen , Jianhang Yan , Wanli Peng , Yi Sun

Handling object deformations for robotic grasping is still a major problem to solve. In this paper, we propose an efficient learning-free solution for this problem where generated grasp hypotheses of a region of an object are adapted to its…

Robotics · Computer Science 2022-03-03 Cristiana de Farias , Brahim Tamadazte , Rustam Stolkin , Naresh Marturi

Robotic grasping in cluttered environments remains a significant challenge due to occlusions and complex object arrangements. We have developed ThinkGrasp, a plug-and-play vision-language grasping system that makes use of GPT-4o's advanced…

Robotics · Computer Science 2026-04-03 Yaoyao Qian , Xupeng Zhu , Ondrej Biza , Shuo Jiang , Linfeng Zhao , Haojie Huang , Yu Qi , Robert Platt

We consider the problem of robotic grasping using depth + RGB information sampling from a real sensor. we design an encoder-decoder neural network to predict grasp policy in real time. This method can fuse the advantage of depth image and…

Robotics · Computer Science 2019-06-03 Song Yaoxian , Cheng Chun , Fei Yuejiao , Li Xiangqing , Yu Changbin

Grasp pose detection in cluttered, real-world environments remains a significant challenge due to noisy and incomplete sensory data combined with complex object geometries. This paper introduces Grasp the Graph 2.0 (GtG 2.0) method, a…

This paper describes a method for generating robot grasps by jointly considering stability and other task and object-specific constraints. We introduce a three-level representation that is acquired for each object class from a small number…

Robotics · Computer Science 2022-03-22 Mark Robson , Mohan Sridharan

Robotic grasping faces challenges in adapting to objects with varying shapes and sizes. In this paper, we introduce MISCGrasp, a volumetric grasping method that integrates multi-scale feature extraction with contrastive feature enhancement…

Robotics · Computer Science 2025-07-04 Qingyu Fan , Yinghao Cai , Chao Li , Chunting Jiao , Xudong Zheng , Tao Lu , Bin Liang , Shuo Wang

Robotic grasping is one of the most fundamental tasks in robotic manipulation, and grasp detection/generation has long been the subject of extensive research. Recently, language-driven grasp generation has emerged as a promising direction…