English
Related papers

Related papers: QwenGrasp: A Usage of Large Vision-Language Model …

200 papers

Dexterous robotic hands have the capability to interact with a wide variety of household objects to perform tasks like grasping. However, learning robust real world grasping policies for arbitrary objects has proven challenging due to the…

Robotics · Computer Science 2022-10-26 Zoey Qiuyu Chen , Karl Van Wyk , Yu-Wei Chao , Wei Yang , Arsalan Mousavian , Abhishek Gupta , Dieter Fox

Interactive robotic grasping using natural language is one of the most fundamental tasks in human-robot interaction. However, language can be a source of ambiguity, particularly when there are ambiguous visual or linguistic contents. This…

Robotics · Computer Science 2022-03-16 Yang Yang , Xibai Lou , Changhyun Choi

Large language models (LLMs) can provide rich physical descriptions of most worldly objects, allowing robots to achieve more informed and capable grasping. We leverage LLMs' common sense physical reasoning and code-writing abilities to…

Robotics · Computer Science 2024-09-10 William Xie , Maria Valentini , Jensen Lavering , Nikolaus Correll

Recognizing and grasping novel-category objects remains a crucial yet challenging problem in real-world robotic applications. Despite its significance, limited research has been conducted in this specific domain. To address this, we…

Robotics · Computer Science 2024-07-19 Li Meng , Zhao Qi , Lyu Shuchang , Wang Chunlei , Ma Yujing , Cheng Guangliang , Yang Chenguang

Large Vision Models trained on internet-scale data have demonstrated strong capabilities in segmenting and semantically understanding object parts, even in cluttered, crowded scenes. However, while these models can direct a robot toward the…

Robotics · Computer Science 2025-11-13 Ray Muxin Liu , Mingxuan Li , Kenneth Shaw , Deepak Pathak

One goal of dexterous robotic grasping is to allow robots to handle objects with the same level of flexibility and adaptability as humans. However, it remains a challenging task to generate an optimal grasping strategy for dexterous hands,…

Robotics · Computer Science 2024-05-17 Fuqiang Zhao , Dzmitry Tsetserukou , Qian Liu

Generating dexterous grasping has been a long-standing and challenging robotic task. Despite recent progress, existing methods primarily suffer from two issues. First, most prior arts focus on a specific type of robot hand, lacking the…

Robotics · Computer Science 2023-03-07 Puhao Li , Tengyu Liu , Yuyang Li , Yiran Geng , Yixin Zhu , Yaodong Yang , Siyuan Huang

Task-oriented grasping is a crucial yet challenging task in robotic manipulation. Despite the recent progress, few existing methods address task-oriented grasping with dexterous hands. Dexterous hands provide better precision and…

Robotics · Computer Science 2026-01-12 Weishang Wu , Yifei Shi , Zhizhong Chen , Zhipong Cai

Robot grasping of desktop object is widely used in intelligent manufacturing, logistics, and agriculture.Although vision-language models (VLMs) show strong potential for robotic manipulation, their deployment in low-level grasping faces key…

Robotics · Computer Science 2026-04-14 Yiran Ling , Wenxuan Li , Siying Dong , Yize Zhang , Xiaoyao Huang , Jing Jiang , Ruonan Li , Jie Liu

Real-world robotic systems frequently require diverse end-effectors for different tasks, however most existing grasp detection methods are optimized for a single gripper type, demanding retraining or optimization for each novel gripper…

Robotics · Computer Science 2026-03-13 Yeonseo Lee , Jungwook Mun , Hyosup Shin , Guebin Hwang , Junhee Nam , Taeyeop Lee , Sungho Jo

To fully utilize the versatility of a multi-fingered dexterous robotic hand for executing diverse object grasps, one must consider the rich physical constraints introduced by hand-object interaction and object geometry. We propose an…

Robotics · Computer Science 2022-12-27 Albert Wu , Michelle Guo , C. Karen Liu

Despite significant advancements in robotic manipulation, achieving consistent and stable grasping remains a fundamental challenge, often limiting the successful execution of complex tasks. Our analysis reveals that even state-of-the-art…

Artificial Intelligence · Computer Science 2025-03-20 Sungjae Lee , Yeonjoo Hong , Kwang In Kim

Intelligent Object manipulation for grasping is a challenging problem for robots. Unlike robots, humans almost immediately know how to manipulate objects for grasping due to learning over the years. A grown woman can grasp objects more…

Machine Learning · Computer Science 2020-01-16 Priya Shukla , Hitesh Kumar , G. C. Nandi

Robotic grasping aims to detect graspable points and their corresponding gripper configurations in a particular scene, and is fundamental for robot manipulation. Existing research works have demonstrated the potential of using a transformer…

Robotics · Computer Science 2023-01-31 Zhenjie Zhao , Hang Yu , Hang Wu , Xuebo Zhang

The task of grasp pattern recognition aims to derive the applicable grasp types of an object according to the visual information. Current state-of-the-art methods ignore category information of objects which is crucial for grasp pattern…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Xiaoqin Zhang , Ziwei Huang , Jingjing Zheng , Shuo Wang , Xianta Jiang

Generating natural human grasps necessitates consideration of not just object geometry but also semantic information. Solely depending on object shape for grasp generation confines the applications of prior methods in downstream tasks. This…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Kailin Li , Jingbo Wang , Lixin Yang , Cewu Lu , Bo Dai

Goal-conditioned robotic grasping in cluttered environments remains a challenging problem due to occlusions caused by surrounding objects, which prevent direct access to the target object. A promising solution to mitigate this issue is…

Robotics · Computer Science 2025-04-07 Boce Hu , Heng Tian , Dian Wang , Haojie Huang , Xupeng Zhu , Robin Walters , Robert Platt

Legged robots with advanced manipulation capabilities have the potential to significantly improve household duties and urban maintenance. Despite considerable progress in developing robust locomotion and precise manipulation methods,…

Robotics · Computer Science 2025-01-14 Jilong Wang , Javokhirbek Rajabov , Chaoyi Xu , Yiming Zheng , He Wang

Multi-object rearrangement is a crucial skill for service robots, and commonsense reasoning is frequently needed in this process. However, achieving commonsense arrangements requires knowledge about objects, which is hard to transfer to…

Robotics · Computer Science 2023-10-09 Yan Ding , Xiaohan Zhang , Chris Paxton , Shiqi Zhang

We focus on the generalization ability of the 6-DoF grasp detection method in this paper. While learning-based grasp detection methods can predict grasp poses for unseen objects using the grasp distribution learned from the training set,…

Robotics · Computer Science 2024-04-03 Haoxiang Ma , Modi Shi , Boyang Gao , Di Huang