English
Related papers

Related papers: Language-guided Robot Grasping: CLIP-based Referri…

200 papers

Robust grasping in cluttered environments remains an open challenge in robotics. While benchmark datasets have significantly advanced deep learning methods, they mainly focus on simplistic scenes with light occlusion and insufficient…

The language-guided robot grasping task requires a robot agent to integrate multimodal information from both visual and linguistic inputs to predict actions for target-driven grasping. While recent approaches utilizing Multimodal Large…

Robotics · Computer Science 2025-02-10 Houjian Yu , Mingen Li , Alireza Rezazadeh , Yang Yang , Changhyun Choi

Robot grasping of desktop object is widely used in intelligent manufacturing, logistics, and agriculture.Although vision-language models (VLMs) show strong potential for robotic manipulation, their deployment in low-level grasping faces key…

Robotics · Computer Science 2026-04-14 Yiran Ling , Wenxuan Li , Siying Dong , Yize Zhang , Xiaoyao Huang , Jing Jiang , Ruonan Li , Jie Liu

Grasping in dense clutter is a fundamental skill for autonomous robots. However, the crowdedness and occlusions in the cluttered scenario cause significant difficulties to generate valid grasp poses without collisions, which results in low…

Robotics · Computer Science 2022-07-26 Zhan Liu , Ziwei Wang , Sichao Huang , Jie Zhou , Jiwen Lu

Robotic grasping faces new challenges in human-robot-interaction scenarios. We consider the task that the robot grasps a target object designated by human's language directives. The robot not only needs to locate a target based on…

Robotics · Computer Science 2023-08-02 Yuhao Lu , Yixuan Fan , Beixing Deng , Fangfu Liu , Yali Li , Shengjin Wang

Despite the impressive progress achieved in robotic grasping, robots are not skilled in sophisticated tasks (e.g. search and grasp a specified target in clutter). Such tasks involve not only grasping but the comprehensive perception of the…

Robotics · Computer Science 2021-12-10 Hanbo Zhang , Deyu Yang , Han Wang , Binglei Zhao , Xuguang Lan , Jishiyu Ding , Nanning Zheng

Generating high-quality instance-wise grasp configurations provides critical information of how to grasp specific objects in a multi-object environment and is of high importance for robot manipulation tasks. This work proposed a novel…

Robotics · Computer Science 2023-02-16 Yucheng Xu , Mohammadreza Kasaei , Hamidreza Kasaei , Zhibin Li

This paper presents INVIGORATE, a robot system that interacts with human through natural language and grasps a specified object in clutter. The objects may occlude, obstruct, or even stack on top of one another. INVIGORATE embodies several…

Robotics · Computer Science 2024-01-09 Hanbo Zhang , Yunfan Lu , Cunjun Yu , David Hsu , Xuguang Lan , Nanning Zheng

Current NLP techniques have been greatly applied in different domains. In this paper, we propose a human-in-the-loop framework for robotic grasping in cluttered scenes, investigating a language interface to the grasping process, which…

Robotics · Computer Science 2022-09-29 Yaoxian Song , Penglei Sun , Pengfei Fang , Linyi Yang , Yanghua Xiao , Yue Zhang

Grasping is among the most fundamental and long-lasting problems in robotics study. This paper studies the problem of 6-DoF(degree of freedom) grasping by a parallel gripper in a cluttered scene captured using a commodity depth sensor from…

Robotics · Computer Science 2019-11-01 Yuzhe Qin , Rui Chen , Hao Zhu , Meng Song , Jing Xu , Hao Su

In densely cluttered environments, physical interference, visual occlusions, and unstable contacts often cause direct dexterous grasping to fail, while aggressive singulation strategies may compromise safety. Enabling robots to adaptively…

Robotics · Computer Science 2026-03-12 Zixuan Chen , Wenquan Zhang , Jing Fang , Ruiming Zeng , Zhixuan Xu , Yiwen Hou , Xinke Wang , Jieqi Shi , Jing Huo , Yang Gao

To effectively apply robots in working environments and assist humans, it is essential to develop and evaluate how visual grounding (VG) can affect machine performance on occluded objects. However, current VG works are limited in working…

Computation and Language · Computer Science 2021-04-15 Ke-Jyun Wang , Yun-Hsuan Liu , Hung-Ting Su , Jen-Wei Wang , Yu-Siang Wang , Winston H. Hsu , Wen-Chin Chen

6-DoF object-agnostic grasping in unstructured environments is a critical yet challenging task in robotics. Most current works use non-optimized approaches to sample grasp locations and learn spatial features without concerning the grasping…

Robotics · Computer Science 2023-12-07 Haowen Wang , Wanhao Niu , Chungang Zhuang

Robotic grasping is one of the most fundamental tasks in robotic manipulation, and grasp detection/generation has long been the subject of extensive research. Recently, language-driven grasp generation has emerged as a promising direction…

Object grasping in cluttered scenes is a widely investigated field of robot manipulation. Most of the current works focus on estimating grasp pose from point clouds based on an efficient single-shot grasp detection network. However, due to…

Robotics · Computer Science 2021-05-19 Wei Wei , Yongkang Luo , Fuyu Li , Guangyun Xu , Jun Zhong , Wanyi Li , Peng Wang

Dexterous grasping in cluttered environments presents substantial challenges due to the high degrees of freedom of dexterous hands, occlusion, and potential collisions arising from diverse object geometries and complex layouts. To address…

Robotics · Computer Science 2026-02-03 Jiyao Zhang , Zhiyuan Ma , Tianhao Wu , Zeyuan Chen , Hao Dong

Robotic grasping is one of the most fundamental robotic manipulation tasks and has been actively studied. However, how to quickly teach a robot to grasp a novel target object in clutter remains challenging. This paper attempts to tackle the…

Robotics · Computer Science 2021-04-07 Yang Yang , Yuanhao Liu , Hengyue Liang , Xibai Lou , Changhyun Choi

In this paper, a novel robotic grasping system is established to automatically pick up objects in cluttered scenes. A composite robotic hand composed of a suction cup and a gripper is designed for grasping the object stably. The suction cup…

Robotics · Computer Science 2023-02-22 Yuhong Deng , Xiaofeng Guo , Yixuan Wei , Kai Lu , Bin Fang , Di Guo , Huaping Liu , Fuchun Sun

In general, humans would grasp an object differently for different tasks, e.g., "grasping the handle of a knife to cut" vs. "grasping the blade to hand over". In the field of robotic grasp pose detection research, some existing works…

Robotics · Computer Science 2025-02-25 An-Lan Wang , Nuo Chen , Kun-Yu Lin , Li Yuan-Ming , Wei-Shi Zheng

The hand plays a pivotal role in human ability to grasp and manipulate objects and controllable grasp synthesis is the key for successfully performing downstream tasks. Existing methods that use human intention or task-level language as…

Artificial Intelligence · Computer Science 2024-04-24 Xiaoyun Chang , Yi Sun