English
Related papers

Related papers: Task-Oriented Grasp Prediction with Visual-Languag…

200 papers

Task-oriented grasping of unfamiliar objects is a necessary skill for robots in dynamic in-home environments. Inspired by the human capability to grasp such objects through intuition about their shape and structure, we present a novel…

Robotics · Computer Science 2024-03-28 Samuel Li , Sarthak Bhagat , Joseph Campbell , Yaqi Xie , Woojun Kim , Katia Sycara , Simon Stepputtis

Multi-task learning of deformable object manipulation is a challenging problem in robot manipulation. Most previous works address this problem in a goal-conditioned way and adapt goal images to specify different tasks, which limits the…

Robotics · Computer Science 2024-01-30 Yuhong Deng , Kai Mo , Chongkun Xia , Xueqian Wang

In our daily life, we often encounter objects that are fragile and can be damaged by excessive grasping force, such as fruits. For these objects, it is paramount to grasp gently -- not using the maximum amount of force possible, but rather…

Robotics · Computer Science 2025-07-25 Ken Nakahara , Roberto Calandra

Intelligent service robots require the ability to perform a variety of tasks in dynamic environments. Despite the significant progress in robotic grasping, it is still a challenge for robots to decide grasping position when given different…

Robotics · Computer Science 2021-11-30 Ming Sun , Yue Gao

Task-oriented grasping is a crucial yet challenging task in robotic manipulation. Despite the recent progress, few existing methods address task-oriented grasping with dexterous hands. Dexterous hands provide better precision and…

Robotics · Computer Science 2026-01-12 Weishang Wu , Yifei Shi , Zhizhong Chen , Zhipong Cai

Robotic grasp detection is a fundamental capability for intelligent manipulation in unstructured environments. Previous work mainly employed visual and tactile fusion to achieve stable grasp, while, the whole process depending heavily on…

Robotics · Computer Science 2019-09-17 Teng Xue , Wenhai Liu , Mingshuo Han , Zhenyu Pan , Jin Ma , Quanquan Shao , Weiming Wang

Dexterous robotic manipulation requires more than geometrically valid grasps: it demands physically grounded contact strategies that account for the spatially non-uniform mechanical properties of the object. However, existing grasp planners…

Robotic manipulation in industrial scenarios such as construction commonly faces uncertain observations in which the state of the manipulating object may not be accurately captured due to occlusions and partial observables. For example,…

Robotics · Computer Science 2025-05-23 Xiao Hu , Yang Ye

This paper presents a grounded language-image pre-training (GLIP) model for learning object-level, language-aware, and semantic-rich visual representations. GLIP unifies object detection and phrase grounding for pre-training. The…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Liunian Harold Li , Pengchuan Zhang , Haotian Zhang , Jianwei Yang , Chunyuan Li , Yiwu Zhong , Lijuan Wang , Lu Yuan , Lei Zhang , Jenq-Neng Hwang , Kai-Wei Chang , Jianfeng Gao

This paper presents a training-free pipeline for task-oriented grasp generation that combines pre-trained grasp generation models with vision-language models (VLMs). Unlike traditional approaches that focus solely on stable grasps, our…

Robotics · Computer Science 2025-10-07 Jiaming Wang , Diwen Liu , Jizhuo Chen , Harold Soh

Precise robotic grasping is important for many industrial applications, such as assembly and palletizing, where the location of the object needs to be controlled and known. However, achieving precise grasps is challenging due to noise in…

Robotics · Computer Science 2019-09-06 Jialiang Zhao , Jacky Liang , Oliver Kroemer

Task-Oriented Grasping (TOG) requires robots to select grasps that are functionally appropriate for a specified task - a challenge that demands an understanding of task semantics, object affordances, and functional constraints. We present…

Robotics · Computer Science 2025-11-18 Shailesh , Alok Raj , Nayan Kumar , Priya Shukla , Andrew Melnik , Michael Beetz , Gora Chand Nandi

Target-oriented grasping in unstructured scenes with language control is essential for intelligent robot arm grasping. The ability for the robot arm to understand the human language and execute corresponding grasping actions is a pivotal…

Robotics · Computer Science 2023-12-27 Xinyu Chen , Jian Yang , Zonghan He , Haobin Yang , Qi Zhao , Yuhui Shi

Tactile and kinesthetic perceptions are crucial for human dexterous manipulation, enabling reliable grasping of objects via proprioceptive sensorimotor integration. For robotic hands, even though acquiring such tactile and kinesthetic…

Robotics · Computer Science 2025-09-11 Ce Guo , Xieyuanli Chen , Zhiwen Zeng , Zirui Guo , Yihong Li , Haoran Xiao , Dewen Hu , Huimin Lu

Robotic grasp should be carried out in a real-time manner by proper accuracy. Perception is the first and significant step in this procedure. This paper proposes an improved pipeline model trying to detect grasp as a rectangle…

Robotics · Computer Science 2024-03-12 Hamed Hosseini , Mehdi Tale Masouleh , Ahmad Kalhor

Grasping with anthropomorphic robotic hands involves much more hand-object interactions compared to parallel-jaw grippers. Modeling hand-object interactions is essential to the study of multi-finger hand dextrous manipulation. This work…

Robotics · Computer Science 2022-11-22 Wei Wei , Daheng Li , Peng Wang , Yiming Li , Wanyi Li , Yongkang Luo , Jun Zhong

Robotic manipulation systems that follow language instructions often execute grasp primitives in a largely single-shot manner: a model proposes an action, the robot executes it, and failures such as empty grasps, slips, stalls, timeouts, or…

Robotics · Computer Science 2026-04-10 Wenze Wang , Mehdi Hosseinzadeh , Feras Dayoub

Grasping compliant objects is difficult for robots - applying too little force may cause the grasp to fail, while too much force may lead to object damage. A robot needs to apply the right amount of force to quickly and confidently grasp…

Robotics · Computer Science 2024-01-17 Maceon Knopke , Liguo Zhu , Peter Corke , Fangyi Zhang

For humans, the process of grasping an object relies heavily on rich tactile feedback. Most recent robotic grasping work, however, has been based only on visual input, and thus cannot easily benefit from feedback after initiating contact.…

Robotic grasping is a primitive skill for complex tasks and is fundamental to intelligence. For general 6-Dof grasping, most previous methods directly extract scene-level semantic or geometric information, while few of them consider the…

Robotics · Computer Science 2024-10-08 Pengwei Xie , Siang Chen , Wei Tang , Dingchang Hu , Wenming Yang , Guijin Wang