English
Related papers

Related papers: Target-Oriented Object Grasping via Multimodal Hum…

200 papers

Object detection and data association are critical components in multi-object tracking (MOT) systems. Despite the fact that the two components are dependent on each other, prior works often design detection and data association modules…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Yongxin Wang , Kris Kitani , Xinshuo Weng

Successful robotic grasping in cluttered environments not only requires a model to visually ground a target object but also to reason about obstructions that must be cleared beforehand. While current vision-language embodied reasoning…

We address the problem of keypoint selection, and find that the performance of 6DoF pose estimation methods can be improved when pre-defined keypoint locations are learned, rather than being heuristically selected as has been the standard…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Yangzheng Wu , Michael Greenspan

Many robotic tasks require grasping objects at specific object parts instead of arbitrarily, a crucial capability for interactions beyond simple pick-and-place, such as human-robot interaction, handovers, or tool use. Prior work has focused…

Task-oriented dexterous grasping remains challenging in robotic manipulations of open-world objects under severe partial observation, where significant missing data invalidates generic shape completion. In this paper, to overcome this…

Robotics · Computer Science 2026-04-14 Weishang Wu , Yifei Shi , Zhiping Cai

Robotic grasping is one of the most fundamental robotic manipulation tasks and has been the subject of extensive research. However, swiftly teaching a robot to grasp a novel target object in clutter remains challenging. This paper attempts…

Robotics · Computer Science 2025-01-07 Yang Yang , Houjian Yu , Xibai Lou , Yuanhao Liu , Changhyun Choi

Precise robotic grasping of several novel objects is a huge challenge in manufacturing, automation, and logistics. Most of the current methods for model-free grasping are disadvantaged by the sparse data in grasping datasets and by errors…

Robotics · Computer Science 2023-01-31 Lei Zhang , Kaixin Bai , Zhaopeng Chen , Yunlei Shi , Jianwei Zhang

Grasp detection in a cluttered environment is still a great challenge for robots. Currently, the Transformer mechanism has been successfully applied to visual tasks, and its excellent ability of global context information extraction…

Robotics · Computer Science 2022-05-31 Mingshuai Dong , Xiuli Yu

Robot learning is often simplified to planar manipulation due to its data consumption. Then, a common approach is to use a fully-convolutional neural network to estimate the reward of grasp primitives. In this work, we extend this approach…

Robotics · Computer Science 2024-11-22 Lars Berscheid , Christian Friedrich , Torsten Kröger

Robotic grasping faces new challenges in human-robot-interaction scenarios. We consider the task that the robot grasps a target object designated by human's language directives. The robot not only needs to locate a target based on…

Robotics · Computer Science 2023-08-02 Yuhao Lu , Yixuan Fan , Beixing Deng , Fangfu Liu , Yali Li , Shengjin Wang

Despite the impressive progress achieved in robotic grasping, robots are not skilled in sophisticated tasks (e.g. search and grasp a specified target in clutter). Such tasks involve not only grasping but the comprehensive perception of the…

Robotics · Computer Science 2021-12-10 Hanbo Zhang , Deyu Yang , Han Wang , Binglei Zhao , Xuguang Lan , Jishiyu Ding , Nanning Zheng

Grasping is one of the most fundamental challenging capabilities in robotic manipulation, especially in unstructured, cluttered, and semantically diverse environments. Recent researches have increasingly explored language-guided…

Robotics · Computer Science 2025-12-25 Zebin Jiang , Tianle Jin , Xiangtong Yao , Alois Knoll , Hu Cao

Vision-based grasp estimation is an essential part of robotic manipulation tasks in the real world. Existing planar grasp estimation algorithms have been demonstrated to work well in relatively simple scenes. But when it comes to complex…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 Haozhe Wang , Zhiyang Liu , Lei Zhou , Huan Yin , Marcelo H Ang

In this paper, we study the problem of task-oriented grasp synthesis from partial point cloud data using an eye-in-hand camera configuration. In task-oriented grasp synthesis, a grasp has to be selected so that the object is not lost during…

Robotics · Computer Science 2023-09-22 Aditya Patankar , Khiem Phi , Dasharadhan Mahalingam , Nilanjan Chakraborty , IV Ramakrishnan

The 6-Degree of Freedom (DoF) grasp method based on point clouds has shown significant potential in enabling robots to grasp target objects. However, most existing methods are based on the point clouds (2.5D points) generated from…

Robotics · Computer Science 2026-01-13 Yaofeng Cheng , Fusheng Zha , Wei Guo , Pengfei Wang , Chao Zeng , Lining Sun , Chenguang Yang

Integrated sensing and communication (ISAC) is a key enabler of 6G, supporting environment-aware services. A fundamental sensing task in this setting is reliable multi-target detection and tracking. This paper proposes a temporal graph…

Signal Processing · Electrical Eng. & Systems 2026-04-10 Saiedeh Maboud Sanaie , Marcus Grossmann , Markus Landmann , Thomas Dallmann

We propose an approach to multi-modal grasp detection that jointly predicts the probabilities that several types of grasps succeed at a given grasp pose. Given a partial point cloud of a scene, the algorithm proposes a set of feasible grasp…

Robotics · Computer Science 2021-09-16 Matt Corsaro , Stefanie Tellex , George Konidaris

Rotation invariance has been an important topic in computer vision tasks. Ideally, robot grasp detection should be rotation-invariant. However, rotation-invariance in robotic grasp detection has been only recently studied by using rotation…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 Dongwon Park , Yonghyeok Seo , Se Young Chun

Camouflaged object detection (COD) aims to segment objects that blend into their surroundings. However, most existing studies overlook the semantic differences among textual prompts of different targets as well as fine-grained frequency…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Dezhen Wang , Haixiang Zhao , Xiang Shen , Sheng Miao

We introduce AO-Grasp, a grasp proposal method that generates 6 DoF grasps that enable robots to interact with articulated objects, such as opening and closing cabinets and appliances. AO-Grasp consists of two main contributions: the…