English
Related papers

Related papers: Toward a Plug-and-Play Vision-Based Grasping Modul…

200 papers

Precise robotic grasping of several novel objects is a huge challenge in manufacturing, automation, and logistics. Most of the current methods for model-free grasping are disadvantaged by the sparse data in grasping datasets and by errors…

Robotics · Computer Science 2023-01-31 Lei Zhang , Kaixin Bai , Zhaopeng Chen , Yunlei Shi , Jianwei Zhang

Humans excel in grasping and manipulating objects because of their life-long experience and knowledge about the 3D shape and weight distribution of objects. However, the lack of such intuition in robots makes robotic grasping an…

Computer Vision and Pattern Recognition · Computer Science 2018-11-05 Ghazal Ghazaei , Iro Laina , Christian Rupprecht , Federico Tombari , Nassir Navab , Kianoush Nazarpour

Robotic grasping presents a difficult motor task in real-world scenarios, constituting a major hurdle to the deployment of capable robots across various industries. Notably, the scarcity of data makes grasping particularly challenging for…

Robotics · Computer Science 2024-06-18 Abhi Kamboj , Katherine Driggs-Campbell

Shared control improves Human-Robot Interaction by reducing the user's workload and increasing the robot's autonomy. It allows robots to perform tasks under the user's supervision. Current eye-tracking-driven approaches face several…

Robotics · Computer Science 2026-01-27 Anke Fischer-Janzen , Thomas M. Wendt , Kristof Van Laerhoven

Human-robot object handovers have been an actively studied area of robotics over the past decade; however, very few techniques and systems have addressed the challenge of handing over diverse objects with arbitrary appearance, size, shape,…

Robotics · Computer Science 2021-06-07 Wei Yang , Chris Paxton , Arsalan Mousavian , Yu-Wei Chao , Maya Cakmak , Dieter Fox

Robotic vision plays a key role for perceiving the environment in grasping applications. However, the conventional framed-based robotic vision, suffering from motion blur and low sampling rate, may not meet the automation needs of evolving…

Reliable robotic grasping, especially with deformable objects such as fruits, remains a challenging task due to underactuated contact interactions with a gripper, unknown object dynamics and geometries. In this study, we propose a…

Robotics · Computer Science 2023-07-25 Yunhai Han , Kelin Yu , Rahul Batra , Nathan Boyd , Chaitanya Mehta , Tuo Zhao , Yu She , Seth Hutchinson , Ye Zhao

Many robotic tasks require grasping objects at specific object parts instead of arbitrarily, a crucial capability for interactions beyond simple pick-and-place, such as human-robot interaction, handovers, or tool use. Prior work has focused…

In this paper, we study the problem of learning vision-based dynamic manipulation skills using a scalable reinforcement learning approach. We study this problem in the context of grasping, a longstanding challenge in robotic manipulation.…

Many robotic tasks involving some form of 3D visual perception greatly benefit from a complete knowledge of the working environment. However, robots often have to tackle unstructured environments and their onboard visual sensors can only…

Computer Vision and Pattern Recognition · Computer Science 2022-10-24 Andrea Rosasco , Stefano Berti , Fabrizio Bottarel , Michele Colledanchise , Lorenzo Natale

Intelligent vision control systems for surgical robots should adapt to unknown and diverse objects while being robust to system disturbances. Previous methods did not meet these requirements due to mainly relying on pose estimation and…

Robotics · Computer Science 2024-05-29 Hongbin Lin , Bin Li , Chun Wai Wong , Juan Rojas , Xiangyu Chu , Kwok Wai Samuel Au

In the rapidly advancing field of robotics, the fusion of state-of-the-art visual technologies with mobile robotic arms has emerged as a critical integration. This paper introduces a novel system that combines the Segment Anything model…

Robotics · Computer Science 2024-04-30 Shimian Zhang , Qiuhong Lu

Currently, task-oriented grasp detection approaches are mostly based on pixel-level affordance detection and semantic segmentation. These pixel-level approaches heavily rely on the accuracy of a 2D affordance mask, and the generated grasp…

Robotics · Computer Science 2022-10-18 Wenkai Chen , Hongzhuo Liang , Zhaopeng Chen , Fuchun Sun , Jianwei Zhang

Generating grasp poses is a crucial component for any robot object manipulation task. In this work, we formulate the problem of grasp generation as sampling a set of grasps using a variational autoencoder and assess and refine the sampled…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Arsalan Mousavian , Clemens Eppner , Dieter Fox

Robotic grasping, the ability of robots to reliably secure and manipulate objects of varying shapes, sizes and orientations, is a complex task that requires precise perception and control. Deep neural networks have shown remarkable success…

Recent advances in AI have led to significant results in robotic learning, but skills like grasping remain partially solved. Many recent works exploit synthetic grasping datasets to learn to grasp unknown objects. However, those datasets…

Developing personal robots that can perform a diverse range of manipulation tasks in unstructured environments necessitates solving several challenges for robotic grasping systems. We take a step towards this broader goal by presenting the…

External collisions to robot actuators typically pose risks to grasping circular objects. This work presents a vision-based sensing module capable of detecting collisions to maintain stable grasping with a soft gripper system. The system…

Robotics · Computer Science 2025-08-08 Boyang Zhang , Jiahui Zuo , Zeyu Duan , Fumin Zhang

Robotic grasping requires safe force interaction to prevent a grasped object from being damaged or slipping out of the hand. In this vein, this paper proposes an integrated framework for grasping with formal safety guarantees based on…

Robotics · Computer Science 2025-11-20 Yitaek Kim , Jeeseop Kim , Albert H. Li , Aaron D. Ames , Christoffer Sloth

The accurate detection and grasping of transparent objects are challenging but of significance to robots. Here, a visual-tactile fusion framework for transparent object grasping under complex backgrounds and variant light conditions is…

Robotics · Computer Science 2024-06-11 Shoujie Li , Haixin Yu , Wenbo Ding , Houde Liu , Linqi Ye , Chongkun Xia , Xueqian Wang , Xiao-Ping Zhang