English
Related papers

Related papers: Visuomotor Grasping with World Models for Surgical…

200 papers

We present a benchmarking study of vision-based robotic grasping algorithms with distinct approaches, and provide a comparative analysis. In particular, we compare two machine-learning-based and two analytical algorithms using an existing…

Robotic grasping is a primitive skill for complex tasks and is fundamental to intelligence. For general 6-Dof grasping, most previous methods directly extract scene-level semantic or geometric information, while few of them consider the…

Robotics · Computer Science 2024-10-08 Pengwei Xie , Siang Chen , Wei Tang , Dingchang Hu , Wenming Yang , Guijin Wang

Surgical robotics is a rising field in medical technology and advanced robotics. Robot assisted surgery, or robotic surgery, allows surgeons to perform complicated surgical tasks with more precision, automation, and flexibility than is…

Robotics · Computer Science 2023-11-02 A. E. Abdelaal , S. N. Zaman , P. Y Chen , T. Suzuki , J. Ingleton

Classical Visual Servoing (VS) rely on handcrafted visual features, which limit their generalizability. Recently, a number of approaches, some based on Deep Neural Networks, have been proposed to overcome this limitation by comparing…

Robotics · Computer Science 2022-01-21 Nicholas Adrian , Van-Thach Do , Quang-Cuong Pham

Grasping objects of different shapes and sizes - a foundational, effortless skill for humans - remains a challenging task in robotics. Although model-based approaches can predict stable grasp configurations for known object models, they…

Robotics · Computer Science 2022-11-22 Malte Mosbach , Sven Behnke

To aid humans in everyday tasks, robots need to know which objects exist in the scene, where they are, and how to grasp and manipulate them in different situations. Therefore, object recognition and grasping are two key functionalities for…

Robotics · Computer Science 2022-12-07 Hamidreza Kasaei , Sha Luo , Remo Sasso , Mohammadreza Kasaei

Robot-assisted surgery has made significant progress, with instrument segmentation being a critical factor in surgical intervention quality. It serves as the building block to facilitate surgical robot navigation and surgical education for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Hongqiu Wang , Lei Zhu , Guang Yang , Yike Guo , Shichen Zhang , Bo Xu , Yueming Jin

We consider the problem of closed-loop robotic grasping and present a novel planner which uses Visual Feedback and an uncertainty-aware Adaptive Sampling strategy (VFAS) to close the loop. At each iteration, our method VFAS-Grasp builds a…

Robotics · Computer Science 2023-10-31 Pedro Piacenza , Jiacheng Yuan , Jinwook Huh , Volkan Isler

In order to explore robotic grasping in unstructured and dynamic environments, this work addresses the visual perception phase involved in the task. This phase involves the processing of visual data to obtain the location of the object to…

Robotics · Computer Science 2021-03-02 Eduardo Godinho Ribeiro , Raul de Queiroz Mendes , Valdir Grassi

Grasping has been a crucial but challenging problem in robotics for many years. One of the most important challenges is how to make grasping generalizable and robust to novel objects as well as grippers in unstructured environments. We…

Robotics · Computer Science 2024-10-15 Binglei Zhao , Han Wang , Jian Tang , Chengzhong Ma , Hanbo Zhang , Jiayuan Zhang , Xuguang Lan , Xingyu Chen

Robot-assisted surgery (RAS) has become a critical paradigm in modern surgery, promoting patient recovery and reducing the burden on surgeons through minimally invasive approaches. To fully realize its potential, however, a precise…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Garam Kim , Tae Kyeong Jeong , Juyoun Park

The use of anthropomorphic robotic hands for assisting individuals in situations where human hands may be unavailable or unsuitable has gained significant importance. In this paper, we propose a novel task called human-assisting dexterous…

Robotics · Computer Science 2025-04-15 Tianhao Wu , Mingdong Wu , Jiyao Zhang , Yunchong Gan , Hao Dong

Grasp detection requires flexibility to handle objects of various shapes without relying on prior knowledge of the object, while also offering intuitive, user-guided control. This paper introduces GraspSAM, an innovative extension of the…

Robotics · Computer Science 2024-09-24 Sangjun Noh , Jongwon Kim , Dongwoo Nam , Seunghyeok Back , Raeyoung Kang , Kyoobin Lee

Reliable object grasping is one of the fundamental tasks in robotics. However, determining grasping pose based on single-image input has long been a challenge due to limited visual information and the complexity of real-world objects. In…

Robotics · Computer Science 2025-05-21 Yiming Li , Hanchi Ren , Yue Yang , Jingjing Deng , Xianghua Xie

Robotic grasping is a fundamental aspect of robot functionality, defining how robots interact with objects. Despite substantial progress, its generalizability to counter-intuitive or long-tailed scenarios, such as objects with uncommon…

Robotics · Computer Science 2024-02-27 Dingkun Guo , Yuqi Xiang , Shuqi Zhao , Xinghao Zhu , Masayoshi Tomizuka , Mingyu Ding , Wei Zhan

As the number of the robot's degrees of freedom increases, the implementation of robot motion becomes more complex and difficult. In this study, we focus on learning 6DOF-grasping motion and consider dividing the grasping motion into…

Robotics · Computer Science 2021-03-24 Daichi Kawakami , Ryoichi Ishikawa , Menandro Roxas , Yoshihiro Sato , Takeshi Oishi

Learning policies that can generalize to unseen environments is a fundamental challenge in visual reinforcement learning (RL). While most current methods focus on acquiring robust visual representations through auxiliary supervision,…

Machine Learning · Computer Science 2023-12-29 Ziyu Wang , Yanjie Ze , Yifei Sun , Zhecheng Yuan , Huazhe Xu

Grasping is essential in robotic manipulation, yet challenging due to object and gripper diversity and real-world complexities. Traditional analytic approaches often have long optimization times, while data-driven methods struggle with…

Robotics · Computer Science 2024-12-16 Wenzheng Zhang , Fahira Afzal Maken , Tin Lai , Fabio Ramos

Training vision-based manipulation policies that are robust across diverse visual environments remains an important and unresolved challenge in robot learning. Current approaches often sidestep the problem by relying on invariant…

Robotics · Computer Science 2025-05-20 Sumeet Batra , Gaurav Sukhatme

The dominant paradigm for end-to-end robot learning focuses on optimizing task-specific objectives that solve a single robotic problem such as picking up an object or reaching a target position. However, recent work on high-capacity models…

Robotics · Computer Science 2024-01-02 Samuel Schmidgall , Ji Woong Kim , Alan Kuntz , Ahmed Ezzat Ghazi , Axel Krieger