English
Related papers

Related papers: hSDB-instrument: Instrument Localization Database …

200 papers

Computer vision-based technologies significantly enhance surgical automation by advancing tool tracking, detection, and localization. However, Current data-driven approaches are data-voracious, requiring large, high-quality labeled image…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Tianle Zeng , Junlei Hu , Gerardo Loza Galindo , Sharib Ali , Duygu Sarikaya , Pietro Valdastri , Dominic Jones

To be useful in everyday environments, robots must be able to identify and locate real-world objects. In recent years, video object segmentation has made significant progress on densely separating such objects from background in real and…

Robotics · Computer Science 2020-01-13 Brent A. Griffin , Victoria Florence , Jason J. Corso

Many works in collaborative robotics and human-robot interaction focuses on identifying and predicting human behaviour while considering the information about the robot itself as given. This can be the case when sensors and the robot are…

We propose a novel method to tackle the visual-inertial localization problem for constrained camera movements. We use residuals from the different modalities to jointly optimize a global cost function. The residuals emerge from IMU…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Regine Hartwig , Daniel Ostler , Jean-Claude Rosenthal , Hubertus Feußner , Dirk Wilhelm , Dirk Wollherr

Robot-assisted surgery is an emerging technology which has undergone rapid growth with the development of robotics and imaging systems. Innovations in vision, haptics and accurate movements of robot arms have enabled surgeons to perform…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Mobarakol Islam , Daniel A. Atputharuban , Ravikiran Ramesh , Hongliang Ren

Vision-based surgical navigation has received increasing attention due to its non-invasive, cost-effective, and flexible advantages. In particular, a critical element of the vision-based navigation system is tracking surgical instruments.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Wenwu Guo , Jinlin Wu , Zhen Chen , Qingxiang Zhao , Miao Xu , Zhen Lei , Hongbin Liu

In head and neck surgery, continuous intraoperative tissue differentiation is of great importance to avoid injury to sensitive structures such as nerves and vessels. Hyperspectral imaging (HSI) with neural network analysis could support the…

Image and Video Processing · Electrical Eng. & Systems 2024-12-23 Eric L. Wisotzky , Alexander Schill , Anna Hilsmann , Peter Eisert , Michael Knoke

Reliable and real-time 3D reconstruction and localization functionality is a crucial prerequisite for the navigation of actively controlled capsule endoscopic robots as an emerging, minimally invasive diagnostic and therapeutic technology…

Positioning patients for scanning and interventional procedures is a critical task that requires high precision and accuracy. The conventional workflow involves manually adjusting the patient support to align the center of the target body…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Zhongpai Gao , Abhishek Sharma , Meng Zheng , Benjamin Planche , Terrence Chen , Ziyan Wu

Surgical robotics holds much promise for improving patient safety and clinician experience in the Operating Room (OR). However, it also comes with new challenges, requiring strong team coordination and effective OR management. Automatic…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Idris Hamoud , Muhammad Abdullah Jamal , Vinkle Srivastav , Didier Mutter , Nicolas Padoy , Omid Mohareri

Reducing the incidence of surgical site infections (SSIs) is one of the objectives of the French nosocomial infection control program. Manual monitoring of SSIs is carried out each year by the hospital hygiene team and surgeons at the…

Creating computer vision datasets requires careful planning and lots of time and effort. In robotics research, we often have to use standardized objects, such as the YCB object set, for tasks such as object tracking, pose estimation,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-20 Kenneth Blomqvist , Jen Jen Chung , Lionel Ott , Roland Siegwart

We present a benchmark for 3D human whole-body pose estimation, which involves identifying accurate 3D keypoints on the entire human body, including face, hands, body, and feet. Currently, the lack of a fully annotated and accurate 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Yue Zhu , Nermin Samet , David Picard

Accurate instrument pose estimation is a crucial step towards the future of robotic surgery, enabling applications such as autonomous surgical task execution. Vision-based methods for surgical instrument pose estimation provide a practical…

Visual-inertial simultaneous localization and mapping (SLAM) is a key module of robotics and low-speed autonomous vehicles, which is usually limited by the high computation burden for practical applications. To this end, an innovative…

Robotics · Computer Science 2025-05-28 Bingxiang Kang , Jie Zou , Guofa Li , Pengwei Zhang , Jie Zeng , Kan Wang , Jie Li

Surgical action automation has progressed rapidly toward achieving surgeon-like dexterous control, driven primarily by advances in learning from demonstration and vision-language-action models. While these have demonstrated success in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Aiza Maksutova , Lalithkumar Seenivasan , Hao Ding , Jiru Xu , Chenhao Yu , Chenyan Jing , Yiqing Shen , Mathias Unberath

The use of Augmented Reality (AR) for navigation purposes has shown beneficial in assisting physicians during the performance of surgical procedures. These applications commonly require knowing the pose of surgical tools and patients to…

This data article presents a dataset of 11,884 labeled images documenting a simulated blood extraction (phlebotomy) procedure performed on a training arm. Images were extracted from high-definition videos recorded under controlled…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Raúl Jiménez Cruz , César Torres-Huitzil , Marco Franceschetti , Ronny Seiger , Luciano García-Bañuelos , Barbara Weber

In this work, we study in detail the performance of Higher Order Dynamic Mode Decomposition (HODMD) technique when applied to echocardiography images. HODMD is a data-driven method generally used in fluid dynamics and in the analysis of…

Image and Video Processing · Electrical Eng. & Systems 2022-01-11 Nourelhouda Groun , Maria Villalba-Orero , Enrique Lara-Pezzi , Eusebio Valero , Jesus Garicano-Mena , Soledad Le Clainche

Automatic surgical gesture recognition is a prerequisite of intra-operative computer assistance and objective surgical skill assessment. Prior works either require additional sensors to collect kinematics data or have limitations on…

Image and Video Processing · Electrical Eng. & Systems 2020-07-15 Jinglu Zhang , Yinyu Nie , Yao Lyu , Hailin Li , Jian Chang , Xiaosong Yang , Jian Jun Zhang