English
Related papers

Related papers: ROBUST-MIPS: A Combined Skeletal Pose and Instance…

200 papers

Surgical robots are usually controlled using a priori models based on the robots' geometric parameters, which are calibrated before the surgical procedure. One of the challenges in using robots in real surgical settings is that those…

Robotics · Computer Science 2022-06-03 Masakazu Yoshimura , Murilo Marques Marinho , Kanako Harada , Mamoru Mitsuishi

Deep learning methods have been shown to be effective for the automatic segmentation of structures and pathologies in medical imaging. However, they require large annotated datasets, whose manual segmentation is a tedious and time-consuming…

Image and Video Processing · Electrical Eng. & Systems 2022-09-27 Bella Specktor Fadida , Daphna Link Sourani , Liat Ben Sira Elka Miller , Dafna Ben Bashat , Leo Joskowicz

One of the fundamental challenges in microscopy (MS) image analysis is instance segmentation (IS), particularly when segmenting cluster regions where multiple objects of varying sizes and shapes may be connected or even overlapped in…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Jun Wang , Chengfeng Zhou , Zhaoyan Ming , Lina Wei , Xudong Jiang , Dahong Qian

In surgical procedures, correct instrument counting is essential. Instance segmentation is a location method that locates not only an object's bounding box but also each pixel's specific details. However, obtaining mask-level annotations is…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Zhen Sun , Huan Xu , Jinlin Wu , Zhen Chen , Zhen Lei , Hongbin Liu

Accurate and efficient tracking of surgical instruments is fundamental for Robot-Assisted Minimally Invasive Surgery. Although vision-based robot pose estimation has enabled markerless calibration without tedious physical setups, reliable…

Robotics · Computer Science 2026-03-16 Hanyang Hu , Zekai Liang , Florian Richter , Michael C. Yip

The surgical usage of Mixed Reality (MR) has received growing attention in areas such as surgical navigation systems, skill assessment, and robot-assisted surgeries. For such applications, pose estimation for hand and surgical instruments…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Rui Wang , Sophokles Ktistakis , Siwei Zhang , Mirko Meboldt , Quentin Lohmeyer

Human pose estimation is a key task in computer vision with various applications such as activity recognition and interactive systems. However, the lack of consistency in the annotated skeletons across different datasets poses challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Muhammad Saif Ullah Khan , Dhavalkumar Limbachiya , Didier Stricker , Muhammad Zeshan Afzal

Accurate segmentation of thin structures is critical for microsurgical scene understanding but remains challenging due to resolution loss, low contrast, and class imbalance. We propose Microsurgery Instrument Segmentation for Robotic…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Tae Kyeong Jeong , Garam Kim , Juyoun Park

Robot-assisted surgery has made great progress with the development of medical imaging and robotics technology. Medical scene understanding can greatly improve surgical performance while the semantic segmentation of the robotic instrument…

Robotics · Computer Science 2023-07-18 Yanjie Xia , Shaochen Wang , Zhen Kan

Machine learning has been widely adopted for medical image analysis in recent years given its promising performance in image segmentation and classification tasks. As a data-driven science, the success of machine learning, in particular…

Computer Vision and Pattern Recognition · Computer Science 2020-07-06 Chengliang Dai , Shuo Wang , Yuanhan Mo , Kaichen Zhou , Elsa Angelini , Yike Guo , Wenjia Bai

Purpose: Registration and segmentation of magnetic resonance (MR) and ultrasound (US) images play an essential role in surgical planning and resection of brain tumors. However, validating these techniques is challenging due to the scarcity…

Robot-assisted surgeries rely on accurate and real-time scene understanding to safely guide surgical instruments. However, segmentation models trained on static datasets face key limitations when deployed in these dynamic and evolving…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Julia Hindel , Ema Mekic , Enamundram Naga Karthik , Rohit Mohan , Daniele Cattaneo , Maria Kalweit , Abhinav Valada

Robot-assisted surgery has made significant progress, with instrument segmentation being a critical factor in surgical intervention quality. It serves as the building block to facilitate surgical robot navigation and surgical education for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Hongqiu Wang , Lei Zhu , Guang Yang , Yike Guo , Shichen Zhang , Bo Xu , Yueming Jin

Understanding a surgical scene is crucial for computer-assisted surgery systems to provide any intelligent assistance functionality. One way of achieving this scene understanding is via scene segmentation, where every pixel of a frame is…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Alexander C. Jenke , Sebastian Bodenstedt , Fiona R. Kolbinger , Marius Distler , Jürgen Weitz , Stefanie Speidel

Masked Image Modeling (MIM) is a promising self-supervised learning approach that enables learning from unlabeled images. Despite its recent success, learning good representations through MIM remains challenging because it requires…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Amir Bar , Florian Bordes , Assaf Shocher , Mahmoud Assran , Pascal Vincent , Nicolas Ballas , Trevor Darrell , Amir Globerson , Yann LeCun

Medical imaging segmentation is a highly active area of research, with deep learning-based methods achieving state-of-the-art results in several benchmarks. However, the lack of standardized tools for training, testing, and evaluating new…

Image and Video Processing · Electrical Eng. & Systems 2024-11-19 Adrian Celaya , Evan Lim , Rachel Glenn , Brayden Mi , Alex Balsells , Dawid Schellingerhout , Tucker Netherton , Caroline Chung , Beatrice Riviere , David Fuentes

Surgical instrument segmentation is recognised as a key enabler in providing advanced surgical assistance and improving computer-assisted interventions. In this work, we propose SegMatch, a semi-supervised learning method to reduce the need…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Meng Wei , Charlie Budd , Luis C. Garcia-Peraza-Herrera , Reuben Dorent , Miaojing Shi , Tom Vercauteren

Precisely locating and segmenting medical instruments in images of minimally invasive surgeries, medical instrument segmentation, is an essential first step for several tasks in medical image processing. However, image degradations, small…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Christian Wilms , Alexander Michael Gerlach , Rüdiger Schmitz , Simone Frintrop

Current deep learning-based approaches for the segmentation of microscopy images heavily rely on large amount of training data with dense annotation, which is highly costly and laborious in practice. Compared to full annotation where the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Shijie Li , Mengwei Ren , Thomas Ach , Guido Gerig

Nucleus instance segmentation from histopathology images suffers from the extremely laborious and expert-dependent annotation of nucleus instances. As a promising solution to this task, annotation-efficient deep learning paradigms have…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Yu Ming , Zihao Wu , Jie Yang , Danyi Li , Yuan Gao , Changxin Gao , Gui-Song Xia , Yuanqing Li , Li Liang , Jin-Gang Yu