English
Related papers

Related papers: Real-time Instance Segmentation of Surgical Instru…

200 papers

Instance segmentation of biological images is essential for studying object behaviors and properties. The challenges, such as clustering, occlusion, and adhesion problems of the objects, make instance segmentation a non-trivial task.…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Jingru Yi , Hui Tang , Pengxiang Wu , Bo Liu , Daniel J. Hoeppner , Dimitris N. Metaxas , Lianyi Han , Wei Fan

Automotive radar provides reliable environmental perception in all-weather conditions with affordable cost, but it hardly supplies semantic and geometry information due to the sparsity of radar detection points. With the development of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Jianan Liu , Weiyi Xiong , Liping Bai , Yuxuan Xia , Tao Huang , Wanli Ouyang , Bing Zhu

This paper addresses category-agnostic instance segmentation for robotic manipulation, focusing on segmenting objects independent of their class to enable versatile applications like bin-picking in dynamic environments. Existing methods…

Robotics · Computer Science 2023-12-29 Prem Raj , Sachin Bhadang , Gaurav Chaudhary , Laxmidhar Behera , Tushar Sandhan

Automated tracking of surgical tool keypoints in robotic surgery videos is an essential task for various downstream use cases such as skill assessment, expertise assessment, and the delineation of safety zones. In recent years, the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-31 Bhargav Ghanekar , Lianne R. Johnson , Jacob L. Laughlin , Marcia K. O'Malley , Ashok Veeraraghavan

Segment Anything Model (SAM) has emerged as a transformative approach in image segmentation, acclaimed for its robust zero-shot segmentation capabilities and flexible prompting system. Nonetheless, its performance is challenged by images…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Wei-Ting Chen , Yu-Jiet Vong , Sy-Yen Kuo , Sizhuo Ma , Jian Wang

Enabled by large annotated datasets, tracking and segmentation of objects in videos has made remarkable progress in recent years. Despite these advancements, algorithms still struggle under degraded conditions and during fast movements.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Friedhelm Hamann , Hanxiong Li , Paul Mieske , Lars Lewejohann , Guillermo Gallego

Breast ultrasound imaging is a valuable tool for early breast cancer detection, but automated tumor segmentation is challenging due to inherent noise, variations in scale of lesions, and fuzzy boundaries. To address these challenges, we…

Image and Video Processing · Electrical Eng. & Systems 2025-06-23 Muhammad Azeem Aslam , Asim Naveed , Nisar Ahmed

Placenta volume measured from 3D ultrasound (3DUS) images is an important tool for tracking the growth trajectory and is associated with pregnancy outcomes. Manual segmentation is the gold standard, but it is time-consuming and subjective.…

Image and Video Processing · Electrical Eng. & Systems 2024-08-13 Hao Li , Baris Oguz , Gabriel Arenas , Xing Yao , Jiacheng Wang , Alison Pouch , Brett Byram , Nadav Schwartz , Ipek Oguz

Accurate segmentation of tissues and instruments in surgical scenes is annotation-intensive due to irregular shapes, thin structures, specularities, and frequent occlusions. While SAM models support point, box, and mask prompts, points are…

Image and Video Processing · Electrical Eng. & Systems 2026-03-20 Haonan Ping , Jian Jiang , Cheng Yuan , Qizhen Sun , Lv Wu , Yutong Ban

Current state-of-the-art instance segmentation methods are not suited for real-time applications like autonomous driving, which require fast execution times at high accuracy. Although the currently dominant proposal-based methods have high…

Computer Vision and Pattern Recognition · Computer Science 2019-08-05 Davy Neven , Bert De Brabandere , Marc Proesmans , Luc Van Gool

In this work, we aim at building a simple, direct, and fast instance segmentation framework with strong performance. We follow the principle of the SOLO method of Wang et al. "SOLO: segmenting objects by locations". Importantly, we take one…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Xinlong Wang , Rufeng Zhang , Tao Kong , Lei Li , Chunhua Shen

An accurate detection and tracking of devices such as guiding catheters in live X-ray image acquisitions is an essential prerequisite for endovascular cardiac interventions. This information is leveraged for procedural guidance, e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Saahil Islam , Venkatesh N. Murthy , Dominik Neumann , Badhan Kumar Das , Puneet Sharma , Andreas Maier , Dorin Comaniciu , Florin C. Ghesu

Medical image segmentation continues to advance rapidly, yet rigorous comparison between methods remains challenging due to a lack of standardized and customizable tooling. In this work, we present the current state of the Medical Imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Adrian Celaya , Tucker Netherton , Dawid Schellingerhout , Caroline Chung , Beatrice Riviere , David Fuentes

Segmentations are crucial in medical imaging to obtain morphological, volumetric, and radiomics biomarkers. Manual segmentation is accurate but not feasible in the radiologist's clinical workflow, while automatic segmentation generally…

We present a robotic system for picking a target from a pile of objects that is capable of finding and grasping the target object by removing obstacles in the appropriate order. The fundamental idea is to segment instances with both visible…

Robotics · Computer Science 2020-01-22 Kentaro Wada , Shingo Kitagawa , Kei Okada , Masayuki Inaba

Weakly supervised instance segmentation reduces the cost of annotations required to train models. However, existing approaches which rely only on image-level class labels predominantly suffer from errors due to (a) partial segmentation of…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Qing Liu , Vignesh Ramanathan , Dhruv Mahajan , Alan Yuille , Zhenheng Yang

Surgical instrument segmentation is a key component in developing context-aware operating rooms. Existing works on this task heavily rely on the supervision of a large amount of labeled data, which involve laborious and expensive human…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Daochang Liu , Yuhui Wei , Tingting Jiang , Yizhou Wang , Rulin Miao , Fei Shan , Ziyu Li

The Segment Anything Model (SAM) is a powerful foundation model that has revolutionised image segmentation. To apply SAM to surgical instrument segmentation, a common approach is to locate precise points or boxes of instruments and then use…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Wenxi Yue , Jing Zhang , Kun Hu , Yong Xia , Jiebo Luo , Zhiyong Wang

Unsupervised video-based surgical instrument segmentation has the potential to accelerate the adoption of robot-assisted procedures by reducing the reliance on manual annotations. However, the generally low quality of optical flow in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Yang Liu , Peiran Wu , Jiayu Huo , Gongyu Zhang , Zhen Yuan , Christos Bergeles , Rachel Sparks , Prokar Dasgupta , Alejandro Granados , Sebastien Ourselin

Cell instance segmentation is a new and challenging task aiming at joint detection and segmentation of every cell in an image. Recently, many instance segmentation methods have applied in this task. Despite their great success, there still…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Menghao Li , Wenquan Feng , Shuchang Lyu , Lijiang Chen , Qi Zhao