English
Related papers

Related papers: Speak, Segment, Track, Navigate: An Interactive Sy…

200 papers

In this contribution, a semi-automatic segmentation algorithm for (medical) image analysis is presented. More precise, the approach belongs to the category of interactive contouring algorithms, which provide real-time feedback of the…

Computer Vision and Pattern Recognition · Computer Science 2014-06-10 Jan Egger

Intraoperative navigation in spine surgery demands millimeter-level accuracy. Currently, this is achieved through radiation-intensive intraoperative imaging and bone-anchored markers that are invasive and disrupt surgical workflow.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Lorenzo Pettinari , Sidaty El Hadramy , Michael Wehrli , Philippe C. Cattin , Daniel Studer , Carol C. Hasler , Maria Licci

Understanding surgical instrument-tissue interactions requires not only identifying which instrument performs which action on which anatomical target, but also grounding these interactions spatially within the surgical scene. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Oluwatosin Alabi , Meng Wei , Charlie Budd , Tom Vercauteren , Miaojing Shi

Performing minimal-invasive surgical punctures require guiding a needle toward an intracorporeal clinically-defined target. As this technique does not involve cutting the body open, a visualization system is employed to provide the surgeon…

Unsupervised video-based surgical instrument segmentation has the potential to accelerate the adoption of robot-assisted procedures by reducing the reliance on manual annotations. However, the generally low quality of optical flow in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Yang Liu , Peiran Wu , Jiayu Huo , Gongyu Zhang , Zhen Yuan , Christos Bergeles , Rachel Sparks , Prokar Dasgupta , Alejandro Granados , Sebastien Ourselin

Automatic surgical instrument segmentation of endoscopic images is a crucial building block of many computer-assistance applications for minimally invasive surgery. So far, state-of-the-art approaches completely rely on the availability of…

Computer Vision and Pattern Recognition · Computer Science 2022-02-17 Luca Sestini , Benoit Rosa , Elena De Momi , Giancarlo Ferrigno , Nicolas Padoy

Recently, open-vocabulary learning has emerged to accomplish segmentation for arbitrary categories of text-based descriptions, which popularizes the segmentation system to more general-purpose application scenarios. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Jie Qin , Jie Wu , Pengxiang Yan , Ming Li , Ren Yuxi , Xuefeng Xiao , Yitong Wang , Rui Wang , Shilei Wen , Xin Pan , Xingang Wang

Accurate neuronavigation is critical for effective transcranial magnetic stimulation (TMS), as stimulation outcomes depend directly on precise coil placement. Existing neuronavigation systems are often costly, complex, and prone to tracking…

Human-Computer Interaction · Computer Science 2026-01-26 Xuyi Hu , Ke Ma , Siwei Liu , Per Ola Kristensson , Stefan Goetz

An accurate detection and tracking of devices such as guiding catheters in live X-ray image acquisitions is an essential prerequisite for endovascular cardiac interventions. This information is leveraged for procedural guidance, e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Saahil Islam , Venkatesh N. Murthy , Dominik Neumann , Badhan Kumar Das , Puneet Sharma , Andreas Maier , Dorin Comaniciu , Florin C. Ghesu

Pixel-wise segmentation of laparoscopic scenes is essential for computer-assisted surgery but difficult to scale due to the high cost of dense annotations. We propose depth-guided surgical scene segmentation (DepSeg), a training-free…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Kunyi Yang , Qingyu Wang , Cheng Yuan , Yutong Ban

Although the preservation of shape continuity and physiological anatomy is a natural assumption in the segmentation of medical images, it is often neglected by deep learning methods that mostly aim for the statistical modeling of input data…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Yousef Yeganeh , Azade Farshad , Goktug Guevercin , Amr Abu-zer , Rui Xiao , Yongjian Tang , Ehsan Adeli , Nassir Navab

Existing methods for instance segmentation in videos typically involve multi-stage pipelines that follow the tracking-by-detection paradigm and model a video clip as a sequence of images. Multiple networks are used to detect objects in…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Ali Athar , Sabarinath Mahadevan , Aljoša Ošep , Laura Leal-Taixé , Bastian Leibe

Accurate tool tracking is essential for the success of computer-assisted intervention. Previous efforts often modeled tool trajectories rigidly, overlooking the dynamic nature of surgical procedures, especially tracking scenarios like…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Chinedu Innocent Nwoye , Nicolas Padoy

Augmented reality (AR) devices with head mounted displays (HMDs) facilitate the direct superimposition of 3D preoperative imaging data onto the patient during surgery. To use an HMD-AR device as a stand-alone surgical navigation system, the…

Spannotation is an open source user-friendly tool developed for image annotation for semantic segmentation specifically in autonomous navigation tasks. This study provides an evaluation of Spannotation, demonstrating its effectiveness in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Samuel O. Folorunsho , William R. Norris

The use of Augmented Reality (AR) for navigation purposes has shown beneficial in assisting physicians during the performance of surgical procedures. These applications commonly require knowing the pose of surgical tools and patients to…

While foundation models have advanced surgical video analysis, current approaches rely predominantly on pixel-level reconstruction objectives that waste model capacity on low-level visual details, such as smoke, specular reflections, and…

Segmentation of anatomical structures and pathological regions in medical images is essential for modern clinical diagnosis, disease research, and treatment planning. While significant advancements have been made in deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Taha Koleilat , Hojat Asgariandehkordi , Hassan Rivaz , Yiming Xiao

In modern video coding standards, block-based inter prediction is widely adopted, which brings high compression efficiency. However, in natural videos, there are usually multiple moving objects of arbitrary shapes, resulting in complex…

Image and Video Processing · Electrical Eng. & Systems 2024-09-13 Zhuoyuan Li , Zikun Yuan , Li Li , Dong Liu , Xiaohu Tang , Feng Wu

Automatic vessel segmentation is paramount for developing next-generation interventional navigation systems. However, current approaches suffer from suboptimal segmentation performances due to significant challenges in intraoperative images…

Image and Video Processing · Electrical Eng. & Systems 2024-07-01 De-Xing Huang , Xiao-Hu Zhou , Xiao-Liang Xie , Shi-Qi Liu , Shuang-Yi Wang , Zhen-Qiu Feng , Mei-Jiang Gui , Hao Li , Tian-Yu Xiang , Bo-Xian Yao , Zeng-Guang Hou