中文
相关论文

相关论文: SurgiTrack: Fine-Grained Multi-Class Multi-Tool Tr…

200 篇论文

We introduce a speech-guided embodied agent framework for video-guided skull base surgery that dynamically executes perception and image-guidance tasks in response to surgeon queries. The proposed system integrates natural language…

计算机视觉与模式识别 · 计算机科学 2026-04-17 Jecia Z. Y. Mao , Francis X. Creighton , Russell H. Taylor , Manish Sahu

Video microscopy has a long history of providing insights and breakthroughs for a broad range of disciplines, from physics to biology. Image analysis to extract quantitative information from video microscopy data has traditionally relied on…

图像与视频处理 · 电气工程与系统科学 2024-06-12 Benjamin Midtvedt , Saga Helgadottir , Aykut Argun , Jesús Pineda , Daniel Midtvedt , Giovanni Volpe

Over the past few years, surgical data science has attracted substantial interest from the machine learning (ML) community. Various studies have demonstrated the efficacy of emerging ML techniques in analysing surgical data, particularly…

图像与视频处理 · 电气工程与系统科学 2023-07-06 Adnan Qayyum , Hassan Ali , Massimo Caputo , Hunaid Vohra , Taofeek Akinosho , Sofiat Abioye , Ilhem Berrou , Paweł Capik , Junaid Qadir , Muhammad Bilal

Device tracking is an important prerequisite for guidance during endovascular procedures. Especially during cardiac interventions, detection and tracking of guiding the catheter tip in 2D fluoroscopic images is important for applications…

计算机视觉与模式识别 · 计算机科学 2023-07-18 Marc Demoustier , Yue Zhang , Venkatesh Narasimha Murthy , Florin C. Ghesu , Dorin Comaniciu

Accurate segmentation of surgical instrument tip is an important task for enabling downstream applications in robotic surgery, such as surgical skill assessment, tool-tissue interaction and deformation modeling, as well as surgical…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Jiaqi Liu , Yonghao Long , Kai Chen , Cheuk Hei Leung , Zerui Wang , Qi Dou

Automated detection and segmentation of surgical devices, such as catheters or wires, in X-ray fluoroscopic images have the potential to enhance image guidance in minimally invasive heart surgeries. In this paper, we present a convolutional…

计算机视觉与模式识别 · 计算机科学 2025-03-05 Lin Xi , Yingliang Ma , Ethan Koland , Sandra Howell , Aldo Rinaldi , Kawal S. Rhode

Recognition of surgical activity is an essential component to develop context-aware decision support for the operating room. In this work, we tackle the recognition of fine-grained activities, modeled as action triplets <instrument, verb,…

图像与视频处理 · 电气工程与系统科学 2022-04-04 Chinedu Innocent Nwoye , Cristians Gonzalez , Tong Yu , Pietro Mascagni , Didier Mutter , Jacques Marescaux , Nicolas Padoy

Tracking tumor lesions across serial CT scans is essential for oncological response assessment. Existing automated methods face a fundamental trade-off: end-to-end trackers achieve high automation but offer no opportunity to correct silent…

Instructional cataract surgery videos are crucial for ophthalmologists and trainees to observe surgical details repeatedly. This paper presents a deep learning model for real-time identification of surgical instruments in these videos,…

计算机视觉与模式识别 · 计算机科学 2025-01-07 Sanya Sinha , Michal Balazia , Francois Bremond

Understanding the intricate workflows of cataract surgery requires modeling complex interactions between surgical tools, anatomical structures, and procedural techniques. Existing datasets primarily address isolated aspects of surgical…

计算机视觉与模式识别 · 计算机科学 2025-06-30 Felix Holm , Gözde Ünver , Ghazal Ghazaei , Nassir Navab

Real-time tool segmentation from endoscopic videos is an essential part of many computer-assisted robotic surgical systems and of critical importance in robotic surgical data science. We propose two novel deep learning architectures for…

In laparoscopic and robotic surgery, precise tool instance segmentation is an essential technology for advanced computer-assisted interventions. Although publicly available procedures of routine surgeries exist, they often lack…

计算机视觉与模式识别 · 计算机科学 2025-06-05 Oluwatosin Alabi , Ko Ko Zayar Toe , Zijian Zhou , Charlie Budd , Nicholas Raison , Miaojing Shi , Tom Vercauteren

Recognizing various surgical tools, actions and phases from surgery videos is an important problem in computer vision with exciting clinical applications. Existing deep-learning-based methods for this problem either process each surgical…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Haifeng Wang , Hao Xu , Jun Wang , Jian Zhou , Ke Deng

Improved surgical skill is generally associated with improved patient outcomes, although assessment is subjective; labour-intensive; and requires domain specific expertise. Automated data driven metrics can alleviate these difficulties, as…

The precise tracking and segmentation of surgical instruments have led to a remarkable enhancement in the efficiency of surgical procedures. However, the challenge lies in achieving accurate segmentation of surgical instruments while…

图像与视频处理 · 电气工程与系统科学 2024-08-09 Jieming Yu , Long Bai , Guankun Wang , An Wang , Xiaoxiao Yang , Huxin Gao , Hongliang Ren

Surgical scene segmentation is critical in computer-assisted surgery and is vital for enhancing surgical quality and patient outcomes. Recently, referring surgical segmentation is emerging, given its advantage of providing surgeons with an…

计算机视觉与模式识别 · 计算机科学 2025-05-14 Haofeng Liu , Mingqi Gao , Xuxiao Luo , Ziyue Wang , Guanyi Qin , Junde Wu , Yueming Jin

Purpose: In conventional fluoroscopy-guided interventions, the 2D projective nature of X-ray imaging limits depth perception and leads to prolonged radiation exposure. Virtual fluoroscopy, combined with spatially tracked surgical…

图像与视频处理 · 电气工程与系统科学 2025-05-22 Shuwei Xing , Inaara Ahmed-Fazal , Utsav Pardasani , Uditha Jayarathne , Scott Illsley , Aaron Fenster , Terry M. Peters , Elvis C. S. Chen

Surgical action triplets describe instrument-tissue interactions as (instrument, verb, target) combinations, thereby supporting a detailed analysis of surgical scene activities and workflow. This work focuses on surgical action triplet…

计算机视觉与模式识别 · 计算机科学 2023-07-20 Saurav Sharma , Chinedu Innocent Nwoye , Didier Mutter , Nicolas Padoy

In surgical training for medical students, proficiency development relies on expert-led skill assessment, which is costly, time-limited, difficult to scale, and its expertise remains confined to institutions with available specialists.…

计算机视觉与模式识别 · 计算机科学 2026-03-30 Le Ma , Thiago Freitas dos Santos , Nadia Magnenat-Thalmann , Katarzyna Wac