English
Related papers

Related papers: Know your sensORs -- A Modality Study For Surgical…

200 papers

Action recognition is a prerequisite for many applications in laparoscopic video analysis including but not limited to surgical training, operation room planning, follow-up surgery preparation, post-operative surgical assessment, and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Sahar Nasirihaghighi , Negin Ghamsarian , Daniela Stefanics , Klaus Schoeffmann , Heinrich Husslein

Videos are prominent learning materials to prepare surgical trainees before they enter the operating room (OR). In this work, we explore techniques to enrich the video-based surgery learning experience. We propose Surgment, a system that…

Human-Computer Interaction · Computer Science 2024-06-27 Jingying Wang , Haoran Tang , Taylor Kantor , Tandis Soltani , Vitaliy Popov , Xu Wang

Accurate identification and localization of anatomical structures of varying size and appearance in laparoscopic imaging are necessary to leverage the potential of computer vision techniques for surgical decision support. Segmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Fiona R. Kolbinger , Jiangpeng He , Jinge Ma , Fengqing Zhu

Modeling and recognition of surgical activities poses an interesting research problem. Although a number of recent works studied automatic recognition of surgical activities, generalizability of these works across different tasks and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-17 Duygu Sarikaya , Pierre Jannin

Image registration plays an important role in medical image analysis. Conventional optimization based methods provide an accurate estimation due to the iterative process at the cost of expensive computation. Deep learning methods such as…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Junshen Xu , Eric Z. Chen , Xiao Chen , Terrence Chen , Shanhui Sun

Interactive segmentation is a promising strategy for building robust, generalisable algorithms for volumetric medical image segmentation. However, inconsistent and clinically unrealistic evaluation hinders fair comparison and misrepresents…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Parhom Esmaeili , Virginia Fernandez , Pedro Borges , Eli Gibson , Sebastien Ourselin , M. Jorge Cardoso

Purpose: The objective of this investigation is to provide a comprehensive analysis of state-of-the-art methods for video-based assessment of surgical skill in the operating room. Methods: Using a data set of 99 videos of capsulorhexis, a…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Sanchit Hira , Digvijay Singh , Tae Soo Kim , Shobhit Gupta , Gregory Hager , Shameema Sikder , S. Swaroop Vedula

Magnetic resonance (MR) protocols rely on several sequences to assess pathology and organ status properly. Despite advances in image analysis, we tend to treat each sequence, here termed modality, in isolation. Taking advantage of the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Agisilaos Chartsias , Giorgos Papanastasiou , Chengjia Wang , Scott Semple , David E. Newby , Rohan Dharmakumar , Sotirios A. Tsaftaris

When technical requirements are high, and patient outcomes are critical, opportunities for monitoring and improving surgical skills via objective motion analysis feedback may be particularly beneficial. This narrative review synthesises…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Merryn D. Constable , Hubert P. H. Shum , Stephen Clark

Human action recognition is used in many applications such as video surveillance, human computer interaction, assistive living, and gaming. Many papers have appeared in the literature showing that the fusion of vision and inertial sensing…

Human-Computer Interaction · Computer Science 2020-08-04 Sharmin Majumder , Nasser Kehtarnavaz

Purpose: Surgical performance depends not only on surgeons' technical skills but also on team communication within and across the different professional groups present during the operation. Therefore, automatically identifying team…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Keqi Chen , Lilien Schewski , Vinkle Srivastav , Joël Lavanchy , Didier Mutter , Guido Beldi , Sandra Keller , Nicolas Padoy

State-of-the-art research of traditional computer vision is increasingly leveraged in the surgical domain. A particular focus in computer-assisted surgery is to replace marker-based tracking systems for instrument localization with pure…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Jonas Hein , Nicola Cavalcanti , Daniel Suter , Lukas Zingg , Fabio Carrillo , Lilian Calvet , Mazda Farshad , Marc Pollefeys , Nassir Navab , Philipp Fürnstahl

Operating rooms (ORs) are cluttered, dynamic, highly occluded environments, where reliable spatial understanding is essential for situational awareness during complex surgical workflows. Achieving spatial understanding for panoptic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Tuna Gürbüz , Ege Özsoy , Tony Danjun Wang , Nassir Navab

In a human-centered intelligent manufacturing system, sensing and understanding of the worker's activity are the primary tasks. In this paper, we propose a novel multi-modal approach for worker activity recognition by leveraging information…

Computer Vision and Pattern Recognition · Computer Science 2019-08-22 Wenjin Tao , Ming C. Leu , Zhaozheng Yin

Segmenting and recognizing surgical operation trajectories into distinct, meaningful gestures is a critical preliminary step in surgical workflow analysis for robot-assisted surgery. This step is necessary for facilitating learning from…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Zhili Yuan , Jialin Lin , Dandan Zhang

Recent advances in data analytics and computer-aided diagnostics stimulate the vision of patient-centric precision healthcare, where treatment plans are customized based on the health records and needs of every patient. In physical…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Yalin Liao , Aleksandar Vakanski , Min Xian , David Paul , Russell Baker

Laparoscopic Surgery (LS) is a modern surgical technique whereby the surgery is performed through an incision with tools and camera as opposed to conventional open surgery. This promises minimal recovery times and less hemorrhaging. Multi…

Human-Computer Interaction · Computer Science 2017-12-04 Navaneeth Kamballur Kottayil , Rositsa Bogdanova , Irene Cheng , Anup Basu , Bin Zheng

The development of effective training and evaluation strategies is critical. Conventional methods for assessing surgical proficiency typically rely on expert supervision, either through onsite observation or retrospective analysis of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Yan Meng , Daniel A. Donoho , Marcelle Altshuler , Omar Arnaout

The amount of surgical data, recorded during video-monitored surgeries, has extremely increased. This paper aims at improving existing solutions for the automated analysis of cataract surgeries in real time. Through the analysis of a video…

Computer Vision and Pattern Recognition · Computer Science 2016-09-20 Hassan Al Hajj , Gwenolé Quellec , Mathieu Lamard , Guy Cazuguel , Béatrice Cochener

This paper strives for action recognition and detection in video modalities like RGB, depth maps or 3D-skeleton sequences when only limited modality-specific labeled examples are available. For the RGB, and derived optical-flow, modality…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Fida Mohammad Thoker , Cees G. M. Snoek