English
Related papers

Related papers: SurgiTrack: Fine-Grained Multi-Class Multi-Tool Tr…

200 papers

Significant progress has been achieved in multi-object tracking (MOT) through the evolution of detection and re-identification (ReID) techniques. Despite these advancements, accurately tracking objects in scenarios with homogeneous…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Changcheng Xiao , Qiong Cao , Yujie Zhong , Long Lan , Xiang Zhang , Zhigang Luo , Dacheng Tao

The field of surgical computer vision has undergone considerable breakthroughs in recent years with the rising popularity of deep neural network-based methods. However, standard fully-supervised approaches for training such models require…

Tracking droplets in microfluidics is a challenging task. The difficulty arises in choosing a tool to analyze general microfluidic videos to infer physical quantities. The state-of-the-art object detector algorithm You Only Look Once (YOLO)…

Computer Vision and Pattern Recognition · Computer Science 2023-01-20 Mihir Durve , Sibilla Orsini , Adriano Tiribocchi , Andrea Montessori , Jean-Michel Tucny , Marco Lauricella , Andrea Camposeo , Dario Pisignano , Sauro Succi

Object-centric slot attention is a powerful framework for unsupervised learning of structured and explainable representations that can support reasoning about objects and actions, including in surgical videos. While conventional…

Image and Video Processing · Electrical Eng. & Systems 2026-03-04 Guiqiu Liao , Matjaz Jogan , Marcel Hussing , Kenta Nakahashi , Kazuhiro Yasufuku , Amin Madani , Eric Eaton , Daniel A. Hashimoto

The ability to dynamically extend a model to new data and classes is critical for multiple organ and tumor segmentation. However, due to privacy regulations, accessing previous data and annotations can be problematic in the medical domain.…

Image and Video Processing · Electrical Eng. & Systems 2023-07-24 Yixiao Zhang , Xinyi Li , Huimiao Chen , Alan Yuille , Yaoyao Liu , Zongwei Zhou

Surgical workflow anticipation can give predictions on what steps to conduct or what instruments to use next, which is an essential part of the computer-assisted intervention system for surgery, e.g. workflow reasoning in robotic surgery.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Xiatian Zhang , Noura Al Moubayed , Hubert P. H. Shum

Autonomous surgical procedures, in particular minimal invasive surgeries, are the next frontier for Artificial Intelligence research. However, the existing challenges include precise identification of the human anatomy and the surgical…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Salman Maqbool , Aqsa Riaz , Hasan Sajid , Osman Hasan

Surgical phase recognition is a basic component for different context-aware applications in computer- and robot-assisted surgery. In recent years, several methods for automatic surgical phase recognition have been proposed, showing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Isabel Funke , Dominik Rivoir , Stefanie Speidel

Our previous work classified a taxonomy of suturing gestures during a vesicourethral anastomosis of robotic radical prostatectomy in association with tissue tears and patient outcomes. Herein, we train deep-learning based computer vision…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Francisco Luongo , Ryan Hakim , Jessica H. Nguyen , Animashree Anandkumar , Andrew J Hung

Single particle tracking is essential in many branches of science and technology, from the measurement of biomolecular forces to the study of colloidal crystals. Standard current methods rely on algorithmic approaches: by fine-tuning…

Soft Condensed Matter · Physics 2018-12-07 Saga Helgadottir , Aykut Argun , Giovanni Volpe

Imitation learning (IL) has shown immense promise in enabling autonomous dexterous manipulation, including learning surgical tasks. To fully unlock the potential of IL for surgery, access to clinical datasets is needed, which unfortunately…

Microvascular anatomy is known to be involved in various neurological disorders. However, understanding these disorders is hindered by the lack of imaging modalities capable of capturing the comprehensive three-dimensional vascular network…

Image and Video Processing · Electrical Eng. & Systems 2024-07-02 Etienne Chollet , Yaël Balbastre , Chiara Mauri , Caroline Magnain , Bruce Fischl , Hui Wang

Surgical triplet detection is a critical task in surgical video analysis. However, existing datasets like CholecT50 lack precise spatial bounding box annotations, rendering triplet classification at the image level insufficient for…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yiliang Chen , Zhixi Li , Cheng Xu , Alex Qinyang Liu , Ruize Cui , Xuemiao Xu , Jeremy Yuen-Chun Teoh , Shengfeng He , Jing Qin

Surgical workflow recognition has numerous potential medical applications, such as the automatic indexing of surgical video databases and the optimization of real-time operating room scheduling, among others. As a result, phase recognition…

Computer Vision and Pattern Recognition · Computer Science 2016-05-24 Andru P. Twinanda , Sherif Shehata , Didier Mutter , Jacques Marescaux , Michel de Mathelin , Nicolas Padoy

In robotic surgery, task automation and learning from demonstration combined with human supervision is an emerging trend for many new surgical robot platforms. One such task is automated anastomosis, which requires bimanual needle handling…

Computer Vision and Pattern Recognition · Computer Science 2017-11-10 Yang Hu , Yun Gu , Jie Yang , Guang-Zhong Yang

Minimally invasive image-guided surgery heavily relies on vision. Deep learning models for surgical video analysis could therefore support visual tasks such as assessing the critical view of safety (CVS) in laparoscopic cholecystectomy…

Image and Video Processing · Electrical Eng. & Systems 2021-09-21 Pietro Mascagni , Deepak Alapatt , Alain Garcia , Nariaki Okamoto , Armine Vardazaryan , Guido Costamagna , Bernard Dallemagne , Nicolas Padoy

Surgical guidance can be delivered in various ways. In neurosurgery, spatial guidance and orientation are predominantly achieved through neuronavigation systems that reference pre-operative MRI scans. Recently, there has been growing…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Gary Sarwin , Alessandro Carretta , Victor Staartjes , Matteo Zoli , Diego Mazzatenta , Luca Regli , Carlo Serra , Ender Konukoglu

Although semi-supervised learning has made significant advances in the field of medical image segmentation, fully annotating a volumetric sample slice by slice remains a costly and time-consuming task. Even worse, most of the existing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Ke Yan , Qing Cai , Fan Zhang , Ziyan Cao , Zhi Liu

Accurate segmentation and tracking of relevant elements of the surgical scene is crucial to enable context-aware intraoperative assistance and decision making. Current solutions remain tethered to domain-specific, supervised models that…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Jecia Z. Y. Mao , Francis X Creighton , Russell H Taylor , Manish Sahu

The task of multiple people tracking in monocular videos is challenging because of the numerous difficulties involved: occlusions, varying environments, crowded scenes, camera parameters and motion. In the tracking-by-detection paradigm,…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Maryam Babaee , Ali Athar , Gerhard Rigoll