English
Related papers

Related papers: LRTD: Long-Range Temporal Dependency based Active …

200 papers

Surgical workflow analysis is essential in robot-assisted surgeries, yet the long duration of such procedures poses significant challenges for comprehensive video analysis. Recent approaches have predominantly relied on transformer models;…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Haoyang Wu , Tsun-Hsuan Wang , Mathias Lechner , Ramin Hasani , Jennifer A. Eckhoff , Paul Pak , Ozanan R. Meireles , Guy Rosman , Yutong Ban , Daniela Rus

Computer-assisted surgery research requires large, deeply annotated video datasets that capture clinical and technical variability. Existing cataract surgery resources lack the diversity and annotation depth required to train generalizable…

Active learning (AL) can reduce annotation costs in surgical video analysis while maintaining model performance. However, traditional AL methods, developed for images or short video clips, are suboptimal for surgical step recognition due to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Nisarg A. Shah , Bardia Safaei , Shameema Sikder , S. Swaroop Vedula , Vishal M. Patel

In order to provide the right type of assistance at the right time, computer-assisted surgery systems need context awareness. To achieve this, methods for surgical workflow analysis are crucial. Currently, convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2018-10-05 Isabel Funke , Alexander Jenke , Sören Torge Mees , Jürgen Weitz , Stefanie Speidel , Sebastian Bodenstedt

In minimally invasive surgery, surgical workflow segmentation from video analysis is a well studied topic. The conventional approach defines it as a multi-class classification problem, where individual video frames are attributed a surgical…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Yitong Zhang , Sophia Bano , Ann-Sophie Page , Jan Deprest , Danail Stoyanov , Francisco Vasconcelos

Action recognition is a prerequisite for many applications in laparoscopic video analysis including but not limited to surgical training, operation room planning, follow-up surgery preparation, post-operative surgical assessment, and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Sahar Nasirihaghighi , Negin Ghamsarian , Daniela Stefanics , Klaus Schoeffmann , Heinrich Husslein

Phase recognition plays an essential role for surgical workflow analysis in computer assisted intervention. Transformer, originally proposed for sequential data modeling in natural language processing, has been successfully applied to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Xiaoyang Zou , Wenyong Liu , Junchen Wang , Rong Tao , Guoyan Zheng

Surgical tool localization is an essential task for the automatic analysis of endoscopic videos. In the literature, existing methods for tool localization, tracking and segmentation require training data that is fully annotated, thereby…

Computer Vision and Pattern Recognition · Computer Science 2018-07-19 Armine Vardazaryan , Didier Mutter , Jacques Marescaux , Nicolas Padoy

Activity recognition in surgical videos is a key research area for developing next-generation devices and workflow monitoring systems. Since surgeries are long processes with highly-variable lengths, deep learning models used for surgical…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Zhuohong He , Ali Mottaghi , Aidean Sharghi , Muhammad Abdullah Jamal , Omid Mohareri

Surgical workflow recognition has numerous potential medical applications, such as the automatic indexing of surgical video databases and the optimization of real-time operating room scheduling, among others. As a result, phase recognition…

Computer Vision and Pattern Recognition · Computer Science 2016-05-24 Andru P. Twinanda , Sherif Shehata , Didier Mutter , Jacques Marescaux , Michel de Mathelin , Nicolas Padoy

Automatic recognition of fine-grained surgical activities, called steps, is a challenging but crucial task for intelligent intra-operative computer assistance. The development of current vision-based activity recognition methods relies…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Sanat Ramesh , Diego Dall'Alba , Cristians Gonzalez , Tong Yu , Pietro Mascagni , Didier Mutter , Jacques Marescaux , Paolo Fiorini , Nicolas Padoy

We propose a new multilabel classifier, called LapTool-Net to detect the presence of surgical tools in each frame of a laparoscopic video. The novelty of LapTool-Net is the exploitation of the correlation among the usage of different tools…

Computer Vision and Pattern Recognition · Computer Science 2019-05-23 Babak Namazi , Ganesh Sankaranarayanan , Venkat Devarajan

Most recent approaches for action recognition from video leverage deep architectures to encode the video clip into a fixed length representation vector that is then used for classification. For this to be successful, the network must be…

Computer Vision and Pattern Recognition · Computer Science 2018-08-30 Swathikiran Sudhakaran , Oswald Lanz

Deep convolution neural networks (CNN) have demonstrated advanced performance on single-label image classification, and various progress also have been made to apply CNN methods on multi-label image classification, which requires to…

Computer Vision and Pattern Recognition · Computer Science 2017-03-14 Junjie Zhang , Qi Wu , Chunhua Shen , Jian Zhang , Jianfeng Lu

Objective: To enable context-aware computer assistance in the operating room of the future, cognitive systems need to understand automatically which surgical phase is being performed by the medical team. The primary source of information…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Isabel Funke , Dominik Rivoir , Stefanie Krell , Stefanie Speidel

Deep neural networks based methods have been proved to achieve outstanding performance on object detection and classification tasks. Despite significant performance improvement, due to the deep structures, they still require prohibitive…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Mohammad Farhadi , Yezhou Yang

This thesis explore different approaches using Convolutional and Recurrent Neural Networks to classify and temporally localize activities on videos, furthermore an implementation to achieve it has been proposed. As the first step, features…

Computer Vision and Pattern Recognition · Computer Science 2017-03-06 Alberto Montes , Amaia Salvador , Santiago Pascual , Xavier Giro-i-Nieto

The recent success in deep learning has lead to various effective representation learning methods for videos. However, the current approaches for video representation require large amount of human labeled datasets for effective learning. We…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Shruti Vyas , Yogesh S Rawat , Mubarak Shah

Purpose: The objective of this investigation is to provide a comprehensive analysis of state-of-the-art methods for video-based assessment of surgical skill in the operating room. Methods: Using a data set of 99 videos of capsulorhexis, a…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Sanchit Hira , Digvijay Singh , Tae Soo Kim , Shobhit Gupta , Gregory Hager , Shameema Sikder , S. Swaroop Vedula

Recognizing the phases of a laparoscopic surgery (LS) operation form its video constitutes a fundamental step for efficient content representation, indexing and retrieval in surgical video databases. In the literature, most techniques focus…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Constantinos Loukas