English
Related papers

Related papers: ESAD: Endoscopic Surgeon Action Detection Dataset

200 papers

The amount of surgical data, recorded during video-monitored surgeries, has extremely increased. This paper aims at improving existing solutions for the automated analysis of cataract surgeries in real time. Through the analysis of a video…

Computer Vision and Pattern Recognition · Computer Science 2016-09-20 Hassan Al Hajj , Gwenolé Quellec , Mathieu Lamard , Guy Cazuguel , Béatrice Cochener

Visual-based human action recognition can be found in various application fields, e.g., surveillance systems, sports analytics, medical assistive technologies, or human-robot interaction frameworks, and it concerns the identification and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Antonios Gasteratos , Stavros N. Moutsis , Konstantinos A. Tsintotas , Yiannis Aloimonos

Robot-assisted minimally invasive surgery is improving surgeon performance and patient outcomes. This innovation is also turning what has been a subjective practice into motion sequences that can be precisely measured. A growing number of…

Computer Vision and Pattern Recognition · Computer Science 2020-06-12 Neil Getty , Zixuan Zhao , Stephan Gruessner , Liaohai Chen , Fangfang Xia

Surgical robotics is a rising field in medical technology and advanced robotics. Robot assisted surgery, or robotic surgery, allows surgeons to perform complicated surgical tasks with more precision, automation, and flexibility than is…

Robotics · Computer Science 2023-11-02 A. E. Abdelaal , S. N. Zaman , P. Y Chen , T. Suzuki , J. Ingleton

In surgical training for medical students, proficiency development relies on expert-led skill assessment, which is costly, time-limited, difficult to scale, and its expertise remains confined to institutions with available specialists.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Le Ma , Thiago Freitas dos Santos , Nadia Magnenat-Thalmann , Katarzyna Wac

Background Analyzing kinematic and video data can help identify potentially erroneous motions that lead to sub-optimal surgeon performance and safety-critical events in robot-assisted surgery. Methods We develop a rubric for identifying…

Robotics · Computer Science 2023-01-20 Kay Hutchinson , Zongyu Li , Leigh A. Cantrell , Noah S. Schenkman , Homa Alemzadeh

Automated endoscopy video analysis is a challenging task in medical computer vision, with the primary objective of assisting surgeons during procedures. The difficulty arises from the complexity of surgical scenes and the lack of a…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Dominik Batić , Felix Holm , Ege Özsoy , Tobias Czempiel , Nassir Navab

Surgical gesture recognition is important for surgical data science and computer-aided intervention. Even with robotic kinematic information, automatically segmenting surgical steps presents numerous challenges because surgical…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 Beatrice van Amsterdam , Matthew J. Clarkson , Danail Stoyanov

The surgical operating room (OR) presents many opportunities for automation and optimization. Videos from various sources in the OR are becoming increasingly available. The medical community seeks to leverage this wealth of data to develop…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Lennart Bastian , Tobias Czempiel , Christian Heiliger , Konrad Karcz , Ulrich Eck , Benjamin Busam , Nassir Navab

The prospect of using autonomous robots to enhance the capabilities of physicians and enable novel procedures has led to considerable efforts in developing medical robots and incorporating autonomous capabilities. Motion planning is a core…

Robotics · Computer Science 2022-10-21 Inbar Fried , Jason A. Akulian , Ron Alterovitz

Endoscopic surgery is the gold standard for robotic-assisted minimally invasive surgery, offering significant advantages in early disease detection and precise interventions. However, the complexity of surgical scenes, characterized by high…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Guankun Wang , Rui Tang , Mengya Xu , Long Bai , Huxin Gao , Hongliang Ren

Purpose: A profound education of novice surgeons is crucial to ensure that surgical interventions are effective and safe. One important aspect is the teaching of technical skills for minimally invasive or robot-assisted procedures. This…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Isabel Funke , Sören Torge Mees , Jürgen Weitz , Stefanie Speidel

Salient human detection (SHD) in dynamic 360{\deg} immersive videos is of great importance for various applications such as robotics, inter-human and human-object interaction in augmented reality. However, 360{\deg} video SHD has been…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Yi Zhang , Lu Zhang , Kang Wang , Wassim Hamidouche , Olivier Deforges

Action recognition is a fundamental capability for humanoid robots to interact and cooperate with humans. This application requires the action recognition system to be designed so that new actions can be easily added, while unknown actions…

Robotics · Computer Science 2025-09-16 Stefano Berti , Andrea Rosasco , Michele Colledanchise , Lorenzo Natale

Automatic surgical gesture recognition is fundamental for improving intelligence in robot-assisted surgery, such as conducting complicated tasks of surgery surveillance and skill evaluation. However, current methods treat each frame…

Artificial Intelligence · Computer Science 2020-02-21 Xiaojie Gao , Yueming Jin , Qi Dou , Pheng-Ann Heng

Automatic surgical activity recognition enables more intelligent surgical devices and a more efficient workflow. Integration of such technology in new operating rooms has the potential to improve care delivery to patients and decrease…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Ali Mottaghi , Aidean Sharghi , Serena Yeung , Omid Mohareri

As labor shortage increases in the health sector, the demand for assistive robotics grows. However, the needed test data to develop those robots is scarce, especially for the application of active 3D object detection, where no real data…

Owing to recent advances in machine learning and the ability to harvest large amounts of data during robotic-assisted surgeries, surgical data science is ripe for foundational work. We present a large dataset of surgical videos and their…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Aneeq Zia , Max Berniker , Rogerio Nespolo , Xiaorui Zhang , Conor Perreault , Ziheng Wang , Benjamin Mueller , Ryan Schmidt , Kiran Bhattacharyya , Xi Liu , Anthony Jarc

We propose a novel shape-aware relation network for accurate and real-time landmark detection in endoscopic submucosal dissection (ESD) surgery. This task is of great clinical significance but extremely challenging due to bleeding, lighting…

Image and Video Processing · Electrical Eng. & Systems 2021-11-10 Jiacheng Wang , Yueming Jin , Shuntian Cai , Hongzhi Xu , Pheng-Ann Heng , Jing Qin , Liansheng Wang

Video action recognition is one of the representative tasks for video understanding. Over the last decade, we have witnessed great advancements in video action recognition thanks to the emergence of deep learning. But we also encountered…

Computer Vision and Pattern Recognition · Computer Science 2020-12-14 Yi Zhu , Xinyu Li , Chunhui Liu , Mohammadreza Zolfaghari , Yuanjun Xiong , Chongruo Wu , Zhi Zhang , Joseph Tighe , R. Manmatha , Mu Li