English
Related papers

Related papers: MURPHY: Relations Matter in Surgical Workflow Anal…

200 papers

Surgical scene perception via videos is critical for advancing robotic surgery, telesurgery, and AI-assisted surgery, particularly in ophthalmology. However, the scarcity of diverse and richly annotated video datasets has hindered the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Ming Hu , Peng Xia , Lin Wang , Siyuan Yan , Feilong Tang , Zhongxing Xu , Yimin Luo , Kaimin Song , Jurgen Leitner , Xuelian Cheng , Jun Cheng , Chi Liu , Kaijing Zhou , Zongyuan Ge

Purpose: Surgery scene understanding with tool-tissue interaction recognition and automatic report generation can play an important role in intra-operative guidance, decision-making and postoperative analysis in robotic surgery. However,…

Artificial Intelligence · Computer Science 2022-11-29 Lalithkumar Seenivasan , Mobarakol Islam , Mengya Xu , Chwee Ming Lim , Hongliang Ren

This data article presents a dataset of 11,884 labeled images documenting a simulated blood extraction (phlebotomy) procedure performed on a training arm. Images were extracted from high-definition videos recorded under controlled…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Raúl Jiménez Cruz , César Torres-Huitzil , Marco Franceschetti , Ronny Seiger , Luciano García-Bañuelos , Barbara Weber

Biological relation networks contain rich information for understanding the biological mechanisms behind the relationship of entities such as genes, proteins, diseases, and chemicals. The vast growth of biomedical literature poses…

Computation and Language · Computer Science 2025-01-27 Po-Ting Lai , Chih-Hsuan Wei , Shubo Tian , Robert Leaman , Zhiyong Lu

Legacy scientific workflows, and the services within them, often present scarce and unstructured (i.e. textual) descriptions. This makes it difficult to find, share and reuse them, thus dramatically reducing their value to the community.…

Information Retrieval · Computer Science 2014-07-02 Beatriz García-Jiménez , Mark D. Wilkinson

Current deep learning paradigms largely benefit from the tremendous amount of annotated data. However, the quality of the annotations often varies among labelers. Multi-observer studies have been conducted to study these annotation…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Xiaosong Wang , Ziyue Xu , Dong Yang , Leo Tam , Holger Roth , Daguang Xu

This paper proposes a new neural architecture for collaborative ranking with implicit feedback. Our model, LRML (\textit{Latent Relational Metric Learning}) is a novel metric learning approach for recommendation. More specifically, instead…

Artificial Intelligence · Computer Science 2018-02-14 Yi Tay , Anh Tuan Luu , Siu Cheung Hui

Surgical AI often involves multiple tasks within a single procedure, like phase recognition or assessing the Critical View of Safety in laparoscopic cholecystectomy. Traditional models, built for one task at a time, lack flexibility,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Soham Walimbe , Britty Baby , Vinkle Srivastav , Nicolas Padoy

Multimedia applications often require concurrent solutions to multiple tasks. These tasks hold clues to each-others solutions, however as these relations can be complex this remains a rarely utilized property. When task relations are…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Gjorgji Strezoski , Nanne van Noord , Marcel Worring

In line with the latest research, the task of identifying helpful reviews from a vast pool of user-generated textual and visual data has become a prominent area of study. Effective modal representations are expected to possess two key…

Multimedia · Computer Science 2024-03-26 HongLin Gong , Mengzhao Jia , Liqiang Jing

Intra-operative anticipation of instrument usage is a necessary component for context-aware assistance in surgery, e.g. for instrument preparation or semi-automation of robotic tasks. However, the sparsity of instrument occurrences in long…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Dominik Rivoir , Sebastian Bodenstedt , Isabel Funke , Felix von Bechtolsheim , Marius Distler , Jürgen Weitz , Stefanie Speidel

Manual annotation remains the gold standard for high-quality, dense temporal video datasets, yet it is inherently time-consuming. Vision-language models can aid human annotators and expedite this process. We report on the impact of…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Juan Gutiérrez , Victor Gutiérrez , Ángel Mora , Silvia Rodriguez , José Luis Blanco

Out of all existing frameworks for surgical workflow analysis in endoscopic videos, action triplet recognition stands out as the only one aiming to provide truly fine-grained and comprehensive information on surgical activities. This…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Chinedu Innocent Nwoye , Tong Yu , Cristians Gonzalez , Barbara Seeliger , Pietro Mascagni , Didier Mutter , Jacques Marescaux , Nicolas Padoy

Recent research in the field of computer vision strongly focuses on deep learning architectures to tackle image processing problems. Deep neural networks are often considered in complex image processing scenarios since traditional computer…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Marcel P. Schilling , Luca Rettenberger , Friedrich Münke , Haijun Cui , Anna A. Popova , Pavel A. Levkin , Ralf Mikut , Markus Reischl

This report represents a roadmap for integrating Artificial Intelligence (AI)-based image analysis algorithms into existing Radiology workflows such that: (1) radiologists can significantly benefit from enhanced automation in various…

Image and Video Processing · Electrical Eng. & Systems 2019-10-16 Engin Dikici , Matthew Bigelow , Luciano M. Prevedello , Richard D. White , Barbaros Selnur Erdal

Intensive Care Units are complex, data-rich environments where critically ill patients are treated using variety of clinical equipment. The data collected using this equipment can be used clinical staff to gain insight into the condition of…

Human-Computer Interaction · Computer Science 2024-10-23 Marceli Wac , Raul Santos-Rodriguez , Chris McWilliams , Christopher Bourdeaux

Accurate tool tracking is essential for the success of computer-assisted intervention. Previous efforts often modeled tool trajectories rigidly, overlooking the dynamic nature of surgical procedures, especially tracking scenarios like…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Chinedu Innocent Nwoye , Nicolas Padoy

Automatic radiology report generation can alleviate the workload for physicians and minimize regional disparities in medical resources, therefore becoming an important topic in the medical image analysis field. It is a challenging task, as…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Xinyi Wang , Grazziela Figueredo , Ruizhe Li , Wei Emma Zhang , Weitong Chen , Xin Chen

Robot-assisted surgery has revolutionized the healthcare industry by providing surgeons with greater precision, reducing invasiveness, and improving patient outcomes. However, the success of these surgeries depends heavily on the robotic…

Robotics · Computer Science 2025-08-05 Mansi Sharma , Antonio Kruger