English
Related papers

Related papers: Surgical Visual Understanding (SurgVU) Dataset

200 papers

Surgical video understanding is essential for computer-assisted interventions, yet existing surgical foundation models remain constrained by limited data scale, procedural diversity, and inconsistent evaluation, often lacking a reproducible…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Sicheng Lu , Zikai Xiao , Jianhui Wei , Danyu Sun , Qi Lu , Keli Hu , Yang Feng , Jian Wu , Zongxin Yang , Zuozhu Liu

In surgical training for medical students, proficiency development relies on expert-led skill assessment, which is costly, time-limited, difficult to scale, and its expertise remains confined to institutions with available specialists.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Le Ma , Thiago Freitas dos Santos , Nadia Magnenat-Thalmann , Katarzyna Wac

Data scarcity remains a fundamental barrier to achieving fully autonomous surgical robots. While large scale vision language action (VLA) models have shown impressive generalization in household and industrial manipulation by leveraging…

Purpose: Machine learning models can only be reliably evaluated if training, validation, and test data splits are representative and not affected by the absence of classes of interest. Surgical workflow and instrument recognition tasks are…

Machine Learning · Computer Science 2024-02-06 Georgii Kostiuchik , Lalith Sharan , Benedikt Mayer , Ivo Wolf , Bernhard Preim , Sandy Engelhardt

Modern operating room is becoming increasingly complex, requiring innovative intra-operative support systems. While the focus of surgical data science has largely been on video analysis, integrating surgical computer vision with language…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Kun Yuan , Manasi Kattel , Joel L. Lavanchy , Nassir Navab , Vinkle Srivastav , Nicolas Padoy

Minimally invasive surgery is highly operator dependant with a lengthy procedural time causing fatigue to surgeon and risks to patients such as injury to organs, infection, bleeding, and complications of anesthesia. To mitigate such risks,…

Computer Vision and Pattern Recognition · Computer Science 2023-01-16 Mansoor Ali , Rafael Martinez Garcia Pena , Gilberto Ochoa Ruiz , Sharib Ali

Purpose: A profound education of novice surgeons is crucial to ensure that surgical interventions are effective and safe. One important aspect is the teaching of technical skills for minimally invasive or robot-assisted procedures. This…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Isabel Funke , Sören Torge Mees , Jürgen Weitz , Stefanie Speidel

Accurate and robust tracking and reconstruction of the surgical scene is a critical enabling technology toward autonomous robotic surgery. Existing algorithms for 3D perception in surgery mainly rely on geometric information, while we…

Image and Video Processing · Electrical Eng. & Systems 2023-02-21 Shan Lin , Albert J. Miao , Jingpei Lu , Shunkai Yu , Zih-Yun Chiu , Florian Richter , Michael C. Yip

Recent Artificial Intelligence (AI) models have matched or exceeded human experts in several benchmarks of biomedical task performance, but surgical benchmarks in particular are often missing from prominent medical benchmark suites. Since…

Robotic assisted (RA) surgery promises to transform surgical intervention. Intuitive Surgical is committed to fostering these changes and the machine learning models and algorithms that will enable them. With these goals in mind we have…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Aneeq Zia , Max Berniker , Rogerio Garcia Nespolo , Xiaorui Zhang , Conor Perreault , Kiran Bhattacharyya , Xi Liu , Ziheng Wang , Satoshi Kondo , Satoshi Kasai , Kousuke Hirasawa , Bo Liu , David Austin , Yiheng Wang , Michal Futrega , Jean-Francois Puget , Zhenqiang Li , Yoichi Sato , Ryo Fujii , Ryo Hachiuma , Mana Masuda , Hideo Saito , An Wang , Mengya Xu , Mobarakol Islam , Long Bai , Winnie Pang , Hongliang Ren , Chinedu Nwoye , Luca Sestini , Nicolas Padoy , Maximilian Nielsen , Samuel Schüttler , Thilo Sentker , Hümeyra Husseini , Ivo Baltruschat , Rüdiger Schmitz , René Werner , Aleksandr Matsun , Mugariya Farooq , Numan Saaed , Jose Renato Restom Viera , Mohammad Yaqub , Neil Getty , Fangfang Xia , Zixuan Zhao , Xiaotian Duan , Xing Yao , Ange Lou , Hao Yang , Jintong Han , Jack Noble , Jie Ying Wu , Tamer Abdulbaki Alshirbaji , Nour Aldeen Jalal , Herag Arabian , Ning Ding , Knut Moeller , Weiliang Chen , Quan He , Muhammad Bilal , Taofeek Akinosho , Adnan Qayyum , Massimo Caputo , Hunaid Vohra , Michael Loizou , Anuoluwapo Ajayi , Ilhem Berrou , Faatihah Niyi-Odumosu , Charlie Budd , Oluwatosin Alabi , Tom Vercauteren , Ruoxi Zhao , Ayberk Acar , John Han , Jumanh Atoum , Yinhong Qin , Surong Hua , Lu Ping , Wenming Wu , Rongfeng Wei , Jinlin Wu , You Pang , Zhen Chen , Tim Jaspers , Amine Yamlahi , Piotr Kalinowski , Dominik Michael , Tim Rädsch , Marco Hübner , Danail Stoyanov , Stefanie Speidel , Lena Maier-Hein , Jie Tian , Ruxin Zhang , Khang Hoang Nguyen , Anh Quoc Nguyen , Tam Minh Nguyen , Khoi Dinh Tran , Minh Nguyen Dang Nhat , Trinh Thi Doan Pham , Linh Van Nguyen , Chunyang Jiang , Dewei Yang , Haitao Li , Yannick Prudent , Thibaut Boissin , Mahmood Alam , Shazad Ashraf , Andrew D. Beggs , Lukman Akanbi , Manuel D. Delgado , Narain Gupta , Amir M. Hajiyavand , Iqbal Qasim , Hafiz A. Alaka , Junaid Qadir , Shu Yang , Yihui Wang , Hao Chen , Shin Paul , Yosuke Yamagishi , Zhang Dong , Hongyun Li , Hongyu Gu , Xiaoliu Ding , Xiaoyao Liu , Xingyu Zhao , Mariana Ribeiro , Tiago Jesus , André Ferreira , Guilherme Barbosa , João Carvalho , Leonardo Barroso , Nuno Gomes , Rafael Peixoto , Rodrigo Ralha , Victor Alves , Stephanie , Nattapat Ittikosil , Achita Chitrapan , Quan Huu Cap , Jiayuan Huang , Shreyas C Dhake , Sergi Kavtaradze , Mobarak I Hoque , Ka Young Kim , Su Yong Yun , Young Tae Kim , Hyeon Bae Kim , Seong Tae Kim , Zuxing Deng , Ling Li , Jieyu Zheng , Xiaojian Li , Anthony Jarc

Medical visual question answering (Med-VQA) has tremendous potential in healthcare. However, the development of this technology is hindered by the lacking of publicly-available and high-quality labeled datasets for training and evaluation.…

Computer Vision and Pattern Recognition · Computer Science 2021-02-19 Bo Liu , Li-Ming Zhan , Li Xu , Lin Ma , Yan Yang , Xiao-Ming Wu

Over the past few years, surgical data science has attracted substantial interest from the machine learning (ML) community. Various studies have demonstrated the efficacy of emerging ML techniques in analysing surgical data, particularly…

Image and Video Processing · Electrical Eng. & Systems 2023-07-06 Adnan Qayyum , Hassan Ali , Massimo Caputo , Hunaid Vohra , Taofeek Akinosho , Sofiat Abioye , Ilhem Berrou , Paweł Capik , Junaid Qadir , Muhammad Bilal

Surgical data science is a scientific discipline with the objective of improving the quality of interventional healthcare and its value through capturing, organization, analysis, and modeling of data. The goal of the 1st workshop on…

While there has been remarkable progress in the performance of visual recognition algorithms, the state-of-the-art models tend to be exceptionally data-hungry. Large labeled training datasets, expensive and tedious to produce, are required…

Computer Vision and Pattern Recognition · Computer Science 2016-06-07 Fisher Yu , Ari Seff , Yinda Zhang , Shuran Song , Thomas Funkhouser , Jianxiong Xiao

With increasing amounts of visual data being created in the form of videos and images, visual data selection and summarization are becoming ever increasing problems. We present Vis-DSS, an open-source toolkit for Visual Data Selection and…

Computer Vision and Pattern Recognition · Computer Science 2018-09-25 Rishabh Iyer , Pratik Dubal , Kunal Dargan , Suraj Kothawade , Rohan Mahadev , Vishal Kaushal

Recent advances in deep learning have transformed computer-assisted intervention and surgical video analysis, driving improvements not only in surgical training, intraoperative decision support, and patient outcomes, but also in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Sahar Nasirihaghighi , Negin Ghamsarian , Leonie Peschek , Matteo Munari , Heinrich Husslein , Raphael Sznitman , Klaus Schoeffmann

The increase in the availability of online videos has transformed the way we access information and knowledge. A growing number of individuals now prefer instructional videos as they offer a series of step-by-step procedures to accomplish…

Computation and Language · Computer Science 2023-09-22 Deepak Gupta , Kush Attal , Dina Demner-Fushman

Multi-modal models are data hungry. While datasets with natural images are abundant, medical image datasets can not afford the same luxury. To enable representation learning for medical images at scale, we turn to YouTube, a platform with a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Wisdom O. Ikezogwo , Kevin Zhang , Mehmet Saygin Seyfioglu , Fatemeh Ghezloo , Linda Shapiro , Ranjay Krishna

Supervised learning demands large amounts of precisely annotated data to achieve promising results. Such data curation is labor-intensive and imposes significant overhead regarding time and costs. Self-supervised learning (SSL) partially…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Thangarajah Akilan , Nusrat Jahan , Wandong Zhang

Semantic segmentation of medical images aims to associate a pixel with a label in a medical image without human initialization. The success of semantic segmentation algorithms is contingent on the availability of high-quality imaging data…